Data Engineering Lead

We are looking for a Data Engineering Lead to join our AMS team supporting a large scale analytics platform for a major Oil & Gas enterprise. You will lead the data engineering track, managing ETL pipelines, data transformations, and ensuring platform reliability.

• AWS Glue, AWS Lambda, Amazon Redshift, Aurora PostgreSQL

• MSK Kafka, AWS SQS, AWS Transfer Family

• Apache Airflow (orchestration)

• SQL, Python

What You'll Do:

• Lead a team of 3 data engineers in maintaining & enhancing large-scale data assets

• Own ETL pipeline performance, monitoring & optimization

• Handle production incidents (24x7 rotation for P1 issues)

• Drive enhancements within defined SLA timelines

• Collaborate with client business advisory team

• Create & maintain runbooks and documentation

Requirements:

• 8+ years in Data Engineering with leadership experience

• Expert in AWS data services (Glue, Redshift, Aurora)

• Strong SQL and Python skills

• Experience managing production data pipelines at scale

• Ability to work from Mumbai (client site as required)

• Available for weekend/night on-call rotation

Nice to Have: - Experience in Oil & Gas domain / large enterprise analytics