Senior Data Engineer - DBT
Sign up free to see how well your resume matches this role.
What you'll do
- Building large-scale AWS data engineering solutions
- Designing and implementing Lakehouse solutions using Apache Iceberg
- Building scalable batch and streaming data pipelines on AWS
- Implementing monitoring, logging, alerting, and observability for production data pipelines
- Providing data quality, troubleshooting, debugging, and production support
What they're looking for
- 3+ years of hands-on experience building large-scale AWS data engineering solutions.
- Strong hands-on experience with DBT(Cloud+Core).
- Hands-on expertise into Redshift warehouse and Analytics.
- Strong hands-on expertise in SQL (analytical queries, window functions, stored procedures), Spark/PySpark, Python.
- Hands-on experience designing and implementing Lakehouse solutions using Apache Iceberg.
- Strong knowledge of AWS services including SMUS, EC2, DynamoDB, API Gateway, MWAA, EMR, S3, Athena, Glue Catalog, Aurora PostgreSQL, Lambda, CloudWatch, SQS, SNS, EventBridge, Secrets Manager, CloudWatch and IAM.
- Experience building scalable batch and streaming data pipelines on AWS.
- Strong experience in Spark/PySpark performance tuning and optimization.
- Hands-on experience optimizing Apache Iceberg and Aurora PostgreSQL for performance and scalability.
- Strong understanding of data modeling, partitioning, file formats, and Lakehouse/Data Lake architectures.
- Experience implementing monitoring, logging, alerting, and observability for production data pipelines.
- Strong knowledge of data quality, troubleshooting, debugging, and production support.
Nice to have
- AWS Data Engineer Associate or equivalent AWS Certification is preferred.
- Experience with AWS Step Functions.
- Experience with Terraform or Infrastructure as Code.
- Exposure to Kafka, Hive, HDFS or other Big Data technologies.
- Hands-on experience using GenAI-assisted development tools such as Kiro, Copilot, Cursor, or similar AI coding assistants to improve engineering productivity.
- Experience with ClickHouse Database
- Telecom/Mobile Network domain knowledge is preferred.
- Experience and knowledge of Atscale design and development.
Summarised by NextRaise from the employer’s description, which follows in full below.
Full description from employer
While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!
JOB ROLE : Senior Data Engineer
Experience : 4-7 Years
Location : Mumbai/Bangalore
Must have Primary skills:
3+ years of hands-on experience building large-scale AWS data engineering solutions.
Strong hands-on experience with DBT(Cloud+Core).(highly recommended skill)
Hands-on expertise into Redshift warehouse and Analytics.
Strong hands-on expertise in SQL (analytical queries, window functions, stored procedures), Spark/PySpark, Python.
Hands-on experience designing and implementing Lakehouse solutions using Apache Iceberg.
Strong knowledge of AWS services including SMUS, EC2, DynamoDB, API Gateway, MWAA, EMR, S3, Athena, Glue Catalog, Aurora PostgreSQL, Lambda, CloudWatch, SQS, SNS, EventBridge, Secrets Manager, CloudWatch and IAM.
Experience building scalable batch and streaming data pipelines on AWS.
Strong experience in Spark/PySpark performance tuning and optimization.
Hands-on experience optimizing Apache Iceberg and Aurora PostgreSQL for performance and scalability.
Strong understanding of data modeling, partitioning, file formats, and Lakehouse/Data Lake architectures.
Experience implementing monitoring, logging, alerting, and observability for production data pipelines.
Strong knowledge of data quality, troubleshooting, debugging, and production support.
Experience with CI/CD, Git, and data engineering best practices.
Strong communication, problem-solving, and stakeholder management skills.
AWS Data Engineer Associate or equivalent AWS Certification is preferred.
Good to have skills :
Experience with AWS Step Functions.
Experience with Terraform or Infrastructure as Code.
Exposure to Kafka, Hive, HDFS or other Big Data technologies.
Hands-on experience using GenAI-assisted development tools such as Kiro, Copilot,Cursor, or similar AI coding assistants to improve engineering productivity.
Experience with ClickHouse Database
Telecom/Mobile Network domain knowledge is preferred.
Experience and knowledge of Atscale design and development.
knowledge of Docker and Kubernetes.
If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
Company
Company facts come from this company's own listings. We only show what the postings themselves carry.