Cognine·4 months ago
4 months ago
Big Data Engineer
Sign up free to see how well your resume matches this role.
About this role
Job Summary:
We are looking for a skilled Big Data Engineer with strong experience in PySpark and data engineering. The ideal candidate will have hands-on experience in building scalable data pipelines, working with streaming data, and cloud platforms. Experience with Palantir Foundry is highly preferred
Experience Required: 5 – 10 years
Key Responsibilities:
- Design, develop, and maintain ETL/data pipelines using Python and PySpark
- Work with real-time/streaming data systems
- Build and optimize data processing solutions on cloud platforms
- Collaborate with cross-functional teams to understand business requirements
- Develop and maintain CI/CD pipelines
- Ensure data quality, performance, and scalability
Required Skills:
- 5–10+ years of experience in Data Engineering
- Strong expertise in Python and PySpark
- Experience with Kafka, Flink, and Kubernetes
- Hands-on with Big Data technologies (Hadoop, Spark, MongoDB)
- Experience with cloud platforms (Azure, AWS, or GCP)
- Good understanding of data architecture and pipeline design
Preferred Skills:
- Experience with Palantir Foundry
- Knowledge of Java
- Experience in consulting or Utilities domain
Company
Cognine
Hyderabad, India
Company facts come from this company's own listings. We only show what the postings themselves carry.