Pyspark Data Engineer
Sign up free to see how well your resume matches this role.
What you'll do
- Design and develop scalable data pipelines using PySpark and CDP .
- Build, optimize, and maintain data ingestion and transformation processes.
- Ensure data quality, integrity, and availability across platforms.
- Work with large-scale datasets and big data ecosystems.
- Collaborate with cross-functional teams to deliver data-driven solutions.
- Monitor and troubleshoot data workflows and performance issues.
What they're looking for
- Strong experience in PySpark and Cloudera Data Platform (CDP) .
- Hands-on experience with Hadoop, Hive, HDFS, Spark , and ETL processes.
- Good understanding of data warehousing and big data architecture.
- Experience with cloud and distributed data processing environments.
- Strong problem-solving and analytical skills.
Nice to have
- Experience: 5+ Years (preferred)
Summarised by NextRaise from the employer’s description, which follows in full below.
Full description from employer
Job Title: Data Engineer
Location: Chennai
Job Description:
We are looking for a skilled Data Engineer with strong expertise in PySpark and Cloudera Data Platform (CDP) to design, develop, and maintain scalable data pipelines. The ideal candidate will have experience working with big data technologies, cloud-native environments, and data processing frameworks to ensure high-quality and reliable data solutions.
Key Responsibilities:
- Design and develop scalable data pipelines using PySpark and CDP.
- Build, optimize, and maintain data ingestion and transformation processes.
- Ensure data quality, integrity, and availability across platforms.
- Work with large-scale datasets and big data ecosystems.
- Collaborate with cross-functional teams to deliver data-driven solutions.
- Monitor and troubleshoot data workflows and performance issues.
Required Skills:
- Strong experience in PySpark and Cloudera Data Platform (CDP).
- Hands-on experience with Hadoop, Hive, HDFS, Spark, and ETL processes.
- Good understanding of data warehousing and big data architecture.
- Experience with cloud and distributed data processing environments.
- Strong problem-solving and analytical skills.
Experience: 5+ Years (preferred)
Location: Chennai
SYNECHRON’S DIVERSITY & INCLUSION STATEMENT
Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.
All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.
Company
Company facts come from this company's own listings. We only show what the postings themselves carry.