Back to board
atgeir·9 months ago

Senior Data Engineer

Pune, IndiaFull-timeMid · 5-8 years

About this role

Proven Skills with: 
  • Writing Complex SQL Queries
  • Unix Shell Scripting
  • Data Warehousing Fundamentals
  • Experience with ETL/ELT pipelines
  • Relational Database
  • SQL, NoSQL
  • Data Mapping, Data Modeling, Data Mining, and Data Warehousing/Mart Relational databases and SQL Query performance tuning
  • Hands-on experience with at least one programming language Python / Java
  • Good understanding of Big Data Fundamentals (Hadoop/Spark) and Data Processing Pipelines
  • Hands-on experience with at least one cloud platform (GCP, AWS, Azure)

Responsibilities

  • Design, Develop and Deploy scalable data pipelines and data services,
  • Design, develop, and test data processes per business requirements, following the development standards and best practices as well as participating in code peer reviews to ensure our applications comply with best practices.
  • Work with business analysts to gather business requirements from end users and translate them into technical specifications.
  • Gather requirements to define data definitions, transformation logic, and data model logical and physical designs, data flow, and process.
  • Provide estimates for development.
  • Perform data analysis and data profiling against source systems and data warehouse.
  • Test solutions to validate whether requirements have been met; develop test plans, test scripts, and test conditions based on the business and system requirements.
  • Provide end-user support in post-deployment phases; assess and evaluate all feedback to ensure that the requirements necessary to correct issues are addressed.
  • Integrate new data management technologies and software engineering tools into existing infrastructure,
  • Research opportunities for data acquisition and new uses for existing data
  • Collaborate with data scientists and researchers to develop algorithms including prototypes, predictive models, and proof of concepts,
  • Work with clients across geographies in an agile team environment,
  • Constantly learn new technologies, frameworks, and tools.
  • Exp. with Agile development.
  • Excellent verbal and written communication skills are a must.


Similar jobs