Senior Data Engineer

Position Overview: As a Data Connector Developer, your role is crucial in building and maintaining efficient data integration solutions that connect various data sources and systems within an organization. You will be responsible for designing, developing, and implementing data connectors to enable seamless data flow and integration across different platforms, databases, APIs, and third-party applications. Your expertise in data connectivity and integration will contribute to the organization's overall data strategy and help ensure the availability and accuracy of data for various business functions.

Years of Experience: 2 to 4 years

Key Responsibilities:
•  This involves understanding the data models, APIs, and protocols of various data sources and developing connectors that can extract, transform, and load data effectively.
•  Define data mappings, transformations, and business rules to ensure consistency and accuracy of integrated data.
•  Identify opportunities to optimize data integration processes, reduce latency, and enhance data quality.
•  Conduct rigorous testing of data connectors and integration processes to identify and resolve any issues or bugs. Ensure data integrity, reliability, and consistency by performing regular data validation and reconciliation tasks.
•  Create and maintain technical documentation, including specifications, user guides, and best practices for data integration and connector development. 
•  Share knowledge and provide training to other team members or stakeholders to promote self-service data integration capabilities.
•  Provide technical support and troubleshooting assistance to resolve integration-related issues.
•  Adhere to data governance policies, standards, and regulatory requirements while handling sensitive and confidential data. Implement necessary security measures to protect data during integration and transit.
Qualifications and Skills:
•  Bachelor’s degree in computer science, Information Systems, or a related field (or equivalent experience). 
•  Strong programming skills in languages such as Python/Java, and SQL. 
•  Proven experience in developing microservices-based applications using languages like Java, Python, or Node.js. 
•  Strong understanding of microservices architecture, design patterns, and best practices.
•  Familiarity with data modelling concepts and experience working with diverse data formats (e.g., JSON, XML, CSV, relational databases). 
•  Solid understanding of integration patterns, protocols, and APIs (e.g., REST, SOAP, GraphQL).
•  Experience with version control systems (e.g., Git) and continuous integration/continuous deployment (CI/CD) practices.
•  Excellent problem-solving skills and attention to detail.
•  Strong communication and collaboration skills to work effectively with cross-functional teams and stakeholders.
•  Familiarity with data governance principles, data security, and compliance standards is a plus.