Senior Data Platform Engineer

Job Title: Data Platform Engineer (Infrastructure & Data Engineering)

Purpose
Support the design, build, and operation of the Data Platform, blending infrastructure engineering with data engineering practices to keep the Databricks/Azure environment reliable, automated, and self-service for platform users.

Key Responsibilities

• Design and maintain CI/CD pipelines (DevOps/GitHub Actions) for infrastructure and application deployments
• Write and maintain Terraform IaC for Azure services and Azure Databricks (Unity Catalog, workspaces, networking, compute policies)
• Develop and support application code in Python and/or .NET for platform tooling and automation
• Build and maintain shared libraries/modules used by data engineers and analysts across the platform
• Design and implement pipelines/processes that support platform management (cost tracking, governance, provisioning, monitoring)
• Collaborate with data engineers, analysts, and security/infra teams to translate requirements into platform capabilities
• Troubleshoot infrastructure, pipeline, and integration issues (networking, auth, connectivity)
• Contribute to platform documentation and best-practice standards

Required Skills & Experience

• Solid experience with Microsoft Azure infrastructure (Entra ID, Key Vault, networking, storage)
• Hands-on Azure Databricks experience (Unity Catalog, cluster/job management)
• Terraform (IaC) experience, ideally in a multi-environment setup
• Proficiency in Python; working knowledge of SQL; .NET is a plus
• Experience building/maintaining CI/CD pipelines (Azure DevOps, GitHub Actions, or similar)
• Understanding of data platform governance and cost management concepts
• Comfortable working across the infra/data engineering boundary

Nice to Have

• Experience with medallion architecture (Bronze/Silver/Gold)
• Exposure to FinOps/cost attribution practices

Role 2 -
Job Title: Senior Data Engineer – Databricks experienced

Purpose

We are seeking a highly skilled Senior Data Engineer with deep expertise in Databricks, Azure, and modern data engineering practices to design, build, and optimize scalable data platforms and pipelines. The ideal candidate will have strong hands-on experience with Databricks, Delta Lake, Spark, and Azure cloud services, enabling data-driven decision-making across the organization. (Databricks experience senior data engineer) – Expecting more details around this role by Monday afternoon.