Freelance Senior Databricks Platform Engineer
Sign up free to see how well your resume matches this role.
What you'll do
- Design and implement Lakehouse architectures on Databricks (medallion / bronze‑silver‑gold patterns, Delta Lake, Unity Catalog).
- Build robust batch and streaming data pipelines using PySpark and Spark SQL, orchestrated via Databricks Workflows / Jobs.
- Model data for analytics use cases (e.g. star schema for BI, curated datasets for data science).
- Ingest data from APIs, files, databases and SaaS sources into data lakes and lakehouses.
- Implement clear and testable transformation logic (data quality checks, deduplication, SCD, CDC, business rules).
- Apply data governance best practices (cataloguing, lineage, RBAC, masking of sensitive data).
- Set up CI/CD and deployment pipelines (Azure DevOps / GitHub) for Databricks assets (notebooks, jobs, pipelines, workflows).
- Using Terraform to automated IaaC setup and reusability
- Monitor, optimize and troubleshoot pipelines and clusters for performance, robustness and cost efficiency.
- Help define and implement best practices, coding standards and reusable components within the team.
What they're looking for
- Databricks platform architecture
- Unity Catalog and governance
- CI/CD and DevOps for Databricks - Enterprise GitHub
- Terraform / Infrastructure as Code
- Lakehouse architecture
- Data Product Platform enablement
Nice to have
- The Knowledge Graph, ontology and agentic AI are considered a strong plus.
- Unity catalogue, CICD, IAC and terraform skills in mode implementation and integration
Summarised by NextRaise from the employer’s description, which follows in full below.
Full description from employer
adesso Belgium, who are we? We are an IT (start-up) provider working under the adesso umbrella with proven track record in different industries. The new Belgian entity of adesso is part of the expansion and growth strategy of the adesso group.
Start date: ASAP- Remote work
Duration: 6 months
Rate: TBD- depending on your location
For one of our international customers, we are urgently looking for a senior Databricks Platform engineer.
The role we are currently looking for is closer to a Databricks Platform Engineer than a traditional Data Engineer or BI consultant. The objective is to help design and build a Data Product Platform on Databricks, with a strong focus on platform architecture, governance, Infrastructure as Code, CI/CD, security, and enabling multiple teams to build and operate data products.
Your Role in projects:
Design & build data platforms
Design and implement Lakehouse architectures on Databricks (medallion / bronze‑silver‑gold patterns, Delta Lake, Unity Catalog).
Build robust batch and streaming data pipelines using PySpark and Spark SQL, orchestrated via Databricks Workflows / Jobs.
Model data for analytics use cases (e.g. star schema for BI, curated datasets for data science).
Ingest, transform & govern data
Ingest data from APIs, files, databases and SaaS sources into data lakes and lakehouses.
Implement clear and testable transformation logic (data quality checks, deduplication, SCD, CDC, business rules).
Apply data governance best practices (cataloguing, lineage, RBAC, masking of sensitive data).
Operate & optimize
Set up CI/CD and deployment pipelines (Azure DevOps / GitHub) for Databricks assets (notebooks, jobs, pipelines, workflows).
Using Terraform to automated IaaC setup and reusability
Monitor, optimize and troubleshoot pipelines and clusters for performance, robustness and cost efficiency.
Help define and implement best practices, coding standards and reusable components within the team.
Your profile - Required technical skills & knowledge:
Proven experience in:
Databricks platform architecture
Unity Catalog and governance
CI/CD and DevOps for Databricks - Enterprise GitHub
Terraform / Infrastructure as Code
Lakehouse architecture
Data Product Platform enablement
The Knowledge Graph, ontology and agentic AI are considered a strong plus.
Unity catalogue, CICD, IAC and terraform skills in mode implementation and integration
Why join adesso Belgium?
Work in an international group with strong local expertise in Belgium.
Collaborate with cross-functional teams within the international data & AI adesso community.
Flexible freelance setup with the support of a growing adesso Belgium community.
Company
Company facts come from this company's own listings. We only show what the postings themselves carry.