Senior Data Engineer — Microsoft Fabric | Active Secret
Sign up free to see how well your resume matches this role.
What you'll do
- Lead the design, development, and optimization of enterprise data ingestion pipelines, transformation logic, and data platform components within Microsoft Fabric
- Design and implement scalable ETL and ELT architectures supporting structured and semi-structured enterprise data
- Configure, administer, and maintain Microsoft Fabric environments, including tenant administration, workspace architecture, capacity management, security configuration, and environment governance
- Implement and maintain Bronze, Silver, and Gold medallion architecture layers
- Develop data transformation processes incorporating schema validation, cleansing, normalization, enrichment, and reconciliation
- Establish data quality monitoring, validation controls, automated testing, and alerting for pipeline and data-quality failures
- Design and implement development, test, staging, and production environment separation
- Build and maintain CI/CD deployment pipelines for data platform components, pipelines, notebooks, configurations, and related artifacts
- Implement infrastructure-as-code approaches for repeatable, version-controlled data platform deployments
- Develop and optimize Spark, PySpark, SQL, and related data-processing workloads
- Configure and maintain data security controls, including encryption, Role-Based Access Control (RBAC), Microsoft Entra ID integration, Privileged Identity Management, and least-privilege access controls
- Support secure integration between Microsoft Fabric and enterprise source systems
What they're looking for
- Significant experience designing and implementing enterprise data pipelines, ETL/ELT processes, and cloud-based data platforms
- Hands-on experience with Microsoft Fabric
- Experience administering or configuring enterprise cloud data environments
- Strong experience with Azure Data Factory or comparable data integration technologies
- Strong SQL proficiency
- Experience with Spark and PySpark for large-scale data processing and transformation
- Experience implementing enterprise ETL/ELT frameworks
- Experience designing and implementing medallion architectures using Bronze, Silver, and Gold data layers
- Experience with schema validation, data cleansing, normalization, reconciliation, and data quality controls
- Experience developing CI/CD pipelines for data platform deployments
- Experience implementing infrastructure-as-code
- Experience with source control, automated deployment, and environment promotion processes
Nice to have
- Microsoft Certified: Fabric Analytics Engineer Associate
- Advanced experience with Microsoft Fabric Lakehouse architecture
- Experience configuring Microsoft Fabric tenants, capacities, workspaces, and deployment pipelines
- Experience with Microsoft Entra ID and Privileged Identity Management
- Experience with Azure DevOps, GitHub Actions, GitLab CI/CD, or comparable CI/CD platforms
- Experience with Terraform, Bicep, ARM templates, or comparable infrastructure-as-code technologies
- Experience designing automated data quality monitoring and alerting
- Experience supporting hybrid on-premises and cloud data environments
Summarised by NextRaise from the employer’s description, which follows in full below.
Full description from employer
Senior Data Engineer — Microsoft Fabric
Remote | Active Secret Clearance
Build and Modernize a Mission-Focused Data Platform
Help shape the data engineering foundation behind a major federal data modernization effort.
As a Senior Data Engineer at Rackner, you'll lead hands-on implementation across Microsoft Fabric, enterprise data pipelines, medallion architecture, automation, security, and deployment. You'll have room to influence how the platform is built and operated; not simply maintain existing pipelines.
This is a strong fit for an engineer who wants to stay hands-on while taking on broader technical ownership: solving difficult platform problems, establishing reusable engineering practices, mentoring other engineers, and working across architecture, cybersecurity, governance, and application teams.
Rackner is building the broader data engineering team across multiple experience levels, so strong candidates may also be considered for the level that best matches their background.
What You'll Lead and Build
- Lead the design and optimization of enterprise data pipelines and transformation workflows in Microsoft Fabric
- Build scalable ETL/ELT solutions across structured and semi-structured data
- Configure and support Fabric tenants, workspaces, capacity, security, and environment separation
- Implement Bronze, Silver, and Gold medallion architecture patterns
- Develop transformation and data-quality processes using SQL, Python, Spark, and PySpark
- Establish automated validation, reconciliation, monitoring, and alerting
- Build CI/CD and infrastructure-as-code practices for repeatable data-platform deployments
- Apply security controls including encryption, RBAC, Microsoft Entra ID, and least-privilege access
- Support secure integration across cloud and on-premises enterprise systems
- Solve complex pipeline, performance, connectivity, and data-quality problems
- Strengthen resilience through rollback, recovery, disaster-recovery, and continuity practices
- Create reusable engineering patterns and technical documentation that improve how the broader team works
- Partner with data architects, governance, cybersecurity, application, and source-system teams
- Mentor Data Engineers and Associate Data Engineers and help raise engineering standards across the program
What You'll Bring
- Deep hands-on work with enterprise data pipelines and modern ETL/ELT patterns
- Strong Microsoft Fabric capabilities
- Advanced SQL skills and working proficiency with Python, Spark, or PySpark
- Familiarity with Azure Data Factory or comparable cloud data-integration technologies
- Practical knowledge of medallion or modern Lakehouse architecture
- CI/CD and automated deployment knowledge within a data-platform environment
- Infrastructure-as-code knowledge
- Production troubleshooting across pipelines, integrations, or cloud data platforms
- Understanding of cloud identity, RBAC, encryption, and least-privilege security
- Ability to communicate technical decisions clearly and guide other engineers
- Active Secret clearance
Standout Background
Additional value may come from:
- Microsoft Certified: Fabric Analytics Engineer Associate
- Advanced Fabric Lakehouse implementation
- Fabric tenant, workspace, capacity, or deployment-pipeline administration
- Microsoft Entra ID or Privileged Identity Management
- Terraform, Bicep, ARM, or comparable infrastructure-as-code tooling
- Hybrid cloud and on-premises integration
- Enterprise data-quality monitoring
- Disaster recovery and business-continuity engineering
- Federal or Department of Defense data environments
Why Rackner
At Rackner, you'll work on technology tied directly to complex federal missions while remaining close to the engineering.
This role offers the opportunity to build rather than simply maintain, influence technical practices, work with modern Microsoft data technologies, and grow your leadership impact without moving away from hands-on engineering.
Our teams work across cloud, DevSecOps, AI/ML, data, and modern software engineering, giving engineers exposure to technical problems beyond a single platform or workstream.
Benefits & Perks
- Company-supported certifications aligned with current and future program work
- Career-development and leadership opportunities
- 401(k) with 100% match up to 6%
- Medical, dental, vision, life, and disability coverage
- Generous PTO and paid holidays
- Home-office equipment and remote-work support
- Fitness and wellness reimbursement
- Weekly pay and team events
Equal Opportunity
Rackner is an equal opportunity employer and considers all qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or other protected characteristics.
Company
Company facts come from this company's own listings. We only show what the postings themselves carry.