Director, Software Engineering
Sign up free to see how well your resume matches this role.
What you'll do
- Lead the design, optimization, and scalability of distributed Spark/PySpark pipelines powering entity resolution and large-scale healthcare data processing.
- Own systems supporting automatching, identity mapping, grouping logic, deduplication, enrichment, and auto-approval workflows across healthcare provider and organization datasets.
- Build and maintain scalable processing frameworks for PubMed, clinical trial, ct.gov, conference, and other healthcare data sources.
- Drive infrastructure optimization initiatives focused on improving throughput, runtime, observability, and cloud compute cost efficiency.
- Partner closely with AI/ML teams to integrate matching and resolution models into EMERALD and improve matching precision and recall.
- Lead complex technical initiatives from architecture and design through deployment, monitoring, and long-term production support.
- Serve as a technical leader and mentor across the team through code reviews, technical guidance, and engineering best practices.
- Collaborate directly with Product and business stakeholders to align technical solutions with operational and customer needs.
- Support production operations, incident response, troubleshooting, and ongoing platform reliability.
What they're looking for
- 8+ years of experience building and maintaining large-scale distributed data systems and pipelines.
- Demonstrated technical leadership experience mentoring engineers and driving complex technical initiatives.
- Extensive experience with Apache Spark and AWS-based big data technologies including EMR, S3, and distributed compute environments.
- Strong coding experience in Python (PySpark), Scala, Java, or equivalent languages used for distributed processing systems.
- Experience optimizing large-scale Spark workloads for performance, scalability, and infrastructure cost efficiency.
- Experience with streaming and event-driven architectures using technologies such as Kafka or Spark Streaming.
- Experience with orchestration and lakehouse technologies such as Argo and Hudi or comparable platforms.
- Experience with containerization and infrastructure technologies such as Docker, Kubernetes, and Terraform.
- Experience working with relational or distributed databases such as PostgreSQL or Redshift.
- Proven ability to operate effectively within highly scalable, production-grade distributed systems.
- Experience working with healthcare, life sciences, Real World Evidence (RWE), or large-scale healthcare datasets is strongly preferred.
Nice to have
- Experience with entity resolution, identity mapping, automatching, deduplication, or large-scale matching systems is strongly preferred.
- Experience working with healthcare, life sciences, Real World Evidence (RWE), or large-scale healthcare datasets is strongly preferred.
Summarised by NextRaise from the employer’s description, which follows in full below.
Full description from employer
At H1, we believe access to the best healthcare information is a basic human right. Our mission is to provide a platform that can optimally inform every doctor interaction globally. This promotes health equity and builds needed trust in healthcare systems. To accomplish this, our teams harness the power of data and AI-technology to unlock groundbreaking medical insights and convert those insights into action that result in optimal patient outcomes and accelerates an equitable and inclusive drug development lifecycle. Visit h1.com to learn more about us.
As part of H1’s hiring process, all candidates are required to participate in an in-person final interview. Depending on your location, this may require travel.
H1's Product Engineering organization is the engine behind the products that put our data in front of the people who need it most, health plans, digital health companies, life sciences organizations, and the clinical teams they serve. We build the client-facing products, APIs, integrations, and intelligent workflows that transform H1's rich underlying data into real decisions: which providers belong in a network directory, where clinical trials should run, and how healthcare organizations can operate with greater accuracy and trust. Product Engineering at H1 sits at the crossroads of complex data systems and enterprise software delivery, and our work directly drives revenue, client retention, and patient impact. We move fast, we own our products end-to-end, and we hold ourselves to a high bar — because in healthcare, the quality of what we build has consequences.
You will:
- Lead, grow, and develop a high-performing product engineering team; hiring, coaching, performance management, and building a culture where engineers do their best work
- Partner with Product Management to co-own the roadmap, translating client needs and business priorities into a clear engineering strategy and delivery plan
- Set technical direction; architecture standards, agentic workflow practices, and the bar for what good looks like — while staying close enough to engage meaningfully in system design decisions with your team
- Own delivery accountability for your segment: on-time, high-quality releases that meet client SLAs
- Run the engineering operating rhythm, manage on-call schedules, sprint planning, triage outages, retrospectives, and incident reviews, with structure and consistency
- Manage competing priorities across Customer Support, sales, PM, and engineering, communicating tradeoffs clearly and making calls when the path isn't obvious
- Serve as the senior engineering voice in cross-functional conversations; occasionally engaging directly with clients as a subject matter expert, though your primary surface is internal
- Own multiple product lines simultaneously, bringing prioritization and clarity across a growing portfolio
- Proven track record owning a SaaS product end-to-end in a complex data environment, from technical architecture through client delivery and operations.
- Experience managing multiple product lines simultaneously with a clear approach to prioritization and keeping teams unblocked.
- Backend product engineering background: APIs, client-facing integrations, data-driven product surfaces, and visualization layers, this is not a data pipeline, infrastructure, or ML role.
- Track record of building and developing engineering teams; people who grew under your leadership.
- Able to articulate your agentic workflow and stay meaningfully close to the technology without coding daily; you can engage substantively in architecture and system design conversations with your team.
- Strong communicator across audiences; executives, sales leaders, engineers, and clients, and a trusted technical voice in commercial conversations
- Decisive under ambiguity; you own stakeholder relationships across CS, PM, sales, and engineering and communicate tradeoffs clearly
- Preferred: experience in healthcare, medical, or insurance/payer technology; strongly preferred for the Health Plans role
Anticipated role close date: 10/20/2026
Company
Company facts come from this company's own listings. We only show what the postings themselves carry.