Sr. Principal Engineer AI/ML System Integration
Sign up free to see how well your resume matches this role.
What you'll do
- Lead architecture and integration strategy for AI/ML-enabled products and platforms.
- Design scalable solutions that integrate applications, APIs, data platforms, AI services, and business workflows.
- Establish reusable integration patterns, architecture standards, and technical governance practices.
- Integrate AI/ML capabilities, LLMs, RAG solutions, agents, and analytics services into enterprise applications.
- Guide technical decisions regarding model usage, orchestration, workflow automation, and human-in-the-loop controls.
- Ensure solutions are secure, resilient, observable, and operationally supportable.
- Design and govern data flows across operational systems, data platforms, semantic layers, and AI services.
- Partner with platform and engineering teams to enable scalable cloud-native architectures and deployment models.
- Ensure data quality, security, lineage, and compliance requirements are addressed.
- Establish end-to-end testing, monitoring, observability, and AI evaluation practices.
- Promote Responsible AI principles, security-by-design, and privacy-by-design approaches.
- Drive production readiness, operational support models, and continuous improvement practices.
What they're looking for
- 8+ years of experience in software engineering, solution architecture, systems integration, or platform engineering.
- Experience architecting and delivering complex enterprise solutions integrating multiple systems, platforms, and data sources.
- Strong understanding of cloud-native architecture, APIs, microservices, event-driven systems, and integration patterns.
- Experience with AI/ML-enabled applications, including LLMs, RAG, agentic workflows, or related technologies.
- Experience with cloud platforms such as Azure, AWS, or GCP.
- Familiarity with MLOps, LLMOps, DevSecOps, and modern software delivery practices.
- Strong communication, stakeholder management, and technical leadership skills.
Nice to have
- Experience in healthcare, life sciences, commercial analytics, CRM, field engagement, or customer engagement platforms.
- Experience with Databricks, Azure AI, Azure OpenAI, AWS AI/ML services, or similar enterprise AI platforms.
- Experience with semantic search, vector databases, knowledge graphs, or agent-based architectures.
- Experience with enterprise architecture, technical governance, and vendor management.
Summarised by NextRaise from the employer’s description, which follows in full below.
Full description from employer
At Lilly, the work is demanding because patients are waiting. We unite caring with discovery to help make life better for people around the world, knowing that every decision, every detail, and every day matters. Headquartered in Indianapolis, Indiana, our over 50,000 employees around the globe take on complex challenges to discover and deliver life-changing medicines, strengthen how health is understood and managed, and support the communities we serve. This is hard, urgent, selfless work—but it’s work worth doing. If you’re driven by purpose and ready to bring your best to work that truly matters for patients, we invite you to join us.
Role Overview
We are seeking a Sr. Principal Engineer to lead the architecture and integration of AI/ML-enabled applications across enterprise platforms, data ecosystems, commercial workflows, and third-party services. This role owns the technical integration strategy that brings together business applications, APIs, data products, machine learning models, large language models, agents, security controls, and human workflows into secure, resilient, observable, and scalable solutions.
This is a senior individual contributor and cross-team technical leadership role. The successful candidate will partner with product managers, AI/ML engineers, software engineers, data teams, platform owners, enterprise architects, cybersecurity, privacy, compliance, vendors, and business stakeholders to deliver end-to-end AI-enabled capabilities
Key Responsibilities
Enterprise & AI Solution Architecture
- Lead architecture and integration strategy for AI/ML-enabled products and platforms.
- Design scalable solutions that integrate applications, APIs, data platforms, AI services, and business workflows.
- Establish reusable integration patterns, architecture standards, and technical governance practices.
AI Platform & Application Integration
- Integrate AI/ML capabilities, LLMs, RAG solutions, agents, and analytics services into enterprise applications.
- Guide technical decisions regarding model usage, orchestration, workflow automation, and human-in-the-loop controls.
- Ensure solutions are secure, resilient, observable, and operationally supportable.
Data, Platform, and Cloud Integration
- Design and govern data flows across operational systems, data platforms, semantic layers, and AI services.
- Partner with platform and engineering teams to enable scalable cloud-native architectures and deployment models.
- Ensure data quality, security, lineage, and compliance requirements are addressed.
Quality, Governance & Operational Excellence
- Establish end-to-end testing, monitoring, observability, and AI evaluation practices.
- Promote Responsible AI principles, security-by-design, and privacy-by-design approaches.
- Drive production readiness, operational support models, and continuous improvement practices.
Technical Leadership
- Serve as a trusted technical advisor to product, engineering, architecture, security, and business stakeholders.
- Lead architecture reviews and influence technical strategy across multiple initiatives.
- Mentor engineers and architects while promoting engineering excellence and knowledge sharing.
Required Qualifications
- 8+ years of experience in software engineering, solution architecture, systems integration, or platform engineering.
- Experience architecting and delivering complex enterprise solutions integrating multiple systems, platforms, and data sources.
- Strong understanding of cloud-native architecture, APIs, microservices, event-driven systems, and integration patterns.
- Experience with AI/ML-enabled applications, including LLMs, RAG, agentic workflows, or related technologies.
- Experience with cloud platforms such as Azure, AWS, or GCP.
- Familiarity with MLOps, LLMOps, DevSecOps, and modern software delivery practices.
- Strong communication, stakeholder management, and technical leadership skills.
Preferred Qualifications
- Experience in healthcare, life sciences, commercial analytics, CRM, field engagement, or customer engagement platforms.
- Experience with Databricks, Azure AI, Azure OpenAI, AWS AI/ML services, or similar enterprise AI platforms.
- Experience with semantic search, vector databases, knowledge graphs, or agent-based architectures.
- Experience with enterprise architecture, technical governance, and vendor management.
Key Skills
- Enterprise Integration Architecture
- AI/ML & Generative AI Solutions
- Cloud & Platform Architecture
- API & Event-Driven Design
- Data & Knowledge Integration
- Agentic AI & Workflow Orchestration
- MLOps / LLMOps
- Responsible AI & Governance
- Architecture Leadership
- Stakeholder & Vendor Management
Lilly is dedicated to helping individuals with disabilities to actively engage in the workforce, ensuring equal opportunities when vying for positions. If you require accommodation to submit a resume for a position at Lilly, please complete the accommodation request form (https://careers.lilly.com/us/en/workplace-accommodation) for further assistance. Please note this is for individuals to request an accommodation as part of the application process and any other correspondence will not receive a response.
Lilly does not discriminate on the basis of age, race, color, religion, gender, sexual orientation, gender identity, gender expression, national origin, protected veteran status, disability or any other legally protected status.
#WeAreLillyCompany
Company facts come from this company's own listings. We only show what the postings themselves carry.