Asapp-2·9 days ago
9 days ago
Lead Machine Learning Engineer, Evaluations
Sign up free to see how well your resume matches this role.
What you'll do
- Work closely with the research and modeling teams to create state-of-the-art NLP models for specific tasks
- Deploy NLP models in a production setting designed to serve customers at scale
- Build and evaluate the core intelligence behind agentic AI systems
- Design and own evaluation frameworks that ensure quality, safety, and performance across complex agentic systems
- Own and grow the evaluation platform that measures quality, safety, and performance across ASAPP's agentic AI systems
Summarised by NextRaise from the employer’s description, which follows in full below.
Full description from employer
At ASAPP, our mission is simple: deliver the best AI-powered customer experience—faster than anyone else. To achieve that, we’re guided by principles that shape how we think, build, and execute. We value customer obsession, purposeful speed, ownership, and a relentless focus on outcomes. ASAPP’s AI Engineering team is seeking an enterprising, talented and curious machine learning engineer.
The AI Engineering team is responsible for working closely with the research and modeling teams to create state-of-the-art NLP models for specific tasks, and deploy them in a production setting designed to serve our customers at scale. We are looking for a Machine Learning Engineer to help build and evaluate the core intelligence behind our agentic AI systems. This role will play a key part in designing and owning evaluation frameworks that ensure quality, safety, and performance across complex agentic systems.
We're looking for a Lead Machine Learning Engineer to own and grow the evaluation platform that measures quality, safety, and performance across ASAPP's agentic AI systems- the infrastructure that tells us, with confidence, whether a model or agent change is actually an improvement before it reaches customers.
This a hybrid role with 10-12 days of in-office presence per month to balance flexibility with collaboration.
The AI Engineering team is responsible for working closely with the research and modeling teams to create state-of-the-art NLP models for specific tasks, and deploy them in a production setting designed to serve our customers at scale. We are looking for a Machine Learning Engineer to help build and evaluate the core intelligence behind our agentic AI systems. This role will play a key part in designing and owning evaluation frameworks that ensure quality, safety, and performance across complex agentic systems.
We're looking for a Lead Machine Learning Engineer to own and grow the evaluation platform that measures quality, safety, and performance across ASAPP's agentic AI systems- the infrastructure that tells us, with confidence, whether a model or agent change is actually an improvement before it reaches customers.
This a hybrid role with 10-12 days of in-office presence per month to balance flexibility with collaboration.
Company
Asapp-2
Mountain View, United States of America
Company facts come from this company's own listings. We only show what the postings themselves carry.