Member of Technical Staff, ML Engineer
About this role
Why join Intelligence
Mission: Give every human superintelligence, and make superintelligence more human.
Intelligence is the product lab company behind DesignArena - 5.2M+ users in 8 months, leaderboard referenced by Andrew Ng, Elon Musk, Demis Hassabis, and more. The team is incredibly talent-dense (11 from Harvard + Berkeley), backed by Tier 1 VC Index Ventures, YC, SV Angel, Lenny Rachitsky, Paul Graham, Dylan Field, and one of the fastest-growing seed-stage startups in SF.
Behind closed doors, we see what the models can do six months before the world does. We are trusted by the best frontier model providers like OpenAI to rigorously evaluate the capabilities of state-of-the-art multimodal models across design, web dev, game dev, image, video, audio, slide generation, and more, through the large-scale platforms that we’ve built.
Design Arena, our flagship product, is the most referenced benchmark for AI-generated visuals, and is powered by over 5.3M+ authentic users across 192 countries. Prediction Arena was the first time models traded autonomously with real cash on real-time, real-world events. Social Arena tested whether AI models can effectively grow and engage audiences on X by having them operate as independent social media agents.
Role
You'll build the machine learning systems that power our evaluation platform and next-generation data engine. You'll train human preference models, build large-scale data pipelines, and develop the infrastructure that transforms millions of human interactions into reliable signals for evaluating and improving frontier AI models.
In this role, you also have an opportunity to be forward-deployed should it interest you, and work directly with the researchers at frontier labs to creatively scale new model capability strategies for improvement.
What You’ll Own
Train and improve preference, reward, and ranking models from millions of human interactions
Develop infrastructure for large-scale experimentation, model training, and specialize in online evaluation techniques
Design systems that transform human preference data into reliable signals for downstream model evaluation and training
What We’re Looking For
Strong STEM background. You studied Computer Science, Data Science, Statistics, Math, Engineering, Physics, or a related field.
Experience building ML systems. You've trained preference models, built data pipelines, or worked on ML infrastructure that runs in production.
Interested in how AI learns from human feedback. You're excited by solving problems at the intersection of human-model interaction.
Details
Location: San Francisco, Levi’s Plaza. We sponsor visas and handle relocation.
Work Schedule: Sunday-Friday. Saturdays are yours!
Compensation: Competitive salary + meaningful equity. You'd be joining at the stage when ownership matters most.