OKX·Fintech·4 days ago
4 days ago
Product Director, Localisation & AI Evals
Sign up free to see how well your resume matches this role.
What you'll do
- Have LLMs carry translation and quality evaluation at scale, so human effort concentrates on setting the standards and making the final calls
- Keep translation quality stable while coverage expands substantially, so cost no longer grows linearly with languages, content and releases
- Ensure localisation issues are caught before release, monitored after release, and genuinely verified once fixed
- Ensure conversion on key user journeys is not damaged by language issues
- Drive a sustained reduction in severe production issues and in issues that recur
- Make localisation quality a responsibility shared by product, design, engineering, content and compliance — not something the language team carries alone
- Turn every issue found into a preventive capability in the system
What they're looking for
- Strong cross-functional influence — a track record of getting other teams to accept constraints or change their process without direct reporting authority. This is the single most important capability for this role
- Accountability for business outcomes — you have been measured on business metrics rather than delivery volume
- Sound judgement on AI / LLM products — no algorithms background required, but you can tell what should be handed to a model and what must stay with a human
- Experience building quality systems or release gates
- International product experience — serving users across multiple languages and regions
Nice to have
- QA or test-infrastructure background
- Building a team and its processes from scratch
- Hands-on experience shipping LLM applications
- Finance, payments or another highly regulated industry
Summarised by NextRaise from the employer’s description, which follows in full below.
Full description from employer
Who We Are
At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom.
OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access to crypto trading and decentralized crypto applications (dApps). OKX is also a trusted brand by hundreds of large institutions seeking access to crypto markets. We are safe and reliable, backed by our Proof of Reserves.
Across our multiple offices globally, we are united by our core principles: We Before Me, Do the Right Thing, and Get Things Done. These shared values drive our culture, shape our processes, and foster a friendly, rewarding, and diverse environment for every OK-er. OKX is part of OKG, a group that brings the value of Blockchain to users around the world, through our leading products OKX, OKX Wallet, OKLink and more.
About the Opportunity
OKX is going all-in on AI-native localisation. The field has long been stuck on one trade-off: you can have translation quality, or you can have scale, but not both. And the real question was never "is this translation accurate?" — it's "can the user actually understand it and get through the flow?"
Web3 is the hardest place to solve this. The vocabulary reinvents itself constantly, with new tech jargon, protocol names and memes appearing every week. It sits next to dense, high-stakes trading terminology, where a single mistranslated word can mislead a user or move money. And every market has its own fast-moving regulations, so the "right" translation is a moving target that must stay compliant across jurisdictions in real time. If you want a localisation problem that is genuinely unsolved — high ambiguity, high stakes, high velocity — this is it.
We're going to break the trade-off with agents. You will own the 0-1 build and launch of two things:
-
A frontier agentic translation system that localises every market (20+ languages) with a human-in-the-loop mechanism.
-
A self-improving agentic QA product that autonomously evaluates translation and end-to-end localisation quality, flags its own failures, and closes the loop.
This is a build-the-frontier role, not a manage-the-vendor role.
This role does not require a linguistics or translation background, multilingual ability, or algorithm engineering skills. We're looking for a PM leader who can build a frontier agentic translation and QA system from 0 to 1 — and make the whole organisation share responsibility for localisation quality.
What You’ll Be Doing
You will lead a squad of product managers and developers, and work hand-in-hand with language managers, to ship the translation and QA systems into production. You set the product direction and quality bar; your PMs and engineers build the agents, harness and evals; and the language managers ground the system in what "good" actually means in each market. Your job is to make these three groups operate as one team — and to make localisation quality something the whole organisation owns, not just the language team.
Own the agentic translation system
Architect and ship it end to end, from 0 to 1, across all markets and 20+ languages — where models carry the work and humans set the standard and make the final call. Break the cost curve: hold quality flat while coverage scales across languages, content and release velocity, so cost stops growing linearly with the business. Make the system interoperate cleanly with OKX's existing localisation stack and content pipelines, rather than living as an island.
Build the agentic QA and quality automation
Stand up an autonomous QA agent that evaluates translation and localisation quality at scale — catching regressions before release, monitoring in production, and self-verifying every fix, using LLM-as-a-judge and eval harnesses rather than manual review. Evaluate not just accuracy and fluency but cultural fit, bias and safety — especially on regulated and financial content, where a wrong or non-compliant phrasing is a real risk. Make quality measurable: define and drive a hard quality signal — human-acceptance rate, or the edit effort needed to reach shippable quality (e.g. Translation Time-to-Edit) — so quality is a metric the system optimises against, not a subjective call. And protect the funnel: conversion on key user journeys should never be adversely affected by language or localisation issues.
Make it self-improving
Drive a sustained reduction in severe and recurring production issues — every escape becomes a new guardrail, and the system gets smarter with every release.
What We Look For In You
- PM leader who has taken a frontier agentic product from 0 to 1, beyond translation.
- Proven ability to ship genuinely novel products at the edge of LLM capabilities—and repeat that success here.
- Accountable for business outcomes and measured on business metrics, not delivery volume.
- Deep hands-on experience building large-scale, frontier-LLM agentic systems from 0 to 1.
- Experience with harness/orchestration layers, multi-agent workflows, and LLM-as-a-judge or automated evaluation pipelines.
- Has built quality systems, automated evaluations, or release gates that enable confident autonomous-system launches.
- International product experience serving users across multiple languages and regions.
Nice to Haves
- Built an agentic system from scratch
- Shipped agentic / LLM applications in production
- Finance, payments or another highly regulated industry.
Perks & Benefits
-
Competitive total compensation package
-
L&D programs and Education subsidy for employees' growth and development
-
Various team building programs and company events
-
Wellness and meal allowances
-
Comprehensive healthcare schemes for employees and dependants
-
More that we love to tell you along the process!
#LI-WWW
#LI-ONSITE
Notice:
All official OKX vacancies are published on this website. While roles may appear on selected third-party platforms from time to time, information on other sites may be inaccurate or outdated. If in doubt, please apply directly through our official careers website.
Information collected and processed as part of the recruitment process of any job application you choose to submit is subject to OKX's Candidate Privacy Notice.
Fintech
Company
OKXFintech
Hong Kong SAR, Singapore
Company facts come from this company's own listings. We only show what the postings themselves carry.