EBay·4 days ago
4 days ago
MTS 2, AI Platform
Sign up free to see how well your resume matches this role.
What you'll do
- Drive the fast, efficient, and reliable inference of large language models at eBay
- Optimise production systems
- Scale GPU fleets
- Collaborate with cross-functional teams
What they're looking for
- Strong production coding skills
- Experience in LLM inference environments
Summarised by NextRaise from the employer’s description, which follows in full below.
Full description from employer
We are looking for an LLM Inference Engineer to drive the fast, efficient, and reliable inference of large language models at eBay. You will optimise production systems, scale GPU fleets, and collaborate with cross-functional teams. Ideal candidates have strong production coding skills and experience in LLM inference environments.
Skills
- llm inference
- production coding
- python
- go
- rust
- pytorch
- vllm
- sglang
- tensorrt
- gpu architecture
- cuda
- kernel programming
- performance optimization
- root cause analysis
- ai/ml systems programming
- triton
- slos
- benchmarking
- monitoring and alerting
- incident response
- cross-functional collaboration
- autonomous ai coding agents
- advanced prompting
- code review
Company
EBay
Bengaluru, India
Company facts come from this company's own listings. We only show what the postings themselves carry.