NIM Solution Architect
Sign up free to see how well your resume matches this role.
What you'll do
- Drive the implementation, deployment, and optimization of NVIDIA Inference Microservices (NIM) solutions for enterprise and industry AI workloads.
- Package and serve open-source, NVIDIA, and customer-proprietary models through NIM with standardized, containerized APIs for on-premises, cloud, and hybrid environments.
- Optimize high-volume inference and rollout workloads for LLMs and VLMs.
- Evaluate and tune the NIM models.
- Deliver technical projects, demos and client support tasks as directed by the Solution Architecture Leadership.
- Provide technical support and guidance to customers, facilitating the adoption and implementation of NVIDIA technologies and products.
- Collaborate with cross-functional teams to enhance and expand our AI solutions portfolio.
What they're looking for
- Master’s degree or higher in Computer Science, Machine Learning, Electrical Engineering, Mathematics, or a related technical field, or equivalent experience.
- 2+ years of hands-on experience in machine learning engineering, applied research, LLM/VLM inference, or RL rollout.
- Production-quality Python and PyTorch skills, including distributed GPU training, solution, profiling, debugging, memory optimization.
- Working knowledge of transformer architectures, performance optimization, rollout sampling strategies, structured generation, and model-quality evaluation.
- Strong written and verbal communication skills, with the ability to collaborate effectively across research, engineering, infrastructure, product, and customer-facing teams.
Nice to have
- Publications, open-source contributions, or significant technical projects, LLM/VLM, agent systems.
- Experience applying programmatic verification, simulators, compilers, execution sandboxes, APIs, or external tools as reward sources for model training. agent system.
- Familiar with oss RL framework such as SLIME, Nemo-RL.
- Familiarity with enterprise AI deployment, customer adaptation, or adapting foundation models to specialized vertical domains.
Summarised by NextRaise from the employer’s description, which follows in full below.
Full description from employer
NVIDIA is leading company of AI computing. At NVIDIA, our employees are passionate about AI, HPC , VISUAL, GAMING. SA team is more focusing to bring NVIDIA new technology into difference industries. This role focuses on NVIDIA Inference Microservices (NIM), inference / RL rolloutperformance, and AI workflow enablement for LLM, VLM, and other generative AI workloads. It is a highly hands-on position at the intersection of model optimization, inference infrastructure, and customer solution delivery.
What you’ll be doing:
- Drive the implementation, deployment, and optimization of NVIDIA Inference Microservices (NIM) solutions for enterprise and industry AI workloads.
- Package and serve open-source, NVIDIA, and customer-proprietary models through NIM with standardized, containerized APIs for on-premises, cloud, and hybrid environments.
- Optimize high-volume inference and rollout workloads for LLMs and VLMs.
- Evaluate and tune the NIM models.
- Deliver technical projects, demos and client support tasks as directed by the Solution Architecture Leadership.
- Provide technical support and guidance to customers, facilitating the adoption and implementation of NVIDIA technologies and products.
- Collaborate with cross-functional teams to enhance and expand our AI solutions portfolio.
What we need to see:
- Master’s degree or higher in Computer Science, Machine Learning, Electrical Engineering, Mathematics, or a related technical field, or equivalent experience.
- 2+ years of hands-on experience in machine learning engineering, applied research, LLM/VLM inference, or RL rollout.
- Production-quality Python and PyTorch skills, including distributed GPU training, solution, profiling, debugging, memory optimization.
- Working knowledge of transformer architectures, performance optimization, rollout sampling strategies, structured generation, and model-quality evaluation.
- Strong written and verbal communication skills, with the ability to collaborate effectively across research, engineering, infrastructure, product, and customer-facing teams.
Ways to stand out from the crowd:
- Publications, open-source contributions, or significant technical projects, LLM/VLM, agent systems.
- Experience applying programmatic verification, simulators, compilers, execution sandboxes, APIs, or external tools as reward sources for model training. agent system.
- Familiar with oss RL framework such as SLIME, Nemo-RL.
- Familiarity with enterprise AI deployment, customer adaptation, or adapting foundation models to specialized vertical domains.
Company
Company facts come from this company's own listings. We only show what the postings themselves carry.
