NextRaise Logo
NextRaise
JobsDiscover rolesJob TrackerTrack applied positionsMy ResumesBuild & optimize resumes
Tools
Job Match AnalyzerPaste JD, get fit scoreATS ScoreScan for ATS issues
Chrome Extension
ResumesJobsProfile
Jobs
2 months ago
NVIDIA·Semiconductors·2 months ago
2 months ago

AI Computing Development Engineer, TensorRT and TensorRT-LLM AIGV

Shanghai, People's Republic of ChinaFull-timeMid · 2-5 years

Sign up free to see how well your resume matches this role.

About this role

NVIDIA is hiring software engineers for its AI Computing team. Academic and commercial groups around the world are using GPUs to power a revolution in deep learning-powered AI, enabling breakthroughs in areas like generative AI, computer vision, speech recognition, recommender systems, and large-scale language and multimodal models. Join the team building the inferencing software (TensorRT/TensorRT-LLM) that will be used across our product lines. The ability to work in a fast-paced, delivery-focused environment is required, and excellent interpersonal skills are a must.

What you'll be doing:

  • Design and develop robust inferencing software (TensorRT/TensorRT-LLM) optimized for functionality and performance across platforms

  • Perform performance analysis, optimization, and tuning of deep learning inference workloads

  • Track and integrate academic and industry advancements in AI and feature-update TensorRT/TensorRT-LLM accordingly

  • Provide feedback into architecture and hardware design and development

  • Collaborate across hardware, software, and research teams to shape the direction of machine learning inferencing across NVIDIA platforms

  • Own and deliver technical work with scope based on experience, ranging from complex features to substantial parts of larger projects, with increasing independence and technical leadership over time

  • Publish key technical results at leading scientific and engineering conferences

What we need to see:

  • Masters or higher degree in Computer Engineering, Computer Science, Applied Mathematics, or related computing-focused field (or equivalent experience)

  • Strong Python or C/C++ programming and software design experience, including debugging, performance profiling, and test design

  • 2+ years working experience

  • Strong curiosity about artificial intelligence and familiarity with the latest developments in deep learning — including generative models, multimodal systems, and large neural networks

  • Experience working with deep learning frameworks such as PyTorch, TensorRT/TensorRT-LLM, SGLang or vLLM

  • Proactive, self-driven, and able to work independently

  • Excellent written and verbal communication skills in English

  • Demonstrated ability, commensurate with experience, to take technical ownership, solve complex problems, and contribute effectively in cross-functional environments

NVIDIA is widely considered to be one of technology’s most desirable employers. We have some of the most forward-thinking and hardworking people on the planet working for us. Does the idea of contributing to and pushing the boundaries of state-of-the-art AI and compute systems excite you? Interested in getting exposure to the entire deep learning software stack? Come join us and help build the GPU-accelerated AI platform used worldwide.

SemiconductorsH1B sponsor likely
AI tools
Apply faster with autofillThe NextRaise extension autofills your application in one click.Get the extension

Similar jobs

  • LLM Application Engineer at BjakChina
  • Lead software enginner for LLM-infra at Cadence Design SystemsShanghai, People's Republic of China
  • LLM Pre-training & Distributed Engineer (AI Infrastructure) at hyphenconnectChina
  • NLP/LLM& AI Agent科学家_CR at BoschShanghai, People's Republic of China
  • LLM Algorithm Engineer at EveryMatrixChang Sha Shi, People's Republic of China
  • 大模型应用开发工程师LLM Application Engineer at ganweigroupRemote, China