Principal Deep Learning Algorithm Engineer

NVIDIA is hiring a Principal Deep Learning Algorithm Engineer to work on large language model inference. The role sits with a team focused on improving the algorithmic performance and efficiency of LLM systems, including agentic and reasoning use cases. It is a senior position for someone with a long background in deep learning and deep learning systems design who wants to work on inference algorithms, workload optimization, and datacenter-scale systems.

What you will do

• Explore and incorporate contemporary research on generative AI, agents, and inference systems into the NVIDIA LLM software stack.
• Analyze, profile, and optimize agentic LLM workloads to reduce request latency and increase request throughput while maintaining workflow fidelity.
• Design and implement scalable systems to accelerate agentic workflows and handle datacenter-scale use cases.
• Advise future iterations of NVIDIA software, hardware, and systems by working with teams across NVIDIA and external partners, and by formalizing the strategic requirements their workloads present.

What they are looking for

• BS, MS, or PhD in Computer Science, Electrical Engineering, Computer Engineering, or a related field, or equivalent experience.
• 15+ years of experience in deep learning and deep learning systems design.
• Proficiency in Python and C++.
• Strong understanding of computer architecture and GPU/parallel datacenter computing fundamentals.
• A proven interest in analyzing, modeling, and tuning application performance.

Ways to stand out

• Experience building large-scale LLM inference systems, especially those involving compound AI.
• Experience with processor and system-level performance modeling.
• GPU programming experience with CUDA or OpenCL.

Pay and benefits

The base salary range is 272,000 USD to 431,250 USD per year. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. You will also be eligible for equity and benefits.

Location

This role is based in the United States.

About NVIDIA

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. The company says it is now applying AI to define the next era of computing, with GPUs acting as the brains of computers, robots, and self-driving cars.

Other things to know

Applications for this job will be accepted at least until July 26, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.

NVIDIA states that it is committed to an inclusive work environment and is an equal opportunity employer. The company says it does not discriminate in hiring and promotion on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.