caferemote
NVIDIA

Senior Software Workload Optimization Engineer

Remote United States Full-time Senior $150K – $351K / year Posted 3 days ago
Apply now
Work from
United States
Contract
Full-time
Experience
Senior
Salary
$150K – $351K / year
Posted
17 November 2026
Apply by
16 January 2027

We’re looking for a software optimization engineer to help us get more useful work done from our GPUs. You’ll join a small team and independently lead investigations into a range of AI workloads. You’ll approach workloads as systems: measure how they perform, identify what limits useful throughput, implement improvements, and verify the results.

Our numerics team at NVIDIA works on techniques that make LLMs more efficient. One current opportunity is reducing the GPU hours needed to evaluate models, but the work will evolve as priorities and bottlenecks change. You don’t need to be an expert in quantization algorithms. We’re looking for someone who enjoys understanding how software uses GPUs and finding practical ways to make it run more efficiently.

Responsibilities

  • Investigate the performance of evaluation and other AI workloads across GPU systems.
  • Identify bottlenecks in computation, memory, communication, data movement, orchestration, and resource allocation.
  • Evaluate and improve parallelism configurations, including how work is distributed across GPUs and nodes.
  • Understand how effectively workloads use GPU capabilities, including tensor cores, and identify opportunities to improve utilization.
  • Implement and validate changes that reduce GPU hours per unit of useful work or increase throughput.
  • Design clear benchmarks and measurements, accounting for tradeoffs among throughput, latency, resource use, and the quality or correctness of results.
  • Partner with workload owners to understand requirements, test improvements, and help deploy solutions.
  • Independently prioritize and drive optimization projects from investigation through measurable results.

What we need to see

  • Experience analyzing and improving the performance of compute-intensive software
  • Bachelor’s degree or equivalent experience, and 5+ years of relevant experience
  • Ability to reason about and optimize parallelism strategies – including tensor, data, pipeline, context, and expert parallelism – to balance throughput, communication overhead, and GPU resource use.
  • Investigate unfamiliar code/systems and work directly with code owners to land end-to-end optimizations.
  • Understanding of GPU architecture and the factors that affect utilization and application performance.
  • Experience using profiling, benchmarking, and measurement to guide optimization decisions.
  • Ability to work independently, communicate findings clearly, and collaborate with researchers and engineers.
  • Three or more years of relevant experience.

Ways to stand out from the crowd.

  • Optimizing AI training, inference, evaluation, or other large-scale GPU workloads.
  • Working with GPU programming or machine learning frameworks and performance tools.
  • Improving workload scheduling, batching, data pipelines, or multi-GPU configurations.
  • Familiarity with collection and interpretation of GPU telemetry
  • Energy-proportional computing or performance optimization under power, energy, or thermal design power budgets and experience with model quantization or numerical methods.

Success in this role means measurably reducing the GPU resources required to deliver useful results across our workloads.

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are:
150,000 USD – 286,000 USD for Level 3; and 183,750 USD – 351,000 USD for Level 4.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 20, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Discussion

No comments yet. Ask a question or share a tip about this role.

Apply now

More jobs from NVIDIA

View company →

Senior Solutions Architect, HPC and AI

NVIDIA
Remote France, Germany Full-time €93K – €245K / year

We are seeking a Senior Solutions Architect with strong hands-on experience in deploying, debugging, and optimizing training and inference workloads on…

14h ago DevOps and Sysadmin

Senior Network Solution Architect – AI Fabrics

NVIDIA
Remote United States Full-time $187K – $442K / year

NVIDIA is looking for an experienced Network Solutions Architect Engineer to help bring our next-generation AI networking platforms into production at customer…

17h ago Data

Solution Architect, Public Sector

NVIDIA
Remote Germany, Poland Full-time €89K – €194K / year

Do you want to support our global, mission-focused government clients as they embrace AI to improve government services and increase the health, well-being,…

18h ago Data

Senior Technical Project Manager, Datacenter

NVIDIA
Remote United States Full-time $172K – $403K / year

Do you want to join a team of highly motivated and experienced project managers who drive the successful introduction of NVIDIA 's next generation GPU/CPU…

21h ago Data

Similar remote jobs

Browse all →

Risk Prevention Analyst - Remote

Velera
Remote United States Full-time $60K – $93K / year

Join the People Helping People Velera is the nation’s premier payments credit union service organization (CUSO) and an integrated fintech solutions provider. The company serves more than…

3h ago Data

Summer 2027 Analytic Enablement Graduate Intern

Highmark Health
Remote United States Internship

Company : Highmark Health Job Description : Applicants must be authorized to work in the U.S. independently. At this time, we do not offer visa sponsorship for this role. The Summer 2027…

4h ago Data

Kinyarwanda Language Specialist - AI Trainer

Invisible Technologies
Remote Worldwide Contract $6 – $65 / hour

Are you a Kinyarwanda language expert eager to shape the future of AI? Large-scale language models are evolving from simple chatbots into powerful engines of communication and…

4h ago Data

Data Support

Saisystems Health
Remote United States Temporary

Purpose Support Marketing in cleaning and enriching our customer and prospect records in our CRM, so reporting, lead tracking, and lifecycle stages are accurate. Responsibilities Update a…

4h ago Data

AI Architect

Vcheck
Remote United States Full-time

About Vcheck Vcheck was founded in 2012 on the belief that the investigative rigor of a boutique firm could be brought to scale through technology. Today, we run more than 25,000…

5h ago Data

Senior AI Automation Engineer

Helpware
Remote Argentina, Brazil, Mexico, Poland, Ukraine Full-time

Our client is a US-based company specializing in advanced solutions for health plans. Their platform helps both new and established Medicare and Medicaid programs scale efficiently by…

5h ago Data

Get remote jobs the moment they are posted

Choose your categories and skills. We push matching jobs to your device. No email, ever.