Senior Software Architect, AI Systems and Networking

NVIDIA is hiring a Senior Software Architect for an applied research team inside its Networking Systems & Software Architecture group. The team writes systems-level software that moves data between GPUs, nodes, and storage, working on transport optimization, hardware-software co-design, and communication frameworks used in production AI stacks. The role is for a recognized expert who can own modules and projects end-to-end, from scoping research questions to shipping production code.

The work sits between applied research and production engineering. You would drive technical decisions, bring in ideas from research and industry, and prototype new approaches to prove they work. The team's charter also expands into emerging areas including quantum computing interconnects.

What you will do

• Architect and implement high-performance communication and memory management libraries for distributed AI.
• Drive hardware-software co-optimization with GPU, DPU, NIC, and switch teams through GPUDirect RDMA, NVLink, and next-generation interconnects.
• Profile and optimize data movement across GPU memory, system DRAM, NVMe, and network fabrics.
• Integrate networking capabilities into AI serving stacks such as vLLM, SGLang, and TensorRT-LLM.
• Contribute to and maintain open-source projects, mentor engineers, conduct design reviews, and prototype experimental technologies to evaluate their viability.

What they are looking for

• 12+ years in systems software and/or networking, with demonstrated ownership of complex projects.
• MS, PhD, or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
• Solid understanding of high-performance networking: InfiniBand, RoCE, RDMA, NVLink, GPUDirect.
• Strong C/C++/Rust systems programming, with comfort in performance profiling and low-level debugging.
• Understanding of ML systems concepts: transformer architectures, KV cache mechanics, model parallelism, or distributed training and inference patterns.

Ways to stand out

• Knowledge of ML inference frameworks (vLLM, SGLang, TensorRT-LLM) and their communication requirements.
• Knowledge of storage networking (NVMe-oF, GPUDirect Storage, S3).
• A background in Reinforcement Learning systems.

Pay and location

The role is based in Canada or the United States. Your base salary will be determined by your location, experience, and the pay of employees in similar positions. The base salary range is 224,000 USD to 356,500 USD for Level 5, and 272,000 USD to 431,250 USD for Level 6. You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until May 23, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.

About NVIDIA

NVIDIA states that it is committed to a diverse work environment and is an equal opportunity employer. It says it does not discriminate in hiring or promotion on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.