Senior AI Platform Engineer

NVIDIA is a leader in AI, deep learning, and high-performance computing, providing pioneering technology and infrastructure that empowers innovative solutions across various industries. As part of NVIDIA's mission, the AI Platform Engineering team drives efficiency and reliability across NVIDIA's AI workloads, pushing the limits of performance on GPUs and specialized AI hardware.

We are looking for an AI Platform Engineer with expertise in AI tools, frameworks, and hardware. The ideal candidate will have experience with AI workloads, particularly using PyTorch, C++, and be skilled in debugging and optimizing AI tasks on NVIDIA GPUs. This role focuses on ensuring optimal efficiency across NVIDIA's AI infrastructure.

What you’ll be doing:

• Develop and refine infrastructure for scalable AI workloads optimized specifically for NVIDIA hardware and software.

• Debug and troubleshoot AI jobs running on NVIDIA hardware, leveraging tools such as Nsight, CUDA, and NCCL, to enhance efficiency and performance.

• Collaborate with internal teams, including research, engineering, and data science, to identify areas for efficiency improvement across NVIDIA's AI workloads.

• Optimize AI frameworks, particularly PyTorch, to fully utilize NVIDIA hardware capabilities.

• Create and maintain NVIDIA-specific performance analysis tools and scripts to monitor, assess, and improve AI infrastructure reliability and performance.

• Utilize NVIDIA's profiling tools (e.g., Nsight Systems, Nsight Compute, DCGM) to gain deep insights into bottlenecks and optimize AI task performance on NVIDIA hardware.

What we need to see:

• 8+ years of experience in debugging and optimizing AI workloads on NVIDIA GPUs.

• Bachelor's or Master's degree in Computer Science, Software Engineering or equivalent experience.

• Strong programming experience with Python, especially using AI frameworks like PyTorch, with a focus on NVIDIA optimization.

• Proficiency in C++, with experience in GPU programming, CUDA, and familiarity with NVIDIA-specific optimizations.

• Knowledge of NVIDIA hardware architectures, including GPU memory hierarchy, CUDA cores, and performance tuning techniques.

Ways to stand out from the crowd:

• Experience with large-scale distributed AI systems on cloud or on-premises infrastructure using NVIDIA hardware.

• Extensive experience in Slurm workload manager and K8s.

• Understanding of parallel programming and experience with multi-threaded or distributed computing on NVIDIA platforms.

NVIDIA leads the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing, and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables amazing creativity and discovery, and powers what were once science fiction inventions, from artificial intelligence to autonomous cars. NVIDIA is looking for exceptional people like you to help us accelerate the next wave of artificial intelligence.

The base salary range is 180,000 USD - 339,250 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.