NVIDIA

Software Engineer, AI Infrastructure

In short

Senior backend engineer role at NVIDIA building open-source Kubernetes-native platform components (KAI-Scheduler, Snapshot, Grove, Run:ai) for AI infrastructure orchestration at data-center scale. Requires 8+ years backend development experience, deep Kubernetes/cloud-native expertise, Go proficiency, and a track record of OSS contributions. Based onsite in Tel Aviv.

About the Role
AI factories are only as good as the software that runs them. NVIDIA's DSX OS turns GPU infrastructure into a shared, multi-tenant platform for AI teams, providing scheduling, orchestration, serving, and observability for AI workloads at data-center scale—from training and inference to reinforcement learning and agentic AI. The DSX OS Platform Software group builds that layer through projects such as KAI-Scheduler, Snapshot, Grove, and Run:ai. Our work ships as open source and upstream contributions across the cloud-native and AI serving ecosystems. We focus on performance, reliability at scale, and giving users the insight they need to understand and improve how their workloads run.
We are looking for highly skilled software engineers to help shape the future of AI infrastructure. As a Senior Software Engineer in the team, you will design and build scalable, high-performance systems, tackle complex distributed-systems problems, and collaborate with experts across NVIDIA and the broader community to support the next generation of AI workloads.
Responsibilities
•Designing and developing open source platform components with a strong focus on performance, reliability, and scalability.
•Building and optimizing Kubernetes-native systems: controllers, operators, schedulers, and APIs that orchestrate GPU workloads at scale.
•Contributing upstream — designing in public, writing proposals, reviewing community code, and engaging with users and maintainers of the projects we work on.
•Collaborating closely with architects, product managers, and partner teams across NVIDIA to deliver impactful solutions.
•Writing clean, maintainable, and testable code in Go.
•Conducting code and design reviews to uphold high-quality standards, and mentoring team members.
What We Need to See
•B.Sc. in Computer Science or a related field or equivalent experience.
•8+ years of experience in backend software development, including system design and architecture.
•Proficiency in at least one backend programming language.
•Deep familiarity with Kubernetes and the cloud-native ecosystem.
•Demonstrated ability to solve complex technical challenges and deliver high-quality solutions.
Requirements
•Expertise in Kubernetes internals and advanced cloud-native technologies.
•Maintain or contribute to OSS projects, and experience working in a public development process.
•Familiarity with AI inference workloads, serving frameworks, and performance optimization.
•Proficiency in Linux, with knowledge in networking, security, storage, and virtualization.

Stop applying.
Get referred.

$10 in free credits

In just 60 seconds, fully on autopilot — Eraldt's AI agents read your CV, map the roles you fit, find live vacancies and the people who can refer you, write personal emails, and get you referred.

This isn't an application: your CV doesn't go to the company, and we don't promise a referral for this exact role.

Discover who else lands interviews on autopilot