NVIDIA

Solutions Architect, Inference Deployments

In short

This is a customer-facing Solutions Architect role at NVIDIA focused on AI inference deployments, covering architecture design, production deployment, performance optimization, and customer enablement across edge and cloud environments. It requires 5+ years of engineering/solutions experience including 3+ years hands-on with AI inference or ML systems, plus deep GPU inference expertise, Linux/containers skills, and strong communication with both technical and executive audiences. The role spans robotics/speech models, synthetic data workflows, and production inference optimization (quantization, batching, kernel selection).

About NVIDIA
NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It's a unique legacy of innovation that's fueled by great technology—and amazing people.
Today, we're tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what's never been done before takes vision, innovation, and the world's best talent. As an NVIDIAN, you'll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.
What you'll be doing
•Lead architecture discussions with customers and co-design scalable inference systems with product and engineering teams. Define technical direction, integration milestones, and deployment plans across edge and cloud environments.
•Deploy, test, and profile speech and action models for robotics and automation on edge devices. Optimize latency, throughput, and memory use within device constraints.
•Lead optimization of synthetic data workflows spanning generation, augmentation, filtering, and data movement. Improve throughput and cost per usable output while preserving data quality.
•Guide production inference deployments, including configuration, monitoring, capacity planning, performance testing, release validation, and rollback. Resolve complex issues across models, runtimes, and infrastructure.
•Evaluate model optimization methods, including quantization, kernel selection, and batching. Validate application quality, explain performance tradeoffs, and use findings to inform product and engineering priorities.
•Drive customer and field enablement through deployment recipes, demos, onboarding materials, and operating guides that help teams adopt and scale NVIDIA technologies.
What we need to see
•Bachelor's or Master's degree in Computer Science, Engineering, or a related field, or equivalent experience.
•5+ years of professional experience in software or hardware engineering, developer relations, technical partnerships, solutions architecture, or product management, including 3+ years of direct, hands-on experience in AI inference or ML systems.
•Deep expertise in AI/ML and GPU inference, with a track record of driving product integrations and delivering production systems across edge or cloud environments.
•Hands-on experience building AI agents and working with Linux systems, containers, and at least one inference runtime or ML framework.
•Demonstrated expertise in performance profiling and production deployment, including monitoring and troubleshooting. Ability to design repeatable benchmarks that measure performance and application quality.
•Ability to explain complex technical concepts clearly to technical and non-technical audiences, from engineers to C-level executives.
•Strong problem-solving skills, intellectual curiosity, and a commitment to learning and helping customers resolve complex technical challenges.
•A track record of building trusted customer and partner relationships, balancing their needs, and guiding complex product and architecture decisions.
Ways to stand out from the crowd
•Technical contributions that demonstrate clear approaches to complex problems and measurable improvements in performance or production reliability.
•A history of enabling customer adoption, with technical recommendations that influenced product or engineering decisions and delivered production results.
•Hands-on experience with NVIDIA Jetson, TensorRT Edge-LLM, Nemotron Speech, NVIDIA Riva, ROS 2, or NVIDIA Isaac in voice or robotics deployments.
•Experience with synthetic data generation or workflow orchestration using NVIDIA Cosmos or comparable tools.
•Experience with containerized inference, TensorRT-LLM, TensorRT, Triton Inference Server, vLLM, SGLang, or NVIDIA Dynamo.
Compensation
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4. You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until October 31, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.

Stop applying.
Get referred.

$10 in free credits

In just 60 seconds, fully on autopilot — Eraldt's AI agents read your CV, map the roles you fit, find live vacancies and the people who can refer you, write personal emails, and get you referred.

This isn't an application: your CV doesn't go to the company, and we don't promise a referral for this exact role.

Discover who else lands interviews on autopilot