About
Baseten provides inference infrastructure and developer tooling that help AI companies bring cutting-edge models into production.
Responsibilities
•Partner with Sales on customer discovery calls, usually second calls and occasionally first calls for large accounts
•Lead demos and technical scoping to align on success criteria, architecture, and deployment approach
•Own benchmarking and repeatable deployments across LLMs, embeddings, image and video generation, Voice AI, and other modalities
•Advise on tradeoffs such as H100s versus B200s and latency-optimized versus throughput-optimized setups
•Drive playbook-style deployments for common models and use cases
•Become a power user of runtimes such as vLLM, SGLang, and TRT-LLM, including their configurations and tradeoffs
•Scope POCs and keep stakeholders aligned on timelines, deliverables, and next steps
•Coordinate POC execution as the project manager
•Bring in Forward Deployed Engineering support when deeper or more complex technical work is needed
Requirements
•AI/ML background and the ability to discuss AI/ML topics credibly with technical stakeholders
•Strong customer-facing communication skills, including structured discovery and clarifying ambiguous requirements
•Technical depth to scope solutions without writing production code
•Ability to script and prototype as needed, including comfort with "vibe coding" in technical workflows
Nice to have
•Experience running or supporting benchmarks for ML inference deployments
•Familiarity with infrastructure tradeoffs affecting inference performance and cost (such as GPU selection and latency versus throughput tuning)
•Experience as a cross-functional technical lead for customer POCs coordinating Sales and Engineering
Benefits
•Competitive compensation, including meaningful equity (U.S. only)
•100% coverage of medical, dental, and vision insurance for the employee and dependents
•Flexible PTO policy, including a company-wide Winter Break; offices are closed from Christmas Eve to New Year's Day
•Paid parental leave
•Fertility and family-building stipend through Carrot (U.S. only)
•Company-facilitated 401(k)
•Exposure to a variety of ML startups, offering learning and networking opportunities
