Ornn AI

Senior Engineer Infrastructure Services (GPU Infrastructure)

In short

Senior infrastructure engineer role building and operating infrastructure across heterogeneous GPU clusters and datacenters, covering provisioning, scheduling, isolation, monitoring, and multi-tenant workload management. The company is an AI startup, and the work centers on writing systems software in Rust and Python, operating Kubernetes and Slurm, and debugging across Linux, networking, storage, virtualization, and distributed systems. Requires independently owning systems from design through production and debugging across the full stack from application to hypervisor and physical server layers.

About the Role
You will build and operate infrastructure across heterogeneous GPU clusters and datacenters. You will design provisioning, scheduling, isolation, monitoring, and management systems for bare-metal, containerized, and virtualized workloads. You will write Rust and Python infrastructure software, operate Kubernetes and Slurm, create secure multi-tenant environments, automate lifecycle management, and debug failures across the full systems stack.
Requirements
•Linux systems knowledge
•Rust systems software experience
•SQL knowledge and experience with data-intensive backend systems
•Experience operating containerized and virtualized production workloads
•Familiarity with Kubernetes and/or Slurm
•Understanding of virtualization, hypervisors, virtio, device passthrough, and workload isolation
•Understanding of distributed systems, failure handling, coordination, state management, idempotency, consistency, and observability
•Ability to debug across application, kernel, network, scheduler, hypervisor, and physical-server layers
•Ability to independently own systems from design through production
Responsibilities
•Build and operate infrastructure across GPU clusters and datacenters
•Design provisioning, scheduling, isolation, monitoring, and compute-management systems
•Build infrastructure software in Rust and Python
•Operate and extend Kubernetes and Slurm environments
•Design secure multi-tenant environments using containers, VMs, hypervisors, and isolation technologies
•Debug failures across Linux, networking, storage, schedulers, virtualization, GPUs, and distributed systems
•Build systems to collect and query infrastructure state and telemetry
•Automate infrastructure deployment and lifecycle management
•Design reliable systems that recover automatically and expose failure information
Benefits
•Meaningful equity
•Health coverage
•Free meals

Stop applying.
Get referred.

$10 in free credits

In just 60 seconds, fully on autopilot — Eraldt's AI agents read your CV, map the roles you fit, find live vacancies and the people who can refer you, write personal emails, and get you referred.

This isn't an application: your CV doesn't go to the company, and we don't promise a referral for this exact role.

Discover who else lands interviews on autopilot