Runpod

Datacenter Infrastructure Specialist (AI)

In short

This role manages the technical lifecycle and operational health of a high-density GPU fleet, validating hardware deployments and troubleshooting networking and systems issues. The company is an AI/GPU infrastructure provider, and the work centers on datacenter networking, RDMA/InfiniBand, NVIDIA stack tuning, and automating network triage with LLMs and AI agents. It requires 3–5 years of infrastructure operations or datacenter engineering experience, Linux administration, Docker, and willingness to join a future on-call rotation.

About the Role
You will manage the technical lifecycle and operational health of a high-density GPU fleet. You will validate hardware deployments, monitor performance and uptime, troubleshoot networking and systems issues, automate operational workflows with AI tools, coordinate incident communications, and support infrastructure partners.
Requirements
•3–5 years of experience in infrastructure operations, systems reliability, or datacenter engineering
•Datacenter networking and performance troubleshooting proficiency
•Exposure to RDMA, InfiniBand, or RoCE
•Experience with the NVIDIA Software Stack and multi-node performance tuning
•Linux system administration
•Containerization with Docker
•System-level troubleshooting and performance tuning at kernel and hardware interface layers
•Written and verbal communication skills
•Ability to participate in a future on-call rotation
•Eligibility to work in the United States
Responsibilities
•Validate new hardware and partner deployments for distributed AI and ML workloads
•Monitor fleet health and identify performance degradation
•Audit downtime and provide technical data to protect customer SLAs
•Automate network triage and generate dynamic runbooks using LLMs and AI agents
•Coordinate technical incident communications and translate outages into actionable resolutions
•Support infrastructure partners
Benefits
•Stock options
•Medical, dental, and vision plans with 100% employee coverage and partial dependent coverage
•Flexible PTO
•$1,200 home office and equipment stipend

Stop applying.
Get referred.

$10 in free credits

In just 60 seconds, fully on autopilot — Eraldt's AI agents read your CV, map the roles you fit, find live vacancies and the people who can refer you, write personal emails, and get you referred.

This isn't an application: your CV doesn't go to the company, and we don't promise a referral for this exact role.

Discover who else lands interviews on autopilot