Encord

DevOps engineer in AI infrastructure

In short

Senior DevOps Engineer role at Encord, an AI data infrastructure startup, to join the platform engineering team in New York. The job covers owning CI/CD pipelines, managing Kubernetes and cloud infrastructure (GCP/AWS) at petabyte scale, driving observability (SLIs/SLOs, Prometheus, Grafana, OpenTelemetry), and reducing manual toil through automation. Requires 4+ years of hands-on DevOps/SRE/platform engineering experience, strong IaC skills (Terraform, Pulumi), and Kubernetes expertise. Hybrid role in New York requiring 4 days/week in-person.

About
Encord is the universal data layer for AI that helps 300+ AI teams train and run models on the right data. Our platform indexes, curates, annotates, and evaluates data across the full AI lifecycle, from development through production. We're an ambitious team of 100+ working at the frontier of AI. We're looking for a Senior DevOps Engineer with 5+ years of experience to join our growing platform engineering team in New York.
Responsibilities
•Own and continuously improve deployment pipelines; partner closely with developers to review infrastructure changes, streamline release processes, and champion DevOps best practices across the engineering group.
•Design, deploy, and maintain cloud infrastructure on GCP and AWS; manage Kubernetes clusters, networking, and storage at petabyte scale, with infrastructure-as-code as the default.
•Drive developer productivity by building, guiding, and reviewing automation and internal tooling efforts across the engineering group; eliminate manual toil wherever it exists.
•Profile and optimise services handling large-scale data pipelines; perform capacity planning for storage and compute-intensive workloads.
•Work with squads to establish performance benchmarks and expectations.
•Define and own SLIs/SLOs/SLAs for critical services; build alerting, runbooks, and incident response processes; lead postmortems with a blameless culture.
•Instrument services with distributed tracing, logging, and metrics (Prometheus, Grafana, OpenTelemetry, GCP Dashboards or similar); build infrastructure, define best practices, and work with each squad to ensure every service is observable before it goes to production.
Requirements
•4+ years of hands-on DevOps, platform engineering, or SRE experience in a production environment.
•Strong experience building and maintaining CI/CD pipelines and deployment automation at scale.
•Proven experience with infrastructure-as-code tools (e.g., Terraform, Pulumi) and configuration management.
•Strong fundamentals in designing, building, and maintaining resilient distributed and/or high performance systems.
•Hands-on experience with Kubernetes and containerised workloads in cloud environments (GCP and/or AWS).
•Solid understanding of networking, operating systems, and database technologies.
•Experience with observability fundamentals: metrics, logs, traces, and alerting.
Conditions & Benefits
•Competitive salary, commission, and meaningful equity in a high-growth start-up
•Clear, accelerated growth opportunities as the company scales rapidly
•Strong in-person culture: 4 days/week
•Flexible PTO to fully recharge
•Annual learning & development budget
•Comprehensive health, dental, and vision coverage
•Frequent travel opportunities across the U.S., London, and Europe
•Bi-annual company offsites, twice-weekly team lunches, and monthly socials
•Compensation Range: $180K - $230K

Stop applying.
Get referred.

$10 in free credits

In just 60 seconds, fully on autopilot — Eraldt's AI agents read your CV, map the roles you fit, find live vacancies and the people who can refer you, write personal emails, and get you referred.

This isn't an application: your CV doesn't go to the company, and we don't promise a referral for this exact role.

Discover who else lands interviews on autopilot