DataArt

Senior MLOps Developer for LLM agents

In short

Senior MLOps/DevOps роль в проекте AI Platform, где нужно строить систему версионирования LLM-агентов как неизменяемых единиц деплоя. Требуется опыт CI/CD с evaluation-гейтами, работой с AWS ECR/AgentCore Runtime и фреймворками оценки агентов (Langfuse, LangSmith, PromptLayer). Формат работы полностью удалённый, требуется от 5 лет опыта в MLOps/DevOps с AI/ML системами.

Описание
The AI Platform project builds a reliable versioning model for LLM agents as immutable deployment units. It supports controlled release workflows, evaluation-based promotion gates, and rollback patterns to maintain quality and consistency across environments.
Задачи
•Develop immutable versioning workflows for agent container images, prompt configuration, tool bindings, and policy associations as a single deployment unit
•Design and maintain CI/CD pipelines with evaluation gates for AI systems before production promotion
•Implement agent promotion workflows across development, QA, and production environments
•Support rollback patterns for agent versions and validate restored versions
•Manage AWS ECR image practices, including ARM64 tagging, lifecycle policies, and image signing for agent immutability
•Integrate agent versions with a registry and maintain metadata such as evaluation results and promotion status
•Collaborate on endpoint management patterns for default and named runtime endpoints
Требования
•5+ Years of MLOps or DevOps engineering experience with AI or ML systems
•Experience with versioning and lifecycle management for LLM agents or ML models
•Experience with immutable artifact versioning at enterprise scale using ECR or model registries
•Experience designing CI/CD pipelines with quality gates for AI systems
•Hands-on experience with AWS AgentCore Runtime versioning
•Experience with agent evaluation frameworks such as Langfuse, LangSmith, or PromptLayer
•Experience with multi-environment agent promotion patterns
•Experience with agent version comparison and regression detection
Условия
No conditions specified

Stop applying.
Get referred.

$10 in free credits

In just 60 seconds, fully on autopilot — Eraldt's AI agents read your CV, map the roles you fit, find live vacancies and the people who can refer you, write personal emails, and get you referred.

This isn't an application: your CV doesn't go to the company, and we don't promise a referral for this exact role.

Discover who else lands interviews on autopilot