Constructor.io

Backend engineer in machine learning infrastructure

In short

Senior backend engineer role on the ML Infrastructure team at Constructor, an AI-first e-commerce search and discovery platform, building and operating shared backend services and platform capabilities that power ML model serving (including LLMs), data pipelines, and specialized storages at scale. Requires 5+ years of backend/platform engineering experience, extensive Python, hands-on public cloud or Kubernetes experience, and skill designing distributed, high-load services and APIs. The role is fully remote with a base salary of $80k–$120k USD plus stock options.

About the Role
Launched in 2019, Constructor is an AI-first e-commerce search and discovery platform that helps shoppers find the right products at the right time and enables leading global e-commerce brands to drive meaningful revenue and conversion gains. The ML Infrastructure team builds and operates the shared backend services and platform capabilities that Constructor's ML and product teams rely on to develop, deploy, and run machine learning at scale—from model serving (including LLMs) to the specialized storages and data pipelines behind it.
Responsibilities
•Making ML workloads easy to run, scale, and operate for every team.
•Providing self-service, configurable infrastructure components to ML and product teams.
•Owning and evolving core ML services and related pipelines with a high bar for reliability and performance.
•Design, build, and operate high-load distributed backend services that power the company's ML infrastructure.
•Take end-to-end ownership of core ML services and related data pipelines: from design and implementation to deployment, observability, and continuous improvement.
•Partner with ML and product teams to understand their needs and turn them into reliable, reusable platform capabilities.
•Make and defend technical decisions: evaluate trade-offs, design first, and own the outcome.
•Be responsible for what you and your team do.
Requirements
•5+ years of professional experience in backend or platform engineering.
•Extensive Python knowledge (our primary language).
•Hands-on experience developing on a public cloud (AWS, GCP, or Azure) or with self-managed Kubernetes—AWS is our primary platform, but we're not limited to it.
•Experience designing and building distributed, high-load services and APIs.
•Strong knowledge of data structures, algorithms, and their trade-offs.
•Design-driven engineering mindset: we're a coding-assistant-friendly environment and expect you to use modern AI tools—but you lead with system design and a strong understanding of their applicability and trade-offs.
•Ownership and proactivity: you can't close your eyes to problems, but are ready to solve them and take responsibility for outcomes.
•You are friendly and willing to help your teammates & others.
Nice to Have
•Experience with Rust (or C/C++/Go)—a strong plus.
•Experience developing or contributing to ML platforms or ML infrastructure—a strong plus.
•Experience setting up and operating any vector database (Qdrant, Milvus, Weaviate, OpenSearch, pgvector, etc.)—a strong plus.
•Experience with model serving / inference infrastructure, including LLMs.
•Experience with Infrastructure as Code (Terraform or similar).
Conditions & Benefits
•Unlimited vacation time—we strongly encourage all of our employees to take at least 3 weeks per year.
•Fully remote team—choose where you live.
•Work from home stipend! We want you to have the resources you need to set up your home office.
•Apple laptops provided for new employees.
•Training and development budget for every employee, refreshed each year.
•Maternity & Paternity leave for qualified employees.
•Work with smart people who will help you grow and make a meaningful impact.
•Base salary: $80k–$120k USD, depending on knowledge, skills, experience, and interview results.
•Stock options—offered in addition to the base salary.
•Regular team offsites to connect and collaborate.

Stop applying.
Get referred.

$10 in free credits

In just 60 seconds, fully on autopilot — Eraldt's AI agents read your CV, map the roles you fit, find live vacancies and the people who can refer you, write personal emails, and get you referred.

This isn't an application: your CV doesn't go to the company, and we don't promise a referral for this exact role.

Discover who else lands interviews on autopilot