About RemoFirst
RemoFirst provides an all-in-one global HR platform that simplifies hiring, compliance, payroll, and benefits management for businesses hiring and managing global teams.
Responsibilities
•Design, develop, and maintain production-grade conversational AI systems
•Own AI features from technical design through deployment and production support
•Design scalable AI architectures and agent workflows
•Build and maintain AI evaluation frameworks, benchmarks, and automated testing pipelines
•Improve AI quality through experimentation, evaluation, and data-driven optimization
•Integrate multiple AI providers and select the best models for different use cases
•Monitor production AI systems and improve reliability, quality, and performance
•Collaborate with product, frontend, and backend teams to deliver end-to-end AI features
•Review technical designs and contribute to engineering best practices
•Troubleshoot complex AI and production issues and deliver high-quality, maintainable solutions
•Stay up to date with Generative AI advancements and apply them where they create business value
Requirements
•5+ Years of experience building AI-powered applications in production
•Strong knowledge of LLMs, prompt engineering, AI agents, RAG, tool calling, structured outputs, and orchestration frameworks
•Experience designing and developing conversational AI systems for voice and/or chat
•Strong understanding of AI system design, including context management, memory, retrieval, multi-agent workflows, and reasoning pipelines
•Experience building AI evaluation frameworks, automated testing pipelines, benchmarks, and regression tests
•Experience improving AI quality through iterative evaluation and experimentation
•Strong software engineering fundamentals, including clean architecture, design patterns, testing, and maintainable code
•Experience integrating multiple AI providers such as OpenAI, Anthropic, Gemini, or similar
•Experience deploying, monitoring, and maintaining AI applications in production
•Full-stack development experience with modern backend and frontend technologies
•Experience with cloud platforms, APIs, CI/CD pipelines, and production deployments
•Strong analytical and problem-solving skills
•Ability to evaluate AI approaches and select solutions based on quality, reliability, latency, and cost
•Ability to independently own complex AI projects from design through production with minimal supervision
Nice to have
•Experience building traditional ML applications
•AI observability, tracing and monitoring
•Mentoring engineers, and driving engineering best practices
Conditions
•Competitive compensation
•100% Remote work
•Startup environment with the opportunity to influence and grow rapidly
•Opportunity to build a tech unicorn and join an AI-forward company
•Work with market-leading companies, including Microsoft and Mastercard, as customers
•Reports to the Lead AI Engineer; projects are strategic and business-critical
•Work with colleagues from top tech companies in a culture that values respect, kindness, autonomy, accountability, hard and smart work, diversity, and inclusion
