ROKO Labs

Python developer in AI systems

In short

Senior Python Engineer role at ROKO Labs building production-grade AI/LLM systems, including RAG pipelines, semantic search, and LLM API integrations (OpenAI, Anthropic, Azure OpenAI). The work spans backend architecture (FastAPI/Flask/Django), vector databases (Pinecone, Weaviate), relational and NoSQL databases, messaging queues, and cloud deployment (AWS/Azure/GCP) with Docker/Kubernetes. Requires 7+ years of software development experience with the last 1–2 years focused on AI/LLM solutions, expert-level Python, and intermediate English or higher. Fully remote, full-time, with flexible hours and no fixed time-tracking.

About the Role
ROKO Labs is looking for a Senior Python Engineer with deep AI expertise to join our team working on large-scale, production-grade intelligent systems. If you love writing clean, well-tested Python code, thrive in cross-functional environments, and are excited about building real-world AI solutions — come join a team of like-minded, caring professionals.
Responsibilities
•Architect and develop scalable, production-grade Python applications, including LLM-powered systems, RESTful APIs, and microservices using FastAPI, Flask, or Django
•Design and implement end-to-end Retrieval-Augmented Generation (RAG) pipelines, embedding workflows, and semantic search solutions in Python
•Build, optimize, and maintain data ingestion pipelines and background task processing using Celery, RabbitMQ, or Kafka
•Integrate and manage LLM APIs and AI platforms (e.g., OpenAI, Anthropic, Azure OpenAI) within robust Python service architectures
•Design and optimize database schemas and queries across relational (PostgreSQL, MySQL) and NoSQL (MongoDB, DynamoDB) databases
•Design scalable vector database architectures (e.g., Pinecone, Weaviate) to support AI-driven search and retrieval features
•Containerize and orchestrate Python services using Docker and Kubernetes for reliable, repeatable cloud deployments (AWS, Azure, or GCP)
•Identify and resolve performance bottlenecks in Python applications through profiling, caching strategies, and code optimization
Requirements
•7+ years of software development experience, with the latest 1–2 years focused on AI/LLM-powered solutions
•Strong, expert-level Python skills — Python is the primary language for this role
•Proven hands-on experience building and deploying LLM applications, especially RAG-based systems
•Good knowledge of Python web frameworks and libraries: Django, Flask, FastAPI
•Experience with data-processing libraries: Pandas, NumPy, Scikit-learn
•Solid understanding of vector databases (e.g., Pinecone, Weaviate) and semantic search architectures
•Experience integrating LLM APIs (OpenAI, Anthropic, Azure OpenAI)
•Strong understanding of RESTful APIs, microservices, and scalable backend architecture
•Good working knowledge of cloud platforms: AWS, Azure, or GCP
•Solid experience with SQL and relational databases (PostgreSQL, MySQL)
•Experience with messaging queues (RabbitMQ, Kafka) and Docker
•Strong testing, debugging, and problem-solving skills
•Strong communication skills; Intermediate English or higher
•BSc/MSc in Computer Science, Engineering, AI, or a related field
Nice to Have
•Experience with NoSQL databases (MongoDB, DynamoDB)
•Experience with multi-agent AI system design
•Familiarity with alternative vector databases (FAISS, Milvus)
•Experience with the Hugging Face ecosystem or fine-tuning open-source models
•Hands-on experience with advanced MLOps frameworks and model governance
•Experience with system architecture or leading a software team
•PhD (completed or in progress) in a relevant field
Conditions
•Our developers work on only one project at a time, so there is no need to juggle 2 or more projects
•We work on long-term projects, giving you the opportunity to get to know the client and their needs well, as well as the team
•Opportunity to work on complex solutions with the latest technologies
•Remote work — it's up to you whether you work from home, beach, or the office
•Flexible working hours — tailor your workday to your preferences, without a time-tracking system
•All employees immediately receive a contract for an indefinite period (B2B collaboration is also an option)
•Regular feedback as part of our commitment to your ongoing development and success
•Job role switch option if you want to try new roles or technologies, with support via opportunities, feedback, and mentoring
•Open to discussing education opportunities for courses or conferences
•Each team has monthly knowledge-sharing sessions combined with weekly talks and brainstorming sessions
•Referral fee if you recommend a colleague or friend who could be a good fit
•Salary will be based on your experience and skills

Stop applying.
Get referred.

$10 in free credits

In just 60 seconds, fully on autopilot — Eraldt's AI agents read your CV, map the roles you fit, find live vacancies and the people who can refer you, write personal emails, and get you referred.

This isn't an application: your CV doesn't go to the company, and we don't promise a referral for this exact role.

Discover who else lands interviews on autopilot