About the company
First Line Software works with some of the world's top businesses and organisations in industries like healthcare, real estate, data engineering, warehouse automation, retail digitalisation, mobile app development, and e-commerce. Our projects are as varied as our people, and our people are as talented as they come. We prefer working as a transparent and supportive team, who shares our knowledge as well as our success.
Responsibilities
•Build and maintain scalable data pipelines and workflows.
•Develop evaluation frameworks for Generative AI and LLM applications.
•Create and maintain golden datasets for model testing.
•Evaluate and benchmark LLM performance.
•Build machine learning-assisted tools to improve delivery and automation.
•Deploy production-ready AI solutions.
•Work closely with delivery teams to solve technical challenges.
•Continuously improve data quality, automation, and operational efficiency.
Requirements
•5+ years experience in Data Engineering, Machine Learning, AI Engineering, or Data Science.
•Strong Python and SQL skills.
•Hands-on experience with Generative AI and LLMs.
•Experience evaluating LLMs using golden datasets, model benchmarking, or LLM-as-a-Judge techniques.
•Experience building and deploying production-ready machine learning solutions.
•Strong understanding of data pipelines, validation, and quality frameworks.
•Experience integrating APIs and cloud-based AI services.
•Strong problem-solving and analytical skills.
•Comfortable owning solutions end-to-end.
•Excellent communication and stakeholder management skills.
•Experience working in Agile, cross-functional teams.
Nice to have: Consulting or customer-facing experience
Conditions
•Our modern stack projects are the right mix of exciting and challenging
•Gain access to our diverse range of training programs, courses, and certifications
•Choose your work style: remote, on-site or hybrid in one of our stunning offices
•Freedom of flexible working hours
•Corporate English classes
•Work from anywhere and explore the world with our Workation program
