About Preply
Preply creates life-changing learning experiences by helping people find tutors, build personalized learning journeys, and stay motivated. Its human-led, technology-enabled platform serves more than 100,000 tutors teaching over 90 languages to learners in 180 countries.
Responsibilities
•Formalize linguistic phenomena into clear rules, taxonomies, annotation criteria, and system or model requirements
•Design, evaluate, and improve prompts and other AI components for language-learning use cases
•Build representative training, calibration, and evaluation datasets, including annotation guidelines and quality-control processes
•Evaluate model behavior using qualitative and quantitative methods, investigate failure modes and quality issues, and validate fixes across prompts, models, data, and downstream processing
•Use Python and existing tools to process linguistic data and automate evaluation
•Collaborate with engineers, product managers, learning designers, and computational linguists to develop reusable solutions, resources, and practices that scale across use cases and languages
•Stay informed about best practices and advances in NLP and LLM research
Requirements
•2–3 years of experience in Computational Linguistics, NLP, or a related role
•Hands-on experience with LLMs, including prompt design, evaluation, and model behavior analysis
•Proficiency in Python for data processing, evaluation, and automation
•Strong understanding of datasets, annotation workflows, evaluation methods, and quality assurance for AI systems
•Comfortable using AI tools in day-to-day problem-solving, analysis, and workflow automation
•Strong qualitative and quantitative analysis skills for evaluating linguistic data, model behavior, and system quality
•Ability to collaborate effectively in cross-functional teams
•Degree in Linguistics, Computational Linguistics, NLP, Language Technology, or a related field, or equivalent practical experience
•Excellent spoken and written English, with strong linguistic precision
Conditions
•Monthly allowance for lessons on Preply.com
•Learning & Development budget and time off for self-development
•Competitive financial package with equity, leave allowance, and health insurance
•Access to free mental health support platforms
