MEDvidi

product analyst for Voice AI Agents

In short

Продуктовый аналитик анализирует качество Voice AI Agents и conversational AI систем: изучает транскрипты звонков, выявляет галлюцинации и сбои моделей, строит дашборды мониторинга AI-производительности для US-based медтех-платформы ментального здоровья. Требуется 3+ года опыта в продуктовой/операционной аналитике, сильный SQL, Python для анализа текстовых данных и понимание ограничений LLM. Полностью удалённая работа на условиях длительного B2B-сотрудничества, нужен свободный русский и английский B2+ с пересечением с CET-часовым поясом.

Описание
MEDvidi is a US-based AI-powered mental healthcare platform that helps patients across 30+ states receive treatment for ADHD, anxiety, depression, and other mental health conditions.
Задачи
•Analyze Voice AI Agents and conversational AI systems
•Investigate hallucinations, inconsistencies, silent failures, and quality degradation
•Analyze call transcripts, conversation logs, AI outputs, and operational datasets
•Evaluate AI quality and measure reliability
•Build monitoring frameworks and dashboards for AI performance
•Detect quality shifts, anomalies, and emerging failure modes
•Measure AI impact on patient experience, operations, and business outcomes
•Partner with Product, Engineering, QA, and Operations teams
Требования
•3+ Years of experience in Product Analytics, Data Analytics, or Operational Analytics
•Strong SQL skills
•Python skills for analytical investigations and working with large-scale text datasets
•Experience with ML pipelines or AI-powered products
•Understanding of LLM limitations, hallucinations, prompt sensitivity, and AI failure modes
•Experience building monitoring systems, analytical frameworks, or dashboards
•Strong communication skills and ability to translate insights into product decisions
•Fluent Russian and English B2+
•Ability to work CET-overlapping hours
•Nice to have: experience with conversational AI or AI agents, evaluating LLM outputs, and AI quality metrics and evaluation frameworks
Условия
•Fully remote long-term B2B collaboration
•Health insurance, wellness compensation, paid vacation, and sick leave
•Personalized English lessons via Preply

Stop applying.
Get referred.

$10 in free credits

In just 60 seconds, fully on autopilot — Eraldt's AI agents read your CV, map the roles you fit, find live vacancies and the people who can refer you, write personal emails, and get you referred.

This isn't an application: your CV doesn't go to the company, and we don't promise a referral for this exact role.

Discover who else lands interviews on autopilot