Runway

Member of Product Staff, Agents (AI)

In short

This role owns the end-to-end development of AI agent products, from customer and technical discovery through evaluation, prompt experimentation, and launch. The company builds AI/LLM-powered agent products for creative and marketing workflows. It requires 8+ years in software with direct ownership of an AI- or LLM-powered product, experience shipping agent products, and knowledge of tool use, planning loops, and agent failure modes. The job demands strong prompt engineering skills, familiarity with evaluation frameworks, and the ability to translate customer research into shipped product improvements.

About the Role
You will own the end-to-end development of agent products, from customer and technical discovery through product shaping, quality, feedback loops, and launch. You will engage customers, conduct interviews and competitive research, analyze evaluations, experiment with prompts, build evaluation infrastructure, monitor regressions, scope releases, ship product improvements, and equip sales, support, and marketing to communicate new capabilities.
Requirements
•8+ years in the software industry
•Direct ownership of an AI- or LLM-powered product in a product management or engineering leadership role
•Track record of improving revenue and adoption metrics
•Experience building and shipping agent products
•Knowledge of tool use, planning loops, multi-step reasoning, and agent failure modes
•Prompt engineering experience
•Familiarity with evaluation frameworks
•Excellent written and verbal communication
Responsibilities
•Develop a deep understanding of creative and marketing workflows through customer engagement
•Synthesize findings on agent performance and behavior
•Run user interviews, competitive research, evaluation analysis, and prompt experimentation
•Shape research findings into product offerings that solve customer problems
•Create evaluation infrastructure and monitor regressions
•Ensure agents improve with every release
•Scope work to deliver user value on fast-paced releases
•Ship product improvements and pull requests
•Enable sales, support, and marketing to communicate new agent capabilities

Stop applying.
Get referred.

$10 in free credits

In just 60 seconds, fully on autopilot — Eraldt's AI agents read your CV, map the roles you fit, find live vacancies and the people who can refer you, write personal emails, and get you referred.

This isn't an application: your CV doesn't go to the company, and we don't promise a referral for this exact role.

Discover who else lands interviews on autopilot