About the Role
As a Data Engineer in the BDE team, you will be a key contributor to the Synapse platform - ITV's operational data engine. We are currently on an ambitious journey to transition our data landscape to make it fit for future needs which collect and measure user behaviour, ensuring high-quality data powers ITV's core viewer experiences.
Responsibilities
•Build and maintain high-throughput streaming and batch pipelines on Dataflow and BigQuery, with Python for orchestration and tooling, utilising Go for the low-latency viewer-facing services, such as continue watching.
•Deploy and manage services using a "lego brick" Terraform methodology, with the flexibility to write custom pipelines when standard modules don't fit the use case.
•Write unit and integration tests as part of our Definition of Done, and help us move beyond after-the-event validation toward proactive, integrated testing, including load testing ahead of big live events.
•Set up metrics and alerting for what you ship, using native logging and monitoring dashboards defined in Terraform, alongside Grafana & Prometheus for deeper system metrics.
•Implement and manage fine-grained access through GCP IAM to ensure data integrity and compliance.
•Take part in the team's support and on-call rota, triaging support issues and bugs as they are reported. Critical issues with our viewer-facing services are picked up straight away, with everything else prioritised alongside planned engineering work.
Requirements
•Hands-on experience with GCP (Pub/Sub, BigQuery, Dataflow, Composer/Airflow, Cloud Functions, GKE and Cloud Build), or equivalent experience on another cloud and a willingness to go deep on GCP.
•Strong SQL, and proficient in at least one of Python, Java or Go with a willingness to pick up the others.
•Experience with streaming data, SQL-based transformation tooling, and CI/CD pipelines.
•Good knowledge of Terraform and of deploying containerised services.
•Ability to work within a complex high-level architecture involving event-driven streaming and multi-project environments.
•Comfortable in a mature Agile environment, participating in daily standups, sprint planning, and retrospectives.
•Able to work in a matrix organisation and a distributed team (UK, Brazil and Spain), liaising with Product Managers and stakeholders across Personalisation, Marketing, Commercial and Finance to refine requirements into technical tasks.
•A desire to improve existing validation tools and contribute to the team's "tool chest" of reusable components.
•We are actively experimenting with AI-assisted engineering (Claude Code, Gemini ADK, Vertex AI agents) and want people who are keen to learn to use it well.
Conditions
No conditions stated in the posting.
