About the Role
We're creating a data platform that enables cutting-edge health research at unprecedented scale. As a Data Engineer, you'll play a critical role in designing and building the secure, high-quality data pipelines that power research used by scientists and healthcare innovators around the world.
Responsibilities
•Building and maintaining data pipelines across our Azure-based platform
•Translating technical specifications, architecture designs, and Jira tickets into secure, scalable implementations
•Developing data transformation and ETL processes using Python and PySpark
•Working with healthcare and NHS datasets to curate trusted, research-ready data assets
•Reviewing and approving code through pull requests, ensuring consistency, quality, security, and adherence to engineering standards
•Collaborating with researchers, engineers, and stakeholders to understand requirements and deliver solutions
•Identifying risks, challenging assumptions, and asking the right questions to improve designs before implementation
•Producing documentation, source-to-target mappings, and supporting technical standards across the platform
•Contributing to best practices in data engineering, security, governance, and cloud architecture
Requirements
•Proven experience building production-grade data pipelines and ETL processes
•Excellent Python skills with experience developing scalable data solutions
•Experience working with PySpark or distributed data processing frameworks
•Experience using GitHub and modern software engineering practices
•Understanding of cloud-based data platforms, ideally Azure
•Experience working with sensitive or regulated data and knowledge of secure data handling principles
•Ability to review technical designs and architecture documents and translate them into practical implementations
•Excellent problem-solving skills and an ability to challenge requirements constructively when needed
•Experience conducting code reviews and maintaining engineering standards
•Excellent stakeholder management and communication skills
Nice to Have
•Experience working with NHS or healthcare datasets
•Knowledge of healthcare coding systems and standards such as SNOMED CT, ICD, or READ codes
•Experience with Databricks
•Experience with Kubernetes
•Experience using Dagster or other workflow orchestration platforms
•SQL and data modelling experience
•Understanding of metadata management and data governance frameworks
Conditions
•Salary from £62,000 per annum. We are interested in applications from people with a range of experience for this role
•Generous Pension Scheme - employer contributions of up to 12%
•30 Days Holiday + Bank Holidays, with flexibility to take bank holidays when it suits you
•Enhanced Parental Leave
•Cycle to Work Scheme - save 25-39% on a new bike and accessories through salary sacrifice
•Home & Tech Savings - up to 8% off on IKEA and Currys products, spread over 12 months through salary sacrifice
•£1,000 Employee Referral Bonus
•Wellbeing Support - Mental Health First Aiders, 24/7 online GP services, and an Employee Assistance Programme for you and your family
•A lovely Central London office in Holborn, with flexible and remote working arrangements
