RQ116502 Senior Data Engineer
Role Summary
We are seeking an experienced Senior Data Engineer to design, build and operate scalable data platforms, pipelines and products that enable data-driven decision making across Finance. This role combines strong software engineering practices with modern cloud data technologies to deliver trusted, secure and high-quality data products.
The successful candidate will work closely with business partners, product teams, architects, data managers and analytics specialists to transform complex business requirements into robust data solutions. They will lead technical delivery, drive engineering excellence and help establish modern data engineering practices across the organisation.
Key Responsibilities
Data Platform and Engineering
•Design, develop and maintain scalable data pipelines and integrations.
•Build and operate cloud-based data platforms, data products and analytical datasets.
•Develop reusable frameworks, automation and engineering patterns to accelerate delivery.
•Ensure data solutions are secure, performant, resilient and cost-efficient.
•Implement CI/CD, automated testing, monitoring and observability across data platforms.
Solution Design
•Translate business requirements into data models, pipelines and technical solutions.
•Design logical and physical data models supporting reporting, analytics, AI and operational use cases.
•Collaborate with enterprise and solution architects to align solutions with strategic technology standards.
•Evaluate new technologies and recommend improvements to existing platforms.
Data Management and Governance
•Support implementation of data governance, quality, lineage and metadata management practices.
•Ensure data assets meet applicable regulatory, audit and control requirements.
•Drive improvements in data quality and trusted data consumption.
Leadership and Collaboration
•Provide technical leadership across delivery teams.
•Mentor and coach data engineers and development teams.
•Collaborate with Product Managers, Data Scientists, AI Engineers and Finance stakeholders.
•Contribute to engineering standards, best practices and continuous improvement initiatives.
Essential Skills and Experience
Technical
•Significant experience delivering enterprise-scale data engineering solutions.
•Strong SQL and data modelling expertise.
•Experience with cloud data platforms, with Azure experience preferred.
•Experience building ELT/ETL pipelines and data integration solutions.
•Strong software engineering practices, including source control, testing, CI/CD and automation.
•Experience with big data, streaming and modern data architectures.
•Knowledge of security, access controls and data governance requirements.
What we expect:
•Drive continuous optimization of data pipelines to improve performance and scalability.
•Identify opportunities to reduce data volumes and optimize storage efficiency across the organization.
•Lead initiatives focused on process efficiency and operational excellence.
•Promote a data-driven culture by leveraging insights to support business decisions.
Preferred Experience
•Finance, Treasury, Tax, FP&A or ERP data domains.
•SAP, S/4HANA, Fiori or enterprise finance platforms.
•Data products supporting AI, machine learning or generative AI use cases.
•Experience with Databricks, Microsoft Fabric, Snowflake or comparable cloud data platforms.
•Experience operating within Agile product teams.
Other Skills Listed: Commercial Acumen, Communication, Data Analysis, Data cleansing and transformation, Data domain knowledge, Data Integration, Data Management, Data Manipulation, Data Sourcing, Data strategy and governance, Data Structures and Algorithms (Inactive), Data visualization and interpretation, Digital Security, Extract, transform and load, Group Problem Solving.
Travel Requirement: Up to 10% travel should be expected with this role.
Relocation Assistance: This role is not eligible for relocation.
Remote Type: This position is a hybrid of office/remote working.
Future Location Notice: This role will start in Sunbury, London. bp has announced a planned office move to Timber Square, London, with all positions currently advertised in Sunbury, including this one, expected to relocate around Q4 2027-Q1 2028. The specific date of the move will be confirmed closer to the time.
