Tasks
•Design, develop, and maintain data products within an Azure Databricks lakehouse environment
•Build and optimise Silver and Gold layer transformations using Medallion Architecture principles
•Contribute to data modelling and architecture discussions
•Investigate and resolve data quality and platform issues
•Develop reporting and analytics solutions using Power BI and Databricks
•Partner with business and technical stakeholders to deliver high-quality data products
•Support code reviews, modelling reviews, and engineering best practices
•Ensure solutions are scalable, reusable, and aligned with governance standards
•Communicate technical solutions, trade-offs, and recommendations to stakeholders
Requirements
•10+ years' experience in Data Engineering, ideally within the insurance sector
•Proven experience delivering enterprise data platforms and business-facing data products
•Strong stakeholder management skills with the ability to work across business and technology teams
•Experience working with underwriters, actuaries, or other business stakeholders
•Strong understanding of data modelling, data governance, and Agile delivery methodologies
•Excellent communication skills with the ability to explain technical concepts to non-technical audiences
•Bachelor's degree in a technical, scientific, mathematical, or business-related discipline (or equivalent experience)
•Advanced SQL and PySpark
•Azure Databricks and Delta Lake
•Data lakehouse architectures and Medallion Architecture (Silver & Gold layers)
•Data modelling and transformation design
•Power BI reporting and dashboard development
•Databricks Dashboards
•Data quality management and troubleshooting
•Semantic layer and consumption layer development
•Azure data platform technologies
•Agile/Scrum delivery practices
•Version control and modern development workflows
•Strong understanding of data governance principles
Nice to have
•Insurance industry experience, particularly specialty insurance, delegated authority, or large-risk environments
•Databricks Unity Catalog
•Experience with AI, LLMs, and Retrieval-Augmented Generation (RAG)
•Databricks Genie experience
•Dimensional modelling, including Star Schemas and Slowly Changing Dimensions (SCDs)
•Databricks Certified Data Engineer certification
•Microsoft Azure Data Engineer Associate certification
Conditions
No conditions stated in the posting.
