Version 1

AI Data Engineer

In short

Senior AI Data Engineer role at Version 1, a large UK/Ireland technology consultancy, designing and building production-grade data and Generative AI solutions on Databricks and Azure. The role covers ETL/ELT and AI pipelines, Lakehouse architecture, RAG pipelines, multi-agent AI workflows, and MLOps, requiring strong Python, SQL, PySpark, and Databricks expertise. Hybrid position based in Dublin, Ireland, requiring at least 3 years of relevant experience.

About Version 1
Version 1 has celebrated 30 years in business and continues to be trusted by global brands to deliver technology and transformation solutions that drive customer success. The company fosters strong partnerships with global technology leaders including Microsoft, AWS, Oracle, Red Hat, OutSystems, and Snowflake. Highlights:
•UK & Ireland's premier AWS, Microsoft & Oracle partner
•3300+ strong, €350m/£300m revenue business
•10+ years as a Great Place to Work in Ireland & UK
•Best Workplace for Women in the UK & Ireland by GPTW
•Best Workplace for Wellbeing in the UK by GPTW
Responsibilities
•Design and build scalable ETL/ELT and AI pipelines using Databricks, PySpark, Delta Lake and SQL.
•Develop and maintain Lakehouse architectures using Bronze, Silver and Gold data layers.
•Build and optimise Delta Live Tables, Databricks Workflows and job orchestration processes.
•Develop and deploy production-grade Generative AI and agent-based solutions.
•Create and maintain RAG pipelines and AI agent frameworks.
•Support MLOps activities, including model training and inference pipelines using MLflow.
•Implement data quality monitoring, governance controls and metadata management through Unity Catalog.
•Develop event-driven integrations using Azure cloud services.
•Collaborate with cross-functional teams to create feature stores and AI training datasets.
•Integrate Databricks with wider Azure services including ADLS Gen2, Azure Data Factory, Azure Key Vault and Azure DevOps.
•Contribute to the development of data engineering best practices and centre of excellence initiatives.
•Mentor and support engineering teams in AI technologies and capabilities.
Requirements
•Strong experience as a Data Engineer, AI Engineer, Machine Learning Engineer, or similar role.
•Hands-on experience building and deploying production-grade:
•Multi-agent AI workflows
•Retrieval Augmented Generation (RAG) solutions
•AI agent frameworks
•Data pipeline solutions within Databricks
•Strong programming skills in Python and SQL.
•Experience with Apache Spark and distributed data processing.
•Experience implementing Generative AI solutions within Databricks Workflows and Jobs.
•Strong knowledge of Databricks Lakehouse architecture.
•Hands-on experience with: Delta Lake, Unity Catalog, Databricks Workflows, MLflow.
•Experience implementing event-driven integrations using: Azure Service Bus (essential), Azure Functions (essential), Azure Databricks (essential).
•Understanding of data modelling and Medallion/Lakehouse architecture.
•Experience with Git-based version control and CI/CD practices.
•Strong understanding of AI/ML pipelines, including data preparation, feature engineering and model deployment.
•Excellent English communication skills.
•Experience with PyTorch and/or TensorFlow.
•Experience with Event Hub and Logic Apps.
•Experience designing enterprise-scale AI platforms.
•Experience mentoring engineering teams or leading technical initiatives.
•Exposure to financial services or highly regulated environments.
•Experience building advanced LLMOps capabilities including prompt tracking, trace logging and regression benchmarking.
Technology Stack
Databricks, PySpark, Delta Lake, Unity Catalog, MLflow, Python, SQL, Apache Spark, Azure Databricks, Azure Service Bus, Azure Functions, Azure Data Factory, Azure Data Lake Storage Gen2, Azure Key Vault, Azure DevOps, Git, PyTorch / TensorFlow.
The company is looking for an engineer who can bridge the gap between modern data engineering and AI innovation, comfortable delivering production-ready solutions, collaborating across teams, and enabling organisations to scale their AI capabilities through robust engineering practices.
Role Overview
Version 1 is seeking an experienced Senior AI Data Engineer to join a high-impact team delivering innovative data and AI solutions within a complex enterprise environment. This role is responsible for designing and implementing modern data platforms, AI workflows, and Generative AI solutions using Databricks and Azure technologies. The successful candidate will combine strong data engineering expertise with hands-on experience building production-grade AI solutions, including Retrieval Augmented Generation (RAG) pipelines, multi-agent workflows, and MLOps capabilities.
Benefits
•Quarterly Performance-Related Profit Share Scheme
•Strong Career Progression & mentorship coaching through Strength in Balance & Leadership schemes, with a dedicated quarterly Pathways Career Development programme
•Flexible/remote working arrangements
•Financial Wellbeing initiatives: Pension, Private Healthcare Cover, Life Assurance, Financial advice, Employee Discount scheme
•Employee Wellbeing schemes: Gym Discounts, Bike to Work, Fitness classes, Mindfulness Workshops, Employee Assistance Programme and more
•Generous holiday allowance, enhanced maternity/paternity leave, marriage/civil partnership leave and special leave policies
•Educational assistance, incentivised certifications and accreditations, including AWS, Microsoft, Oracle, and Red Hat
•Reward schemes including Version 1's Annual Excellence Awards & Star Awards
•Environment, Social and Community First initiatives for local fundraising and development opportunities

Stop applying.
Get referred.

$10 in free credits

In just 60 seconds, fully on autopilot — Eraldt's AI agents read your CV, map the roles you fit, find live vacancies and the people who can refer you, write personal emails, and get you referred.

This isn't an application: your CV doesn't go to the company, and we don't promise a referral for this exact role.

Discover who else lands interviews on autopilot