Description
We are looking for an experienced Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a fantastic team of technology experts. You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability.
Responsibilities
•Develop Data Engineering solutions for our clients/projects
•Design and build data models, schemas to support business requirements
•Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc.
•Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based
•Work collaboratively with the client and cross-functional teams to identify and address data-related issues and opportunities
•Stay updated with the latest trends and developments in the data engineering field, such as modern data stack, big data technologies, cloud computing, etc.
Requirements
•Experience in operating as part of data engineering teams and independently
•Experience of working with cloud infrastructure (Azure or AWS, GCP is beneficial)
•SQL and relational databases (e.g. MS SQL/Azure SQL, PostgreSQL)
•Framework experience within either Flask, Tornado or Django, Docker
•Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc.
•Data acquisition and development of data sets and improving data quality
•Preparing data for predictive and prescriptive modelling
•Reporting tools (e.g. Tableau, PowerBI, Qlik)
•Passionate, motivated and enthusiastic about developing technology solutions
•Experience working in an Agile development environment
Nice to have
•Experience with cloud infrastructure (GCP is beneficial)
•Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo
•GDPR and Government Service Standard (desirable)
Benefits
•Competitive Salary
•Bonus Scheme
•Private Healthcare Insurance
•25 Days Annual Leave + Bank Holidays
•Up to 10 days allocated for development training per year
•Enhanced Parental Leave
•Paid Fertility Leave (5 Days)
•Contributory Pension
•EAP with Help@Hand
•Gym Membership Benefits
•Flexible Benefits Allowance
•Cycle to Work and Electric Vehicle schemes
•Flexible Working
•Annual Away Days/Company Socials
