About the Role
HAYS is looking for a Data Engineer to join a growing international technology company. We are looking for someone with experience building and evolving data platforms on AWS, designing robust pipelines and datasets ready to be used by Analytics, BI and data-driven product teams.
Responsibilities
•Design and develop production data pipelines
•Build datasets, data marts and tables prepared for Analytics and BI
•Develop ETL/ELT processes with Python
•Work with Data Lake / Lakehouse architectures on AWS
•Implement incremental ingestion and near-real-time processes using CDC
•Design data models oriented toward BI, including Star Schema
•Ensure data quality by monitoring duplicates, integrity, freshness, schema changes and anomalies
•Orchestrate pipelines using Airflow and native AWS services
•Participate in architecture decisions, automation, CI/CD and Infrastructure as Code
Requirements
•4+ years of experience as a Data Engineer, developing and operating data pipelines in production environments
•Advanced level of Python
•Solid experience working with AWS
•Knowledge of services such as S3, Glue, Athena, Redshift, DMS, Lambda, Step Functions, CloudWatch, SQS/SNS, ECS or DynamoDB
•Experience working with Lakehouse architectures and Delta-type technologies
•Solid knowledge of Data Modelling, especially Star Schema
•Experience with Airflow
•Experience with AWS DMS / CDC in production environments
•Good testing and Data Quality practices
Conditions
No conditions stated in the posting.
