Senior Data Engineer
Company: Adyen
About the Role
You will design, deploy, and operate production ELT pipelines and data architectures. You will integrate data from diverse sources, ensure quality through testing and monitoring, improve pipeline and query performance, establish data practices, and collaborate with stakeholders to deliver understandable integration insights.
Requirements
•6+ years of data engineering experience
•Python
•PySpark
•Airflow
•Hadoop
•Spark
•Kafka
•SQL
•Git
•Pytest
•Data validation
•Data governance
Responsibilities
•Engage stakeholders to understand requirements and craft solutions
•Design, develop, deploy, and operate production ELT pipelines and data architectures
•Integrate data from multiple sources and formats
•Establish data-performance, code-quality, validation, governance, and discoverability practices
•Implement testing, monitoring, and validation protocols for code and data
•Identify and resolve data-pipeline and system performance bottlenecks
•Improve query performance and resource utilization
Benefits
•RSUs
Salary: $198K - $293K