Описание
Senovo IT Ltd operates in staffing and recruiting.
Задачи
•Design, develop, and maintain scalable data pipelines and ETL/ELT solutions using Azure services
•Build and optimize data processing workflows using Azure Databricks, Apache Spark, and Python
•Develop and manage enterprise data integration solutions using Azure Data Factory (ADF) and SQL Server Integration Services (SSIS)
•Design and implement data storage solutions using Azure Data Lake Storage Gen2 (ADLS Gen2) and Azure Synapse Analytics
•Perform advanced SQL development, query tuning, and performance optimization for large datasets
•Collaborate with business stakeholders, analysts, and architects to understand data requirements and deliver robust solutions
•Implement data quality, security, governance, and monitoring processes
•Participate in code reviews, version control management, and deployment activities using Git
•Troubleshoot and resolve data pipeline failures, performance bottlenecks, and production issues
•Follow best practices for cloud architecture, data modeling, and engineering standards
Требования
•Strong hands-on experience with Azure Synapse Analytics
•Expertise in Azure Databricks
•Experience with Azure Data Factory (ADF)
•Strong knowledge of SQL Server Integration Services (SSIS)
•Advanced SQL programming and query optimization
•Deep understanding of Apache Spark for batch and distributed data processing
•Proficiency in Python for data engineering and automation
•Experience with Git version control
•Knowledge of Azure Data Lake Storage (ADLS Gen2)
•Strong analytical, troubleshooting, and problem-solving skills
•Excellent communication and stakeholder management abilities
Условия
•Contract employment.
