About
Sii's Data & Analytics Competency Center focuses on data processing and analysis, with development opportunities in Data Science, Big Data, and Machine Learning.
Responsibilities
•Design, build, and develop scalable, high-performance data processing platforms using Data Lake / Data Platform architecture
•Create and maintain ETL/ELT pipelines to integrate data from various sources and process it in Azure Databricks
•Model data and prepare structures for analytical and business needs
•Implement batch and/or near-real-time data processing solutions
•Monitor, optimize, and develop existing pipelines and data processing processes
•Collaborate with data analysts, BI teams, and Data Science teams on data preparation and sharing
•Gather business requirements and propose optimal technological solutions
•Create and maintain technical documentation for developed solutions
•Support and mentor less experienced team members, sharing knowledge and best practices
Requirements
•At least 4 years of experience in projects involving processing and integrating large volumes of data
•Strong knowledge of SQL and Python
•Experience with data processing frameworks such as Apache Spark / PySpark
•Practical experience designing and building Data Lake and Data Warehouse solutions
•Ability to build and maintain ETL/ELT pipelines and work with data orchestration and integration tools
•Commercial experience in cloud-based Microsoft Azure data processing projects, such as Databricks, Azure Data Factory, Synapse, and Fabric
•Knowledge of distributed data processing concepts and data pipeline optimization
•Fluent English
•Fluent Polish
•Must be located in Poland
Nice to have
•Experience in projects involving data migration from on-premise to cloud, using Oracle, PostgreSQL, or MS SQL databases
Conditions
•Location: Warsaw
•Profit sharing
•Internal training center
•Regular integration events and trips
•Medical care
•Comfortable, well-equipped offices
