About the Role
We're looking for an Amazing Data Engineer with Machine Learning experience.
Requirements
•2–3 years of experience in Data Engineering, including involvement in projects involving traditional Machine Learning
•Strong experience with Azure Databricks
•Good knowledge of Python, SQL and PySpark
•Experience with Azure Data Lake Storage and formats such as Parquet and Delta Lake
•Experience across the full data solution development lifecycle: ingestion, transformation, modelling and data delivery
•Hands-on experience with Machine Learning libraries
•Knowledge of data preparation, feature engineering, model training, validation and evaluation
•Understanding of concepts such as overfitting, data leakage, train/test split and cross-validation
•Experience integrating models into data processing pipelines and batch scoring workflows
•Experience with Git and software development best practices
•Ability to develop scalable solutions, with a focus on performance and execution costs
•Fluent in Portuguese and English
Nice to Have
•Experience with Azure Machine Learning, including training jobs/pipelines, model registration and inference endpoints
•Experience with Azure Data Factory
•Knowledge of model monitoring, data drift detection and model retraining processes
•Experience deploying models through APIs or online endpoints
•Knowledge of Unity Catalog, data governance and access control
•Experience working with Agile methodologies, particularly Scrum, and using Jira and Confluence
Conditions
•Personalized career development, taking into consideration your needs and goals from short to long term
•Interesting challenges: you can work for several clients from different sectors of activity
•Free training and certification programs in languages, tech, behavior and business
•International projects in Benelux: gain international experience in Benelux
•Well-being support: free nutrition, psychology, general medicine appointments, yoga and personal training days — all remote
