Description
DCG is a recruitment company that provides recruitment services for its partners and supports clients throughout their cooperation.
Responsibilities
•Integrate with external REST APIs, including handling authorization, pagination, rate limits, and retries
•Retrieve, parse, and process JSON and XML data
•Implement transformations and data structures according to the established architecture
•Ensure data quality through validation, handling source schema changes, and enabling data reprocessing
•Implement logging, pipeline monitoring, and error handling
•Work with Git repositories and the client's CI/CD processes
•Collaborate with the client's team, clarify requirements independently, and report technical issues
Requirements
•At least 3 years of commercial experience as a Data Engineer
•Practical Python experience building and maintaining production ETL/ELT pipelines
•Experience integrating REST APIs and processing JSON/XML data
•Good SQL knowledge
•Experience with data validation, schema drift, error logging, and data reprocessing; familiarity with tools such as Pydantic, Pandera, or Great Expectations
•Practical experience with selected services: Azure Data Lake Storage, Azure Data Factory, Azure Functions, Azure SQL, Azure Databricks, or Microsoft Fabric
•Knowledge of Git and CI/CD using Azure DevOps or GitHub Actions
•English at B2+ level for recruitment interviews and daily collaboration with the client
•Independence and ability to work within an existing team and technical environment
Nice to have
•Integrating AI/LLM outputs into data pipelines and evaluating their quality
•Knowledge of preparing data models for Power BI
•Experience with legislative or regulatory data such as Congress.gov or UK Parliament APIs
Conditions
•Private medical care
•Sports card subsidy
•Ongoing consultant support
•Employee referral program
