Decskill

Big data engineer

In short

Senior Big Data Engineer role at an IT consulting company (part of Astek Group), designing and optimizing Big Data pipelines with Spark, Python, Hadoop, and Hive, working hybrid in Lisbon with international teams including Paris-based stakeholders. Requires 5+ years of Big Data/software development experience, strong skills in Spark, Hadoop, Hive, SQL, Kafka, Linux, CI/CD, Git, XL Release/Deploy, and CTRL-M, plus English B2+. French is a plus.

About Decskill
At Decskill, we believe that technological excellence is driven by human talent. We are an IT consulting company with more than 10 years of consolidated experience in the market, focused on building long-term relationships with both our clients and our people. Today, we are a community of over 800 professionals, working from Lisbon, Porto, and Madrid, contributing to impactful technology initiatives. As part of the Astek Group, we combine a strong local culture with a global presence, being active in around 23 countries across 4 continents.
Responsibilities
•Design, develop, and optimize Big Data solutions using Spark, Python, Hadoop, and Hive
•Develop and maintain scalable data processing pipelines and APIs
•Optimize application and data processing performance
•Implement and support CI/CD pipelines and deployment processes
•Manage source code and releases using Git, XL Release, and XL Deploy
•Schedule and monitor data workflows with CTRL-M
•Collaborate with international teams, including Paris-based stakeholders, to deliver high-quality solutions
•Troubleshoot production issues and contribute to the continuous improvement of Big Data platforms
Requirements
•5+ years of experience in Big Data and software development
•Strong experience with Spark, Python, Hadoop, Hive, and SQL
•Proficiency in Linux, APIs, and Kafka
•Experience with CI/CD, Git, XL Release, XL Deploy, and CTRL-M
•Solid understanding of DevOps concepts and performance optimization
•English level B2 or above (mandatory)
Nice to have: French is a plus
What we offer
•Long-term projects with national and international context
•Opportunities to grow technically and professionally
•A people-first culture, focused on transparency and trust
•Teams that value ownership, collaboration and stability

Stop applying.
Get referred.

$10 in free credits

In just 60 seconds, fully on autopilot — Eraldt's AI agents read your CV, map the roles you fit, find live vacancies and the people who can refer you, write personal emails, and get you referred.

This isn't an application: your CV doesn't go to the company, and we don't promise a referral for this exact role.

Discover who else lands interviews on autopilot