About the Role
Our client, a global leader in energy technology, is launching a high-visibility initiative to build real-time applications on live data from one of its European factories. Cameras on the factory floor detect objects, and the applications must process this unstructured video and image data and respond instantly. The first release is due within 3 to 4 months, with the longer-term aim of scaling the solution to other sites. You will join once the Product Manager and Solution Architect are in place.
Responsibilities
•Design, build and maintain scalable pipelines for real-time ingestion, transformation and analysis
•Process unstructured data at speed, especially video and images
•Build and maintain infrastructure as code with AWS CDK
•Implement and optimise storage in Snowflake and Aurora
•Work with the development team on Python backend integration
•Apply best practice in data modelling and data quality
•Monitor and troubleshoot pipelines to maintain availability and performance
Requirements
•Proven Senior Data Engineer experience on complex transformation projects
•Hands-on work with unstructured data, ideally video
•Strong AWS skills, with hands-on AWS CDK
•Extensive Snowflake and Aurora experience
•Solid Python backend development
•Clear communicator who can explain technical concepts to non-technical stakeholders
Nice to have
•Real-time or streaming experience
•Computer vision
•Agile methodologies
Conditions
•Fully remote (European Union)
•Start: ASAP
•Duration: until end of September 2027 (with possibility to extend)
