About the Role
Insight Global are seeking a Data Engineer to join the R&D AI organisation of a leading global pharmaceutical company. This position is fully remote in Europe for a contract through June 2027. The Data Engineer will join a small engineering team responsible for building and expanding an internal AWS-based platform for the storage and processing of large-scale, non-GxP omics datasets. You will help develop scalable data pipelines that enable scientific and technical teams to ingest, process, store and consume complex datasets from internal and external sources.
Responsibilities
•Working with large structured and unstructured scientific datasets
•Developing data processing pipelines
•Capturing metadata
•Designing appropriate data models
•Supporting the continued development of the platform's data capabilities
Requirements
•Strong professional experience in Data Engineering
•Strong Python skills
•Experience with Databricks and data lake architectures
•Experience building and maintaining scalable data processing pipelines
•Experience handling large structured and unstructured datasets and files
•Experience designing schemas and data models for both tabular and non-tabular data
•Experience with data processing tools such as Pandas, DuckDB or similar technologies
•Strong AWS experience, particularly with technologies such as Amazon S3
•Experience with Apache Airflow, Apache Iceberg or similar data engineering technologies
Nice to Have
•Educational or professional experience in biology, bioinformatics, biotechnology or another scientific discipline
•Experience working with omics or sequencing data
•Experience with Nextflow and/or Seqera
•Experience with TileDB
•Experience with WEKA storage
•Understanding of data archiving strategies
•Experience supporting scientific or bioinformatics users and workflows
Conditions
•Fully remote in Europe
•Contract through June 2027
