About the Role
Lumenalta partners with global enterprises to design and build large-scale data platforms that power their products and operations. This engagement supports a major US consumer goods company moving its SAP data into Databricks.
Responsibilities
•Build ingestion pipelines for SAP source data landing in Databricks, following the client-defined ingestion architecture
•Work with SAP table structures, relationships, and business objects to land data correctly and completely
•Implement incremental and change-data-capture patterns for SAP sources, and validate that deltas are applied accurately
•Transform landed SAP data into clean, usable Delta tables using PySpark, SQL, and Databricks declarative pipelines
•Reconcile Databricks outputs against SAP to confirm completeness and accuracy
•Identify gaps, performance issues, and failure points in the ingestion architecture, and propose practical improvements
•Document reusable patterns, configurations, and runbooks for subsequent SAP data domains
•Work directly with the client's engineering and data teams in their tools and environments, adapting to changing priorities
Requirements
•5+ years in data engineering, including production pipelines on Databricks
•Hands-on experience extracting and modeling SAP data from ECC or S/4HANA, including familiarity with core SAP tables and modules such as finance, sales, materials, or supply chain
•Experience with SAP extraction approaches such as ODP or BW extractors, SLT, SAP Datasphere, or third-party replication tools
•Experience implementing incremental and CDC ingestion patterns
•Strong PySpark and SQL skills, and working knowledge of Delta Lake
•Experience with Databricks declarative pipelines or Delta Live Tables, Auto Loader, and Databricks Workflows
•Comfortable working in a client-directed, time-and-materials model, where priorities are set by the client and can change week to week
•Clear written communication and the discipline to document reusable patterns
•Fluent English, both written and spoken
Nice to Have
•Experience with SAP Business Data Cloud or SAP Databricks
•Unity Catalog experience, including organizing and governing SAP-derived data
•Prior SAP-to-cloud migration work in consumer goods, manufacturing, or distribution
•Databricks Data Engineer Professional certification
Conditions
•100% dedicated to one project at a time
•Access to Databricks Delivery Partner Program qualification and Champion nominations, with mentorship and related program benefits
•Databricks certification exam fees are covered
•Interview process: a screening call, a technical interview, and a HackerRank assessment. The technical interview is a conversation rather than a whiteboard exam and covers a candidate-built SAP-to-cloud pipeline, SAP data extraction and modeling, handling deltas and reconciliation, and possible improvements. Relevant project experience matters more than certifications
•Applications accepted until October 4th, 2026. Candidates can expect feedback by October 12th, 2026
