About the role
JLL, an international real estate management company, is seeking a Data Engineer to join our JLL Technologies Team. We are seeking candidates that are self-starters who can work in a diverse and fast-paced environment. We are looking for a candidate to provide Azure Databricks, Python, PySpark, SparkSQL, Delta Lake, Azure Data Factory and Azure DevOps CI/CD expertise to design and build the required solutions for our clients, working alongside senior engineers to turn business requirements into reliable, well-documented data solutions.
Responsibilities
•Plan, design, develop, execute and monitor data integration and ETL/ELT pipelines that ingest, cleanse and normalize data from diverse internal and external sources to support project delivery and daily operation.
•Build, debug and optimize Databricks notebooks, PySpark/SparkSQL code and Delta Lake tables, and identify opportunities to optimize the sizing, performance and efficiency of existing processes.
•Develop ETL code, metadata definitions, data models, queries, scripts, schedules and maintenance procedures.
•Develop technical understanding of how data flows from various source systems and source types across the organization to fine tune data integration solutions.
•Articulate business requirements as a technical solution that can be designed and engineered, and consult with the business to develop documentation that ensures accurate usage and interpretation of JLL data.
•Work with batch and event-driven or streaming patterns (for example Kafka, Spark Streaming, Azure Event Hubs) under guidance, and handle structured and unstructured data in a data lake environment.
•Contribute to data management and data persistence solutions using relational and non-relational databases.
•Perform unit testing, system integration testing and regression testing, and assist with user acceptance testing.
•Use AI-assisted development tools (for example Cursor, Databricks Assistant, Claude) to improve productivity and code quality, while reviewing and validating generated output.
•Build small proofs of concept to validate approaches, and participate in Agile delivery with the wider data engineering team.
•Adhere to established standards and best practices and provide input for improvement of those processes.
•Work independently or as part of a team to deliver data warehouse ETL projects, with minimal supervision, adapting to a quickly changing environment.
•Maintain a high-volume data warehouse application.
•Ability to work on multiple tasks simultaneously, switch between tasks and work in conflicting priorities.
Experience & Education
•At least 1 to 3 years of relevant experience is desired.
•At least 1+ years of experience in Azure Databricks.
•Bachelor's/Master's degree in Computer Science or a related quantitative discipline from a reputed University.
•Strong in communications with business stakeholders: requires strong ability to communicate and manage stakeholders, and to drive collaboration between the business team and the various project teams including application support teams, database teams, and infrastructure teams across the regions.
•Excellent technical, analytical, and organizational skills.
•Effective written and verbal communication skills, including technical writing.
Technical Skills & Competencies
•Azure Databricks, ETL knowledge, SQL knowledge, Python, PySpark, SparkSQL, Azure functions, Delta Lake, Azure Data Factory, Azure DevOps CI/CD.
•Good to have knowledge on ADLS Gen2, Kafka stream processing, Spark Streaming, Azure Event Hubs.
•Good to have exposure to relational and non-relational databases (Azure SQL/MS SQL Server, Cosmos DB/MongoDB), including stored procedures, views and explain plans.
•Good to have knowledge of AI tools such as Cursor, Databricks Assistant and Claude.
•Good communication.
•Self-starter and willingness to learn other technology including Informatica and Go Anywhere.
•Good to have hands-on experience with Informatica PowerCenter / Informatica Cloud, Data Quality and Control-M to automate job runs, along with PowerShell / UNIX Shell scripting.
•Must have strong knowledge of Software Development Life Cycle including requirement analysis, design, development, testing, and implementation. Hands on experience in performance tuning of sources, targets, queries and pipelines.
Support
•Ability to identify critical system health issue and flag them for discussion and resolution.
•Constantly questioning due to fluid processes and complexity of environment.
•Familiarity with common support activities including access management, object and connection management, backing up repositories, code migration across multiple environments and performance diagnosis/improvement.
•Ability to support and co-ordinate Sev1 tickets with guidance from senior team members.
•Proven experience in following standards and helping others adopt standards.
•Making sure that code is in sync across all environments.
Location
On-site – Bengaluru, KA
Scheduled Weekly Hours: 40
