Description
The Surveillance Enhancement Program is a multi-year initiative to develop and improve a surveillance platform that identifies potential market misconduct, manipulation, and abuse. The project enhances alerts, data sourcing, user interfaces, workflows, and monitoring capabilities to meet regulatory obligations, including the Market Abuse Regulation and Dodd-Frank.
Responsibilities
•Develop software applications based on business requirements
•Maintain and enhance software applications according to project specifications
•Participate in requirements analysis, design, development, testing, and implementation
•Propose new software development techniques and technologies
•Perform unit and user acceptance testing to evaluate application functionality
•Complete assigned development tasks within deadlines
•Follow coding standards and best practices
•Assist Junior Developers when needed
•Review code and recommend improvements
•Review business requirements and recommend changes to develop reliable applications
•Develop coding documentation and technical specifications for assigned projects
•Act as the primary contact for development queries and concerns
•Analyze and resolve development issues
Requirements
•10+ years of experience in data-intensive PySpark development, window functions, performance optimization, Spark architecture, salting, and column pruning
•Experience leading a development team
•Proven experience as a Core Python developer
•Good understanding of Gen AI
•Experience with classes, OOP, exception handling, and parallel processing
•Strong knowledge of database connectivity, data loading, transformation, and calculation
•Extensive experience with Pandas/NumPy dataframes, slicing, data wrangling, and aggregations
•Knowledge of lambda functions, decorators, vector operations on Pandas dataframes/series, and apply/map functions
•Experience with concurrency and error handling in data pipeline batches of 1–10 GB
•Ability to translate business requirements into technical requirements
•Ability to design data pipeline architecture for concurrent data processing
•Experience with Git source control and service-oriented architecture, including integrations with other applications and services
•Experience debugging applications
•English at C1 Advanced level
Nice to have
•Web backend technology, Django, Python, PostgreSQL, Apache Airflow
Conditions
No conditions are specified in the posting.
