Lead Data Engineer

Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether you're in the early stages of your career, looking for a new direction, or wanting to continue in a position of leadership.Joining the world’s largest Capital Markets dedicated consultancy, you will have the opportunity to gain exposure to a range of mission-critical projects, tech stacks, clients and a company that prides itself on career development, variety, and flexibility.Senior / Lead Data Engineer Capital Markets Risk – Data pipelines orchestrationWe are seeking an exceptional Senior / Lead Data Engineer to join our FD Data team. The ideal candidate will be a seasoned data engineer / lead with extensive experience in designing, developing, and optimizing data pipelines and infrastructure in the capital markets risk domain.Essential Requirements : Experience in risk analytics, including market risk or credit risk.Familiarity with risk technology and calculations, including VaR, Stress Testing, Sensitivities, and P&L Vectors.Strong software development skills in Python or another common programming language (e.g., Java or Scala), with a focus on best practices : low-level design documentation, clean and well-documented code, and thorough testing.Expertise in Apache Airflow, with demonstrated experience designing, implementing, and managing workflows, DAGs, and tasks. A deep understanding of Airflow's architecture, best practices, and troubleshooting capabilities is mandatory.Proficiency in deploying and managing Cloud Database Services, with a preference for Snowflake.Advanced skills in SQL and Python for data manipulation and analysis.Experience implementing cloud-based solutions using modern cloud technologies (preferably AWS).Familiarity with modern SDLC tooling, including Git, Bamboo, Jira, or similar.Proven ability to implement and enforce data quality standards and practices.Preferred Qualifications (Nice to Have) : Good base of derivatives knowledge, pricing, risk management of structured products, options and more exotic derivatives.Knowledge of additional data processing libraries and tools to enhance data engineering workflows.Expertise in real-time data processing frameworks such as Apache Flink or Kafka Streams.Experience building event-driven and / or streaming data services.Soft Skills : Strong analytical and problem-solving skills, with the ability to troubleshoot and resolve complex data-related issues effectively.Excellent communication skills, with the ability to collaborate and share knowledge within a team environment.Proactive, self-starter attitude with an entrepreneurial approach.Ability to escalate and follow up on issues promptly and efficiently.FD provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.Candidate personal data will be processed in line with our Global Candidate Privacy Notice available on our website.