Talent.com
The Citco Group Limited
Team Lead, Data Engineering - DatabricksThe Citco Group Limited • Toronto, ON, Canada
Team Lead, Data Engineering - Databricks

Team Lead, Data Engineering - Databricks

The Citco Group Limited • Toronto, ON, Canada
30+ days ago
Salary
CA$135,000.00 yearly
Job type
  • Full-time
Job description

About Citco

Since the 1940s, Citco has provided specialist financial services to alternative investment funds, investors, multinationals, and private clients worldwide. Our data engineering initiatives represent one of our most critical technical focus areas, driving innovation across our global operations.

Job Description

As a Team Lead, you will lead a technical team of data engineers, ensuring best practices in performance, security, and scalability while working on Citco's enterprise‑wide Centralized Data Platform (CDP) built on Databricks.

This role requires a deep, hands‑on understanding of Databricks internals and a track record of delivering large‑scale data platforms in a cloud environment.

You will be part of a team driving technical excellence and innovation within Citco's data engineering practice.

Responsibilities

  • Lead and mentor a team of data engineers, conducting code reviews, design reviews, and knowledge‑sharing sessions across multiple locations.
  • Drive the Agile/Scrum SDLC process and collaborate with team members.
  • Design and develop Databricks solutions leveraging Lakehouse architecture for enterprise data processing and analytics.
  • Develop and optimize ETL/ELT pipelines.
  • Create and manage structured streaming pipelines for real‑time data processing.
  • Configure and optimize Databricks clusters and Spark jobs for optimal performance.
  • Utilize Delta Live Tables for data ingestion and transformations.
  • Apply Unity Catalog features and IAM best practices for security governance and access control.
  • Support infrastructure and resource management using Terraform.
  • Implement monitoring solutions for pipeline performance and data quality.
  • Contribute to code reviews and knowledge‑sharing sessions.

Required Qualifications

  • 8+ years of experience in data engineering.
  • 3+ years of hands‑on experience with Databricks platform.
  • Proven experience leading a team.
  • Strong expertise in Python and Spark programming.
  • Demonstrable experience using AI in development.
  • Proven experience with AWS or other similar cloud services.
  • Deep understanding of data modeling and SQL.
  • Experience with Delta Lake and Lakehouse architecture.
  • Strong knowledge of ETL/ELT principles and patterns.
  • Experience with version control systems (Git).
  • Demonstrated ability to optimize data pipelines.
  • Strong problem‑solving and analytical skills.
  • Excellent communication and collaboration abilities.

Nice to Have

  • Financial services industry experience.
  • Experience with multiple cloud providers.
  • Knowledge of AI/ML implementation patterns.
  • API development experience.
  • Experience with real‑time data processing.
  • Data governance framework experience.

What Sets You Apart

  • Active interest in emerging technologies and industry trends.
  • Experience implementing complex data solutions.
  • Track record of continuous learning and skill development.
  • Strong technical documentation abilities.
  • Experience using AI tools to enhance productivity.
  • Ability to mentor junior team members.

Technical Environment

  • Primary Platform: Databricks
  • Cloud Platform: AWS (S3, Glue, Lambda)
  • Languages: Python, SQL
  • Tools: Delta Lake, Unity Catalog, Git
  • Additional: Real‑time processing, API integrations.

Salary Range

CAD $135,000 - CAD $175,000

Our Benefits

Your well‑being is of paramount importance to us, and central to our success. We provide a range of benefits, training and education support, and flexible working arrangements to help you achieve success in your career while balancing personal needs. Ask us about specific benefits in your location.

We embrace diversity, prioritizing the hiring of people from diverse backgrounds. Our inclusive culture is a source of pride and strength, fostering innovation and mutual respect.

Citco welcomes and encourages applications from people with disabilities. Accommodation is available upon request for candidates taking part in all aspects of the selection.

#J-18808-Ljbffr

Create a job alert for this search

Team Lead, Data Engineering - Databricks • Toronto, ON, Canada

Similar jobs

Data Engineering Lead — Cloud Pipelines & Leadership

Compunnel, Inc.Toronto, ON, CA
Full-time

A technology solutions provider is seeking a Data Engineering Lead to spearhead data engineering initiatives in Toronto, Ontario.The ideal candidate will design scalable data solutions utilizing bo... Show more

 • Promoted

Data Engineer

searchlabsmarkham, on, Canada
Full-time

This Data Engineer role is a one-year contract, working on a hybrid in-office/remote model in the GTA.The compensation range is $60-$100/hr.Build and maintain ETL pipelines for enterprise data inte... Show more

 • Promoted

Experienced Data Engineer - Hybrid Model

searchlabsmarkham, on, Canada
Full-time

Take on a one-year contract as a Data Engineer with a hybrid work model in the Greater Toronto Area, focusing on data integration and pipeline management.Your advanced technical skills are crucial.... Show more

 • Promoted

Senior Databricks Architect — Lead Cloud Data Platform

Data ElephantToronto, ON, CA
Full-time

A leading data consulting firm in Canada is seeking a Senior Databricks Architect to guide clients through their data modernization journeys.In this senior technical leadership role, you will be re... Show more

 • Promoted

Lead Azure Data Architect(15+ Years Required)

QData IncToronto, ON, CA
Full-time

Senior Azure Databricks Architect.Python skills and a passion for building scalable data solutions in the cloud? Join our team to lead architecture, optimize pipelines, and drive innovation across ... Show more

 • Promoted

Senior Databricks Data Architect: Lakehouse Leader

Rubicon PathToronto, ON, CA
Full-time

A financial services company in Toronto is seeking a senior Databricks Data Architect to lead a team of data engineers.The role involves building and optimizing a robust data platform, ensuring sec... Show more

 • Promoted

Data Lake Delivery Lead

Cpus Engineering Staffing Solutions Inc.Old Toronto, ON, CA
Full-time

We are currently requesting resumes for the following position.Toronto Corporate Headquarters.Lead and manage multiple projects simultaneously, ensuring timely completion, quality and budget adhere... Show more

 • Promoted

Senior Data Engineering Leader, Ai Platforms & Architecture

UnileverToronto, Canada
Full-time

A global consumer goods company based in Toronto is seeking a Senior Manager, Data Engineering to lead and manage their data and architecture platform.This leadership role collaborates closely with... Show more

 • Promoted

Remote Data Team Lead & Architect: MongoDB to Redshift

Confidential Companytoronto, on, Canada
Remote
Full-time

A growing technology firm in Toronto, Ontario is seeking a Lead Data Engineer to spearhead the migration of its data infrastructure from a monolithic to a microservices-based architecture.This is a... Show more

 • Promoted

Lead Engineering Manager for Data Architecture

Lyfttoronto, on, Canada
Full-time

Shape Lyft's Data Platform as the Engineering Manager for the Lakehouse Foundation team, focusing on data layer management.Lead in a collaborative hybrid work environment.In this leadership role, y... Show more

 • Promoted

TekRek Data Platform Engineering Lead

TekRekToronto
Full-time

Advance your career as a Data Platform Engineering Lead at TekRek, innovating the foundation for real-time analytics in high-volume IoT applications.Shape the future of a modern telematics API.This... Show more

 • Promoted

Lead, Data Engineering

RBCToronto, Ontario, Canada
Full-time

This is an opportunity within the Data & Analytics team at RBC Global Asset Management.We are seeking a hands-on, highly skilled and motivated individual to join our dynamic team as a Data Engineer... Show more

 • Promoted

Azure Data Engineering & Bi Lead (Databricks) - C$82,544 - C$110,058 A Year

Anishinabek Employment & Training ServicesToronto County, Canada
Full-time

Manage and optimize BI systems in Azure, develop data warehousing solutions, and ensure data privacy and compliance. Show more

 • Promoted

Senior Data Engineering Leader, AI Platforms & Architecture

UnileverToronto, ON, CA
Full-time

A global consumer goods company based in Toronto is seeking a Senior Manager, Data Engineering to lead and manage their data and architecture platform.This leadership role collaborates closely with... Show more

 • Promoted

Team Lead, Data Engineering - Databricks

The Citco Group LimitedToronto
Full-time

Since the 1940s, Citco has provided specialist financial services to alternative investment funds, investors, multinationals, and private clients worldwide.Our data engineering initiatives represen... Show more

 • Promoted

Lead Tech Role in Snowflake & IICS

Intact Financial CorporationToronto, ON, CA
Full-time

Become a pivotal part of Intact Lab as a Tech Lead focused on Snowflake, IICS, and AWS.Enjoy a balanced hybrid work model while influencing transformative data projects.As a Tech Lead at Intact Lab... Show more

 • Promoted

Lead Data Engineer Team Manager

Staples CanadaRichmond Hill, York Region, CA
Full-time

Take charge as Lead Manager for the Data Engineering team, fostering growth and innovation within data projects.We seek a dedicated professional focused on customer-centric solutions and team succe... Show more

 • Promoted

Data Engineering And Bi Lead - $82,544 - $110,058 A Year

Ontario Trillium FoundationNorth York, Canada
Full-time

Lead the optimization and management of Ontario Trillium Foundation's business intelligence systems, focusing on data engineering, distributed systems, and infrastructure within Microsoft Azure. Show more

 • Promoted

Technical Team Lead

Gala SolutionsToronto, Ontario, Canada
Full-time

Recruitment Manager at Gala Solutions Inc Job Description :.As an active member, you will be in the heart of a major transformation program supporting it as a Technical Leader.The Technical Leader ... Show more

 • Promoted

Lead Rail Systems Integration Expert

WSP in Canadamarkham, on, Canada
Full-time

Shape the future of transit systems as a Lead Rail Systems Integration Expert.Join a vital project to integrate urban rail systems with operational infrastructure.In this senior role, you will spea... Show more