Talent.com
S.i. Systems
Team Lead, Data Engineering - Databricks to lead and mentor a team of data engineers, conductingS.i. Systems • Toronto
Team Lead, Data Engineering - Databricks to lead and mentor a team of data engineers, conducting

Team Lead, Data Engineering - Databricks to lead and mentor a team of data engineers, conducting

S.i. Systems • Toronto
30+ days ago
Job type
  • Full-time
  • Permanent
Job description

Permanent Full Time

Hybrid (3 days in the office)

Must Haves:

  • 8+ years of experience in data engineering
  • 3+ years of hands-on experience with Databricks platform
  • Proven experience leading a team
  • Strong expertise in Python and Spark programming
  • Demonstrable experience in using AI in development
  • Proven experience with AWS or other similar cloud services
  • Deep understanding of data modeling and SQL
  • Experience with Delta Lake and Lakehouse architecture
  • Strong knowledge of ETL/ELT principles and patterns
  • Experience with version control systems (Git)
  • Demonstrated ability to optimize data pipelines
  • Strong problem-solving and analytical skills
  • Excellent communication and collaboration abilities

Nice to Have:

  • Financial services industry experience
  • Experience with multiple cloud providers
  • Knowledge of AI/ML implementation patterns
  • API development experience
  • Experience with real-time data processing
  • Data governance framework experience

What Sets You Apart:

  • Active interest in emerging technologies and industry trends
  • Experience implementing complex data solutions
  • Track record of continuous learning and skill development
  • Strong technical documentation abilities
  • Experience using AI tools to enhance productivity
  • Ability to mentor junior team members

Technical Environment:

  • Primary Platform: Databricks
  • Cloud Platform: AWS (S3, Glue, Lambda)
  • Languages: Python, SQL
  • Tools: Delta Lake, Unity Catalog, Git
  • Additional: Real-time processing, API integrations

Responsibilities

Your Role:

  • You will lead and mentor a team of data engineers, conducting code reviews, design reviews, and knowledge-sharing sessions across multiple locations
  • Drive the Agile/Scrum SDLC process and collaborate with team members
  • Design and develop Databricks solutions leveraging Lakehouse architecture for enterprise data processing and analytics
  • Develop and optimize ETL/ELT pipelines
  • Create and manage structured streaming pipelines for real-time data processing
  • Configure and optimize Databricks clusters and Spark jobs for optimal performance
  • Utilize Delta Live Tables for data ingestion and transformations
  • Apply Unity Catalog features and IAM best practices for security governance and access control
  • Support infrastructure and resource management using Terraform
  • Implement monitoring solutions for pipeline performance and data quality
  • Contribute to code reviews and knowledge-sharing sessions

Salary Range: CAD $, - CAD $,



Create a job alert for this search

Team Lead, Data Engineering - Databricks to lead and mentor a team of data engineers, conducting code reviews, design reviews, and knowledge-sharing sessions across multiple locations • Toronto

Similar jobs

Data Engineering Lead — Cloud Pipelines & Leadership

Compunnel, Inc.Toronto, ON, CA
Full-time

A technology solutions provider is seeking a Data Engineering Lead to spearhead data engineering initiatives in Toronto, Ontario.The ideal candidate will design scalable data solutions utilizing bo... Show more

 • Promoted

Data Engineer

searchlabsmarkham, on, Canada
Full-time

This Data Engineer role is a one-year contract, working on a hybrid in-office/remote model in the GTA.The compensation range is $60-$100/hr.Build and maintain ETL pipelines for enterprise data inte... Show more

 • Promoted

Lead Engineering Manager For Data Architecture

LyftToronto, Canada
Full-time

Shape Lyft's Data Platform as the Engineering Manager for the Lakehouse Foundation team, focusing on data layer management.Lead in a collaborative hybrid work environment.In this leadership role, y... Show more

 • Promoted

Remote Data Team Lead & Architect: MongoDB to Redshift

Confidential CompanyToronto, ON, CA
Remote
Full-time

A growing technology firm in Toronto, Ontario is seeking a Lead Data Engineer to spearhead the migration of its data infrastructure from a monolithic to a microservices-based architecture.This is a... Show more

 • Promoted

TekRek Data Platform Engineering Lead

TekRekToronto, ON, CA
Full-time

Advance your career as a Data Platform Engineering Lead at TekRek, innovating the foundation for real-time analytics in high-volume IoT applications.Shape the future of a modern telematics API.This... Show more

 • Promoted

Senior Data Engineering Leader, Ai Platforms & Architecture

UnileverToronto, Canada
Full-time

A global consumer goods company based in Toronto is seeking a Senior Manager, Data Engineering to lead and manage their data and architecture platform.This leadership role collaborates closely with... Show more

 • Promoted

Azure Data Engineering & Bi Lead (Databricks) - C$82,544 - C$110,058 A Year

Non-Profit OrganizationToronto County, Canada
Full-time

Lead data engineering and BI systems in Azure for a non-profit, managing infrastructure, data warehousing, and compliance.Requires SQL, Python, project management. Show more

 • Promoted

Data Engineering Lead - $140,000 - $150,000 A Year

Fitch RatingsToronto, Canada
Full-time

Software Engineer, Associate Director role at Fitch Ratings, designing, building, and scaling data solutions, requiring 10+ years of experience and expertise in financial services, data governance,... Show more

 • Promoted

Data and Machine Learning Engineering Lead

Sanofi S.A.toronto, on, Canada
Full-time

At Sanofi, we’re committed to providing the next-gen healthcare that patients and customers need.It’s about harnessing data insights and leveraging AI responsibly to search deeper and solve sooner ... Show more

 • Promoted

Lead Engineering Manager for Data Architecture

Lyfttoronto, on, Canada
Full-time

Shape Lyft's Data Platform as the Engineering Manager for the Lakehouse Foundation team, focusing on data layer management.Lead in a collaborative hybrid work environment.In this leadership role, y... Show more

 • Promoted

Remote SaaS Data & AI Engineering Lead

Harvey NashToronto, ON, CA
Remote
Full-time

A leading technology consultancy is seeking a Data & AI Engineering Manager to lead teams in building scalable data and AI products in a SaaS environment.The role combines technical leadership and ... Show more

 • Promoted

Lead, Data Engineering

RBCToronto
Full-time

This is an opportunity within the Data & Analytics team at RBC Global Asset Management.We are seeking a hands-on, highly skilled and motivated individual to join our dynamic team as a Data Engineer... Show more

 • Promoted

Lyft Data Science Team Leader

Lyft, Inc.toronto, on, Canada
Full-time

Join Lyft as a Data Science Team Leader focused on P&L management.Enhance routing for millions by developing insightful analytics solutions.In this influential role, you’ll manage and mentor a dive... Show more

 • Promoted

AI and Data - Manager - Solution Architect/Tech Lead

EYToronto, Ontario, Canada
Full-time

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you.And we’re counting on your u... Show more

 • Promoted

Avison Young: Senior Role in Data Engineering

Avison YoungToronto, ON, CA
Full-time

Step into the role of Senior Analytics Engineer at Avison Young and shape data-driven decisions.In this on-site position, you will focus on analytics engineering and data modeling using Snowflake a... Show more

 • Promoted

Senior Data Engineering Leader, AI Platforms & Architecture

UnileverToronto, ON, CA
Full-time

A global consumer goods company based in Toronto is seeking a Senior Manager, Data Engineering to lead and manage their data and architecture platform.This leadership role collaborates closely with... Show more

 • Promoted

Lead Data Engineer Team Manager

Staples CanadaRichmond Hill, York Region, CA
Full-time

Take charge as Lead Manager for the Data Engineering team, fostering growth and innovation within data projects.We seek a dedicated professional focused on customer-centric solutions and team succe... Show more

 • Promoted

Team Lead, Data Engineering - Databricks

The Citco Group LimitedToronto
Full-time

Since the 1940s, Citco has provided specialist financial services to alternative investment funds, investors, multinationals, and private clients worldwide.Our data engineering initiatives represen... Show more

 • Promoted

Lead Tech Role in Snowflake & IICS

Intact Financial CorporationToronto, ON, CA
Full-time

Become a pivotal part of Intact Lab as a Tech Lead focused on Snowflake, IICS, and AWS.Enjoy a balanced hybrid work model while influencing transformative data projects.As a Tech Lead at Intact Lab... Show more

 • Promoted

Data Engineering And Bi Lead - $82,544 - $110,058 A Year

Ontario Trillium FoundationNorth York, Canada
Full-time

Manages and optimizes business intelligence systems infrastructure in Microsoft Azure, focusing on data engineering and distributed systems.Oversees ETL, data pipelines, and CI/CD processes. Show more