Talent.com
PeoplePilot
Databricks EngineerPeoplePilot • Toronto, ON, Canada
Databricks Engineer

Databricks Engineer

PeoplePilot • Toronto, ON, Canada
22 days ago
Job type
  • Full-time
Job description

Key Requirements

  • 12–18 years of overall data engineering experience
  • 8+ years of experience in enterprise Data Warehouse and Data Lake platforms
  • 5+ years of hands‑on experience with Databricks and Spark at scale
  • Strong experience in modernizing legacy Cloudera platforms (CDH/CDP, Hive, HBase, Impala, Spark) to Databricks Lakehouse
  • Redesign ingestion, transformation, and consumption patterns from HDFS‑based architecture to cloud object storage and Delta Lake
  • Refactor legacy Hive/Impala logic into PySpark and Spark SQL ELT pipelines
  • Ensure data reconciliation, audit integrity, and consistency during migration
  • Design and govern enterprise Data Warehouse and Data Lake/Lakehouse architectures
  • Implement layered architecture including Raw/Landing, Curated/Conformed, and Semantic/Consumption layers
  • Modernize traditional EDW platforms into scalable lakehouse architectures
  • Strong experience in finance and risk data models including General Ledger, Sub‑ledger, financial hierarchies, and risk exposure models (credit, liquidity, market risk)
  • Enable reporting use cases including aggregation, drill‑down, and drill‑back capabilities
  • Build and manage semantic/consumption layers for BI, reporting, and analytics
  • Define business metrics, dimensions, hierarchies, and KPIs
  • Experience with Databricks SQL, Delta tables, and dbt or similar frameworks
  • Develop and optimize large‑scale data pipelines using PySpark, Spark SQL, and Delta Lake
  • Implement Medallion architecture (Bronze, Silver, Gold layers)
  • Optimize workloads using Z‑ORDER, OPTIMIZE, caching, and cluster configurations
  • Implement data governance, data quality frameworks, reconciliation controls, and exception handling
  • Establish data lineage and metadata management
  • Ensure data security, access control, and compliance standards
  • Experience with cloud platforms such as AWS or Azure
  • Experience with CI/CD pipelines using Git, Terraform, Jenkins, or Azure DevOps
  • Familiarity with orchestration tools such as Airflow or Databricks Workflows
  • Experience with dbt is a plus
  • Act as a technical authority and lead architecture decisions
  • Mentor and guide senior engineers and establish engineering standards
  • Strong stakeholder management with finance, risk, analytics, and governance teams
  • Ability to translate complex data structures into business‑ready insights

Nice to Have

  • Experience in BFSI, Capital Markets, or regulatory reporting
  • Exposure to SAP Finance, Oracle Financials, or S/4HANA
  • Experience supporting AI/ML workloads
  • Databricks or cloud certifications

Impact

  • Lead Cloudera to Databricks transformation initiatives
  • Shape enterprise finance and risk data platforms
  • Support regulatory, management, and analytical reporting systems
#J-18808-Ljbffr
Create a job alert for this search

Databricks Engineer • Toronto, ON, Canada

Similar jobs

Databricks Senior Engineer - $84,000 - $130,000 A Year

SlalomToronto County, Canada
Full-time

Seeking a Databricks Senior Engineer to lead technical teams, design and implement data solutions using Databricks platform features, and contribute to innovative data strategies. Show more

 • Promoted

Data Engineer

searchlabsmarkham, on, Canada
Full-time

This Data Engineer role is a one-year contract, working on a hybrid in-office/remote model in the GTA.The compensation range is $60-$100/hr.Build and maintain ETL pipelines for enterprise data inte... Show more

 • Promoted

Data Engineer - Snowflake, dbtCore/Cloud, AWS

Aviva CanadaMarkham, ON, CA
Full-time

Individually we are people, but together we are Aviva.Individually these are just words, but together they are our Values – Care, Commitment, Community, and Confidence.At Aviva Canada, we put peopl... Show more

 • Promoted

Databricks Engineer

PeoplePilotToronto, ON, CA
Full-time

Data Warehouse and Data Lake platforms.Strong experience in modernizing legacy Cloudera platforms (CDH/CDP, Hive, HBase, Impala, Spark) to Databricks Lakehouse.Redesign ingestion, transformation, a... Show more

 • Promoted

Sr Databricks Engineer - C$130,000 - C$135,000 A Year

SynechronToronto County, Canada
Full-time

Seeking a skilled Azure Data Engineer with Databricks expertise to design, implement, and optimize data pipelines.Responsibilities include ETL/ELT, data transformation, integration, and deployment ... Show more

 • Promoted

AWS Databrciks Engineer

AkkodisToronto, ON, CA
Full-time

Toronto, ON Hybrid (3 days Onsite- Tue, Wed, Thursday).Citizens or PR only considered for the TCS role, sorry, OWP won't work.Design, develop, and maintain scalable and robust data pipelines on Dat... Show more

 • Promoted

Senior Databricks Data Engineer — Lakehouse & Ai Pipelines - C$120,000 - C$150,000 A Year

The Citco Group LimitedEast York, Canada
Full-time

Senior Data Engineer sought to design and optimize data pipelines on Databricks Lakehouse Platform. Show more

 • Promoted • New!

Senior Databricks Data Engineer — Lakehouse & Ai Pipelines - C$120,000 - C$150,000 A Year

Financial Services ProviderNorth York, Canada
Full-time

Data Engineer needed in Toronto to design and optimize data pipelines on Databricks Lakehouse Platform using Python, Spark, and AWS for a financial services provider. Show more

 • Promoted

Azure DevOps Engineer

Swoonmarkham, york region, Canada
Full-time

This range is provided by Swoon.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Direct message the job poster from Swoon.Technical Recruiter @ S... Show more

 • Promoted

Senior Data Engineer ( Databricks/Snowflake)

TEEMA Solutions GroupToronto, ON, CA
Full-time

Toronto (3 days downtown/Hybrid).Our client is interviewing to onboard a Senior Data Engineers to join their Data & Analytics team within the Wealth Technology group.We are looking for Data Enginee... Show more

 • Promoted

Snowflake Data Engineer

Tech Mahindramarkham, on, Canada
Full-time

A Bachelor’s or Higher Degree is the minimum entry required for the position.Model: Hybrid (3 Days Onsite (Mon/ Tues/ Wed)).We are seeking a highly skilled Snowflake Data Engineer with extensive ex... Show more

 • Promoted

Data Engineer: PySpark, Databricks & Tableau

Highbrow LLCToronto, ON, CA
Temporary

A leading data engineering firm in Toronto is seeking a Data Engineer with 2-5 years of experience in technologies such as PySpark, SQL, and Databricks.The role involves working in the Data Science... Show more

 • Promoted

Databricks Senior Solutions Engineer Role

DatabricksToronto, Canada
Full-time

Empower enterprises in Toronto as a Senior Solutions Engineer with Databricks.Partner with the Enterprise Account Executive to refine technical strategies and deepen utilization of ML & AI solu... Show more

 • Promoted

SoC Data Path Engineer

Advanced Micro Devicesmarkham, on, Canada
Full-time

At AMD, we believe technology can change lives for the better.It can heal us, entertain us, and make us more connected, productive, and understanding of the world around us.And we’re looking for ta... Show more

 • Promoted

Databricks Architect

TechDoQuestToronto, ON, CA
Full-time

Design and architect enterprise-scale data platforms using.Lead data modernization initiatives including migration from legacy data warehouses to cloud-based platforms.Apache Spark, Delta Lake, and... Show more

 • Promoted

Data Accelerator - RTL Design Engineer – Lead

AMDmarkham, york region, Canada
Full-time

The Data Accelerator (DACC) team at AMD seeks a Silicon Design Engineer to lead a front‑end IP design team.This role focuses on custom hardware accelerators for servers, data centers, and embedded ... Show more

 • Promoted

Databricks Senior Engineer: Data-Driven Insights

WinsAboveToronto, ON, CA
Full-time

Accelerate data-driven transformation as a Senior Solutions Engineer at Databricks in Toronto, ON.Utilize your expertise in ML and AI to provide strategic guidance to large enterprises.In this infl... Show more

 • Promoted

Staff Data Engineer

Loblaw Digitaltoronto, on, Canada
Permanent

Architecture & Technical Leadership.Lead system‑level design for scalable, reliable, and high‑performance data platforms supporting batch, streaming, and real‑time use cases.Drive architectural imp... Show more

 • Promoted

Data Engineer

Adastra Corporationmarkham, on, Canada
Full-time

Adastra is seeking a Senior Data Engineer to design, build, and optimize scalable data pipelines and cloud-based data platforms that support advanced analytics, reporting, and AI initiatives.This r... Show more

 • Promoted

Senior Data Engineer — Databricks on AWS (Remote)

LumenaltaToronto, ON, CA
Remote
Full-time

A leading data solutions company is seeking a Senior Data Engineer to join their fully remote team.In this role, you will design and build scalable ETL/ELT pipelines using Databricks on AWS, ensuri... Show more