Talent.com
VDart Inc
Senior Data EngineerVDart Inc • Toronto, ON, Canada
Senior Data Engineer

Senior Data Engineer

VDart Inc • Toronto, ON, Canada
18 hours ago
Job type
  • Full-time
  • Quick Apply
Job description

Title: Senior Data Engineer

Mode: Fulltime

Location: Toronto, ON

Senior Data Engineer (Databricks)

Design, develop, and maintain scalable ETL/ELT pipelines for structured and unstructured data.

Build and optimize data solutions using Databricks, PySpark, and Spark SQL.

Implement data ingestion frameworks from various source systems including databases, APIs, files, and streaming platforms.

Develop and maintain data lakehouse architectures leveraging Databricks best practices.

Design and implement Medallion Architecture (Bronze, Silver, Gold layers) for enterprise data platforms.

Collaborate with business stakeholders, data scientists, architects, and application teams to understand data requirements.

Optimize Spark jobs and data pipelines for performance, scalability, and cost efficiency.

Implement data quality, governance, security, and monitoring frameworks.

Support AI/ML initiatives by preparing and engineering datasets for model development and deployment.

Develop CI/CD pipelines and automate deployment processes for data engineering workloads.

Participate in architecture reviews and establish data engineering standards and best practices.

Mentor junior engineers and provide technical leadership across projects.

Required Qualifications

Bachelor's or Master's degree in Computer Science, Information Technology, Data Science, or related field.

8+ years of experience in Data Engineering and Data Platform development.

Strong hands-on experience with Databricks and Apache Spark.

Proficiency in Python, PySpark, and SQL.

Experience with cloud platforms such as:

o Microsoft Azure (preferred)

o AWS

o Google Cloud Platform

Experience with Delta Lake, Unity Catalog, and Databricks workflows.

Strong understanding of Data Lake, Data Warehouse, and Lakehouse architectures.

Experience working with large-scale distributed data processing systems.

Knowledge of data modeling, partitioning, indexing, and query optimization techniques.

Experience with Git, CI/CD pipelines, and DevOps practices.

Preferred Qualifications

Databricks Certified Data Engineer Associate or Professional Certification.

Experience with Azure Data Factory, Synapse Analytics, or equivalent cloud-native services.

Experience with streaming technologies such as Kafka, Event Hubs, or Spark Streaming.

Exposure to AI/ML platforms, MLOps, and Generative AI solutions.

Experience working in Insurance, Financial Services, or Enterprise Digital Transformation programs.

Technical Skills

Category Skills

Data Engineering Databricks, Apache Spark, PySpark, Spark SQL

Programming Python, SQL, Scala (Preferred)

Cloud Azure, AWS, GCP

Data Platforms Delta Lake, Unity Catalog, Data Lakehouse

ETL/ELT Azure Data Factory, Databricks Workflows, Airflow

DevOps Git, Azure DevOps, Jenkins, CI/CD

Streaming Kafka, Spark Streaming, Event Hubs

Databases SQL Server, PostgreSQL, Oracle, Snowflake

Create a job alert for this search

Senior Data Engineer • Toronto, ON, Canada

Similar jobs

Senior Data Engineer - $110,000 - $135,000 A Year

Terawatt InfrastructureToronto County, Canada
Full-time

Seeking a Senior Data Engineer to design and implement scalable data architectures, optimize data pipelines, and build/maintain data models and lakes.Role focuses on transforming raw data into ML-r... Show more

 • Promoted

Senior Data Engineer: Build and Scale Innovative Data Solutions

LumenaltaToronto, ON, CA
Full-time

Embrace an exciting opportunity as a remote Senior Data Engineer.Lead the charge in building scalable data solutions, utilizing Databricks on AWS for impactful results.This mid-senior level positio... Show more

 • Promoted

Senior Data Engineer: Snowflake, DBT & Glue Pro (Contract)

Compunnel Inc.Markham, York Region, CA
Full-time

A leading IT Services and Consulting firm is seeking a Senior Data Engineer in Markham, Ontario.Candidates should have over 8 years of data engineering experience and proficiency in technologies su... Show more

 • Promoted

Senior Databricks Data Engineer — Lakehouse & Ai Pipelines - C$120,000 - C$150,000 A Year

Financial Services ProviderNorth York, Canada
Full-time

Data Engineer needed in Toronto to design and optimize data pipelines on Databricks Lakehouse Platform using Python, Spark, and AWS for a financial services provider. Show more

 • Promoted

Senior Data Engineer

Aarorn Technologies IncToronto, ON, CA
Full-time

Senior Data Engineer – Contract – Toronto, ON (3x onsite a week).Provide technical expertise in designing, coding, and documenting ETL processes for new initiatives.Independently support existing a... Show more

 • Promoted

Senior Data Engineer

TechedinToronto, ON, CA
Full-time

Hybrid (2 days remote), Toronto, Canada.We are hiring for the Senior Data Engineer role, where the selected candidate will work on scalable data pipelines and analytics solutions.This position focu... Show more

 • Promoted

Senior Data Engineer I - QuantumBlack, AI by McKinsey

QuantumBlack, AI by McKinseyToronto, ON, CA
Full-time

Driving lasting impact and building long-term capabilities with our clients is not easy work.You are the kind of person who thrives in a high performance/high reward culture - doing hard things, pi... Show more

 • Promoted

Senior Data Engineer, Integrations - C$146,200 - C$197,800 A Year

ClioToronto County, Canada
Full-time

Senior Data Engineer sought to build data pipelines, data warehouses, and make datasets accessible, using AWS technologies and big data tools. Show more

 • Promoted

Senior Data Engineer: Pyspark, Delta Lake & Azure Lakehouse - C$95,000 - C$145,000 A Year

Global Technology Service ProviderEast York, Canada
Full-time

Seeking a Senior Data Engineer to lead ETL/ELT pipeline development using PySpark, Delta Lake, and Azure Lakehouse.Role offers a hybrid work model. Show more

 • Promoted

Senior Data Engineer, Blockchain

CircleToronto, ON, CA
Full-time

Circle is committed to visibility and stability in everything we do.As we grow as an organization, we're expanding into some of the world's strongest jurisdictions.Speed and efficiency are motivato... Show more

 • Promoted

Senior Data Engineer

Canadian Tire CorporationToronto, ON, CA
Full-time

Canadian Tire Corporation is seeking an experienced.CTC Triangle Program — Loyalty Data Product Engineering team in Toronto, ON, reporting to the Engineering Manager.This team designs, develops, an... Show more

 • Promoted

Senior AI Data Engineer

Veeva SystemsToronto, ON, CA
Full-time

Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster.As one of the fastest-growing SaaS companies in hist... Show more

 • Promoted

Senior Data Engineer - Data Governance & Platform Lead - C$120,000 - C$170,000 A Year

Global Commerce CompanyToronto, Canada
Full-time

Leading the development and optimization of a user platform and recommendation engine, focusing on data accuracy and performance across various systems.Requires strong SQL and Python skills. Show more

 • Promoted

Senior Data Engineer

TechDoQuestToronto, ON, CA
Full-time

Lead data analysis, profiling, discovery, and migration assessment activities.Perform source to target mapping for BigQuery datasets, pipelines, and reporting assets.Analyze Airflow/Composer workfl... Show more

 • Promoted

Senior Data Engineer

Sonata SoftwareToronto, ON, CA
Full-time

Billion Revenue, is a leading AI-first Modernization Engineering company, powered by our unique PlatformationTM framework.Our 6400+ AI Engineers are helping enterprises transform from systems to in... Show more

 • Promoted

Senior AWS Databricks Data Engineer - Hybrid Toronto

AkkodisToronto, ON, CA
Full-time

A leading IT consultancy is seeking a Mid-Senior Level Data Engineer for a contract role in Toronto.Candidates will design, develop, and maintain scalable data pipelines, ensuring data quality and ... Show more

 • Promoted

Senior Data Engineer - C$85,000 - C$125,000 A Year

MozillaEast York, Canada
Full-time

Seeking a Senior Data Engineer to manage data lifecycle, build pipelines, transform data, and ensure data quality and integrity for data-informed decisions. Show more

 • Promoted

Senior Data & Analytics Engineer

WagepointToronto, ON, CA
Full-time

Senior Data & Analytics Engineer.This range is provided by Wagepoint.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.At Wagepoint, we’re good pe... Show more

 • Promoted

Senior Data Engineer - $90,000 - $140,000 A Year

VanguardEast York, Canada
Full-time

Senior Data Engineer to build data pipelines and enhance data foundations using AWS, Databricks, and modern data architecture. Show more

 • Promoted

Senior Data Engineer - $123,833 - $170,184 A Year

City of TorontoEast York, Canada
Full-time

Seeking a Senior Data Engineer to design, develop, and implement data solutions using AWS technologies and Python.Responsibilities include building data pipelines, data modeling, and supporting the... Show more