Talent.com
VDart Inc
Senior Data EngineerVDart Inc • Toronto, ON, Canada
Senior Data Engineer

Senior Data Engineer

VDart Inc • Toronto, ON, Canada
Il y a 1 jour
Type de contrat
  • Temps plein
  • Quick Apply
Description de poste

Title: Senior Data Engineer

Mode: Fulltime

Location: Toronto, ON

Senior Data Engineer (Databricks)

Design, develop, and maintain scalable ETL/ELT pipelines for structured and unstructured data.

Build and optimize data solutions using Databricks, PySpark, and Spark SQL.

Implement data ingestion frameworks from various source systems including databases, APIs, files, and streaming platforms.

Develop and maintain data lakehouse architectures leveraging Databricks best practices.

Design and implement Medallion Architecture (Bronze, Silver, Gold layers) for enterprise data platforms.

Collaborate with business stakeholders, data scientists, architects, and application teams to understand data requirements.

Optimize Spark jobs and data pipelines for performance, scalability, and cost efficiency.

Implement data quality, governance, security, and monitoring frameworks.

Support AI/ML initiatives by preparing and engineering datasets for model development and deployment.

Develop CI/CD pipelines and automate deployment processes for data engineering workloads.

Participate in architecture reviews and establish data engineering standards and best practices.

Mentor junior engineers and provide technical leadership across projects.

Required Qualifications

Bachelor's or Master's degree in Computer Science, Information Technology, Data Science, or related field.

8+ years of experience in Data Engineering and Data Platform development.

Strong hands-on experience with Databricks and Apache Spark.

Proficiency in Python, PySpark, and SQL.

Experience with cloud platforms such as:

o Microsoft Azure (preferred)

o AWS

o Google Cloud Platform

Experience with Delta Lake, Unity Catalog, and Databricks workflows.

Strong understanding of Data Lake, Data Warehouse, and Lakehouse architectures.

Experience working with large-scale distributed data processing systems.

Knowledge of data modeling, partitioning, indexing, and query optimization techniques.

Experience with Git, CI/CD pipelines, and DevOps practices.

Preferred Qualifications

Databricks Certified Data Engineer Associate or Professional Certification.

Experience with Azure Data Factory, Synapse Analytics, or equivalent cloud-native services.

Experience with streaming technologies such as Kafka, Event Hubs, or Spark Streaming.

Exposure to AI/ML platforms, MLOps, and Generative AI solutions.

Experience working in Insurance, Financial Services, or Enterprise Digital Transformation programs.

Technical Skills

Category Skills

Data Engineering Databricks, Apache Spark, PySpark, Spark SQL

Programming Python, SQL, Scala (Preferred)

Cloud Azure, AWS, GCP

Data Platforms Delta Lake, Unity Catalog, Data Lakehouse

ETL/ELT Azure Data Factory, Databricks Workflows, Airflow

DevOps Git, Azure DevOps, Jenkins, CI/CD

Streaming Kafka, Spark Streaming, Event Hubs

Databases SQL Server, PostgreSQL, Oracle, Snowflake

Créer une alerte emploi pour cette recherche

Senior Data Engineer • Toronto, ON, Canada

Offres similaires

Senior Data Engineer

Canadian Tire CorporationToronto
Temps plein

Canadian Tire Corporation is seeking an experienced.CTC Triangle Program — Loyalty Data Product Engineering team in Toronto, ON, reporting to the Engineering Manager.This team designs, develops, an... Voir plus

 • Offre sponsorisée

Senior AWS Databricks Data Engineer - Hybrid Toronto

AkkodisToronto
Temps plein

A leading IT consultancy is seeking a Mid-Senior Level Data Engineer for a contract role in Toronto.Candidates will design, develop, and maintain scalable data pipelines, ensuring data quality and ... Voir plus

 • Offre sponsorisée

Senior Data Engineer - $90,000 - $140,000 A Year

VanguardNorth York, Canada
Temps plein

Senior Data Engineer to build data pipelines and enhance data foundations using AWS, Databricks, and modern data architecture. Voir plus

 • Offre sponsorisée

Senior Data Engineer - $123,833 - $170,184 A Year

City of TorontoToronto County, Canada
Temps plein

Seeking a Senior Data Engineer to design, develop, and implement data solutions using AWS technologies and Python.Responsibilities include building data pipelines, data modeling, and supporting the... Voir plus

 • Offre sponsorisée

Senior Data Engineer - Data Governance & Platform Lead - C$120,000 - C$170,000 A Year

Global Commerce CompanyEast York, Canada
Temps plein

Leading the development and optimization of a user platform and recommendation engine, focusing on data accuracy and performance across various systems.Requires strong SQL and Python skills. Voir plus

 • Offre sponsorisée

Senior Data Engineer - $110,000 - $135,000 A Year

Terawatt InfrastructureToronto County, Canada
Temps plein

Seeking a Senior Data Engineer to design and implement scalable data architectures, optimize data pipelines, and build/maintain data models and lakes.Role focuses on transforming raw data into ML-r... Voir plus

 • Offre sponsorisée

Senior Data Engineer: Build and Scale Innovative Data Solutions

LumenaltaToronto, ON, CA
Temps plein

Embrace an exciting opportunity as a remote Senior Data Engineer.Lead the charge in building scalable data solutions, utilizing Databricks on AWS for impactful results.This mid-senior level positio... Voir plus

 • Offre sponsorisée

Senior Data Engineer: Pyspark, Delta Lake & Azure Lakehouse - C$95,000 - C$145,000 A Year

Global Technology Service ProviderToronto, Canada
Temps plein

A global technology service provider in Toronto is seeking a Data Engineer to lead the development of ETL/ELT pipelines and ensure high standards in code quality.The ideal candidate has deep expert... Voir plus

 • Offre sponsorisée

Senior Data Engineer: Snowflake, DBT & Glue Pro (Contract)

Compunnel Inc.Markham, York Region, CA
Temps plein

A leading IT Services and Consulting firm is seeking a Senior Data Engineer in Markham, Ontario.Candidates should have over 8 years of data engineering experience and proficiency in technologies su... Voir plus

 • Offre sponsorisée

Senior Data Engineer

Aarorn Technologies IncToronto
Temps plein

Aarorn Technologies Inc provided pay range.This range is provided by Aarorn Technologies Inc.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Job... Voir plus

 • Offre sponsorisée

Senior Data Engineer

TechedinToronto
Temps plein

Hybrid (2 days remote), Toronto, Canada.We are hiring for the Senior Data Engineer role, where the selected candidate will work on scalable data pipelines and analytics solutions.This position focu... Voir plus

 • Offre sponsorisée

Senior Data Engineer, Blockchain

CircleToronto, ON, CA
Temps plein

Circle is committed to visibility and stability in everything we do.As we grow as an organization, we're expanding into some of the world's strongest jurisdictions.Speed and efficiency are motivato... Voir plus

 • Offre sponsorisée

Senior Data Integrations Engineer

EnableToronto, ON, CA
Temps plein

As a Senior Data Integrations Engineer, you will be an expert on all integrations within the Enable platform.You will work with Customer Success Managers and our onboarding teams to configure data ... Voir plus

 • Offre sponsorisée

Senior AI Data Engineer

Veeva SystemsToronto, ON, CA
Temps plein

Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster.As one of the fastest-growing SaaS companies in hist... Voir plus

 • Offre sponsorisée

Senior Data Engineer, Integrations - C$146,200 - C$197,800 A Year

ClioEast York, Canada
Temps plein

Senior Data Engineer sought to build data pipelines, data warehouses, and make datasets accessible, using AWS technologies and big data tools. Voir plus

 • Offre sponsorisée

Senior Data Engineer

Sonata SoftwareToronto, ON, CA
Temps plein

Billion Revenue, is a leading AI-first Modernization Engineering company, powered by our unique PlatformationTM framework.Our 6400+ AI Engineers are helping enterprises transform from systems to in... Voir plus

 • Offre sponsorisée

Databricks Senior Engineer: Data-Driven Insights

WinsAboveToronto, ON, CA
Temps plein

Accelerate data-driven transformation as a Senior Solutions Engineer at Databricks in Toronto, ON.Utilize your expertise in ML and AI to provide strategic guidance to large enterprises.In this infl... Voir plus

 • Offre sponsorisée

Senior Databricks Data Engineer — Lakehouse & Ai Pipelines - C$120,000 - C$150,000 A Year

Financial Services ProviderEast York, Canada
Temps plein

Data Engineer needed in Toronto to design and optimize data pipelines on Databricks Lakehouse Platform using Python, Spark, and AWS for a financial services provider. Voir plus

 • Offre sponsorisée

Senior Data Engineer - C$85,000 - C$125,000 A Year

MozillaEast York, Canada
Temps plein

Seeking a Senior Data Engineer to manage data lifecycle, build pipelines, transform data, and ensure data quality and integrity for data-informed decisions. Voir plus

 • Offre sponsorisée

Senior Data & Analytics Engineer

WagepointToronto, ON, CA
Temps plein

Senior Data & Analytics Engineer.This range is provided by Wagepoint.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.At Wagepoint, we’re good pe... Voir plus