Talent.com
Mastech Digital
AWS Databricks EngineerMastech Digital • Toronto, ON, Canada
AWS Databricks Engineer

AWS Databricks Engineer

Mastech Digital • Toronto, ON, Canada
9 days ago
Job type
  • Full-time
Job description

Remote - Canada


We’re looking for a hands‑on Databricks Engineer to help Client migrate and modernize 100+ data pipelines (batch + streaming) from an acquired company’s environment. This is a fast‑paced, execution‑heavy role where you’ll:

  • Rebuild jobs/workflows in Databricks (AWS East)
  • Modernize CI/CD with GitHub Actions + Terraform/DAB
  • Work deeply with Spark, Delta Lake, and large‑scale ETL
  • Collaborate with a lean, high‑impact team

It’s a chance to own delivery on a large‑scale migration project with visibility and immediate impact. If you enjoy building, debugging, and optimizing at scale, this role offers both challenge and recognition.


Title: AWS Databricks Engineer

Duration: Long term

Location: Remote (Canada)


Job Description:

Role Overview

We are looking for Sr Data Engineers to join our team. You will work alongside our existing Data Engineering team to migrate our Databricks workspaces from a legacy account to a new, purpose-built AWS infrastructure. This is a hands-on role where you will be building infrastructure-as-code, creating data pipelines as Databricks Asset Bundles (DAB), and ensuring a smooth transition with zero data loss.


Key Responsibilities

  • Migrate existing Databricks workspaces, jobs, notebooks, and configurations to new AWS accounts
  • Build and maintain infrastructure using Terraform with the Databricks provider
  • Define and deploy Databricks resources using Databricks Asset Bundles (DAB)
  • Create CI/CD pipelines using GitHub Actions for automated deployments
  • Set up and configure Unity Catalog objects including catalogs, schemas, and access grants
  • Migrate data between S3 buckets across AWS accounts
  • Write and optimize Spark jobs in Python or Scala
  • Configure orchestration workflows using Apache Airflow (MWAA)
  • Collaborate with the platform and cloud infrastructure teams on AWS networking, IAM, and security configurations
  • Participate in code reviews and follow GitOps best practices


Required Qualifications

  • 5+ years of experience in data engineering or related roles
  • Strong hands-on experience with Databricks on AWS
  • Proficiency in Terraform for infrastructure provisioning and management
  • Experience with Spark (PySpark or Scala) for data processing
  • Familiarity with AWS services: S3, IAM, KMS, Secrets Manager, VPC
  • Experience with CI/CD pipelines, preferably GitHub Actions
  • Strong understanding of data lake architectures and Delta Lake
  • Comfortable working with Git and following GitOps workflows


Preferred Qualifications

  • Experience with Databricks Asset Bundles (DAB)
  • Experience with Databricks Unity Catalog
  • Hands-on experience with Atmos or similar Terraform orchestration frameworks
  • Experience with Apache Airflow or Amazon MWAA
  • Experience with data migration projects, especially Databricks workspace migrations
  • Familiarity with Databricks Terraform Exporter or similar reverse-engineering tools
  • Experience working in multi-account AWS environments


Technology Stack

  • Cloud: AWS (multi-account)
  • Data Platform: Databricks (Unity Catalog)
  • IaC: Terraform, Atmos
  • Resource Bundles: Databricks Asset Bundles (DAB)
  • Orchestration: Apache Airflow (MWAA)
  • CI/CD: GitHub Actions
  • Languages: Python, Scala, SQL, HCL
  • Storage: S3, Delta Lake
  • Version Control: GitHub


Best regards,

Vivek Shrivastava

Lead Recruiter – Information Technology

Tel – 412-286-1530

Vivek.Shrivastava@mastechdigital.com

Create a job alert for this search

AWS Databricks Engineer • Toronto, ON, Canada

Similar jobs

Data Engineer, Trading Analytics on AWS

LuxoftToronto, ON, CA
Full-time

A leading IT consulting firm in Toronto is seeking a Data Engineer to enhance trading operations through cloud-based solutions.You will design, build, and maintain a scalable data platform, ensurin... Show more

 • Promoted

Hybrid Cloud Data Platform Engineer (AWS + Snowflake)

Aviva CanadaMarkham, York Region, CA
Full-time

A leading insurance provider in York Region, Markham is seeking a Data Platform Administrator specialized in AWS and Snowflake.This role involves designing and optimizing cloud data solutions, auto... Show more

 • Promoted

Senior Data Engineer - AWS & Data Platform Expert

TEEMAToronto, ON, CA
Full-time

A large municipal government in Toronto is looking for a Senior Data Engineer to enhance city services through innovative data solutions.The role involves utilizing AWS technologies for building sc... Show more

 • Promoted

Senior DevOPS/Cloud Engineer(26-14254)

Russell Tobintoronto, on, ca
Full-time

Russell Tobin & Associates is hiring on behalf of one of its esteemed clients.Job Title: Senior DevOPS/Cloud Engineer.Location: Toronto, Ontario, Canada (Onsite).Duration: 12 Months (possible exten... Show more

 • Promoted

Remote Lead Data Platform Engineer - AWS, ETL & Analytics

Launch PotatoToronto, ON, CA
Remote
Full-time

A digital media company is seeking a Data Engineer to lead scalable data efforts and support cross-functional teams with reliable data.The ideal candidate will have 5+ years of experience in data e... Show more

 • Promoted

Senior Analytics (AWS DBT) Engineer

Mastech Digitalnewmarket, on, ca
Full-time

We are seeking a Senior AWS DBT Engineer to play a critical role in transforming an existing analytics ecosystem into a modern, scalable Databricks + dbt architecture (Bronze → Silver → Gold).This ... Show more

 • Promoted

Sr AWS Cloud Engineer (Banking/Capital Markets)

companytoronto, on, ca
Full-time

Senior AWS Cloud Engineer / Sr AWS DevOps (10+ years of experience).Duration: 6mo (high change of extension).Location: Downtown Toronto or remore (within Canada only).AWS cloud infrastructure / pla... Show more

 • Promoted

Remote Cloud Data Platform Engineer (AWS)

My RecruiterToronto, ON, CA
Remote
Full-time

A recruiting firm is hiring a Platform Engineer in Toronto, Canada for a global software services client.The engineer will develop a cloud-based data platform and collaborate with various teams.Can... Show more

 • Promoted

Data Engineer – Snowflake, AWS & BI Pipelines

RPS Real Property SolutionsToronto, ON, CA
Full-time

A leading real estate solutions provider in Toronto is seeking an experienced Data Engineer to optimize their data infrastructure.The role requires 3+ years of experience, strong skills in Snowflak... Show more

 • Promoted

AWS Data Engineering

Compunnel, Inc.Toronto, ON, CA
Full-time

We are seeking a skilled AWS Data Engineer with expertise in building scalable data pipelines and cloud-native platforms.The ideal candidate will have hands-on experience with AWS services such as ... Show more

 • Promoted

Cloud Engineer - AWS

Iris Software Inc.Toronto, ON, CA
Temporary

Toronto, ON (Hybrid – 2-3 days onsite per week).AWS Services: IAM, SageMaker, S3.Infrastructure as Code (IaC): AWS CDK to provision SageMaker resources, Lambda functions, Step Functions.MLOPs, Cont... Show more

 • Promoted

Platform Engineer - AWS

NTT Data Americas, Inc.Toronto, ON, CA
Full-time

Design, build, and maintain AWS-based cloud platforms and shared services.Implement Infrastructure as Code (IaC) using Terraform, CloudFormation, or similar tools.Build CI/CD pipelines to support a... Show more

 • Promoted

Data Engineer - AWS, Snowflake, DBT, Airflow | Remote

act digitalToronto, ON, CA
Remote
Full-time

An international IT consulting firm is seeking a mid-level or senior Data Engineer to support a global pharmaceutical project.Responsibilities include reviewing data engineering designs, performing... Show more

 • Promoted

Data Engineer – Cloud Pipelines (Snowflake/AWS) Hybrid

V-Soft Consulting Group, Inc.Toronto, ON, CA
Full-time

A leading technology services company in Toronto, Ontario is looking for a Data Engineer to design and implement scalable data solutions.The role requires expertise in AWS services and proficiency ... Show more

 • Promoted

Data Platform Engineer – AWS & Python

EPAM Systems, Inc.Toronto, ON, CA
Full-time

EPAM is seeking a Senior Data Platform Engineer well-versed in Python and AWS.Your role will focus on optimizing data infrastructure while ensuring secure data access for our customers.In this posi... Show more

 • Promoted • New!

Remote Senior Data Engineer with AWS/GCP Skills

Inizio Partners CorpToronto, ON, CA
Remote
Full-time

Take the next step in your career as a Remote Senior Data Engineer.Bring your expertise in AWS and GCP to enhance our data systems and platforms.We are seeking a Consultant Data Engineer with stron... Show more

 • Promoted

Sr AWS Cloud Engineer (Banking/Capital Markets) - company

companynorth york, on, ca
Full-time

Senior AWS Cloud Engineer / Sr AWS DevOps (10+ years of experience).Duration: 6mo (high change of extension).Location: Downtown Toronto or remore (within Canada only).AWS cloud infrastructure / pla... Show more

 • Promoted

Senior AWS Data Engineer - Analytics Focus

AdastraMarkham, York Region, CA
Full-time

Elevate your career as a Senior AWS Data Engineer focusing on analytics and BI solutions.Engage in a dynamic hybrid environment to design and deliver data solutions for informed decision-making.You... Show more

 • Promoted

Senior Data Engineer — Databricks on AWS (Remote)

LumenaltaToronto, ON, CA
Remote
Full-time

A leading data solutions company is seeking a Senior Data Engineer to join their fully remote team.In this role, you will design and build scalable ETL/ELT pipelines using Databricks on AWS, ensuri... Show more

 • Promoted

AWS Cloud Data Engineer

Tata Consultancy ServicesToronto, ON, CA
Full-time

Tata Consultancy Services (TCS) is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to c... Show more