Talent.com
Tredence Inc.
Azure Databricks Engineer - oshawaTredence Inc. • oshawa, on, ca
Azure Databricks Engineer - oshawa

Azure Databricks Engineer - oshawa

Tredence Inc. • oshawa, on, ca
4 days ago
Job type
  • Full-time
Job description

Job Summary

We are seeking a skilled Azure Databricks Engineer with strong experience in Azure Data Factory (ADF) to design, develop, and maintain scalable data pipelines and analytics solutions on the Azure cloud platform. The ideal candidate will have expertise in big data processing, ETL/ELT workflows, and distributed computing using Databricks.

Key Responsibilities

  • Design and implement scalable data pipelines using Azure Data Factory (ADF)
  • Develop and optimize data processing workflows using Azure Databricks (PySpark/Scala)
  • Build ETL/ELT processes for ingesting, transforming, and loading large datasets
  • Integrate data from multiple sources such as APIs, databases, and data lakes
  • Work with Azure Data Lake Storage (ADLS) and Azure SQL Database
  • Monitor, troubleshoot, and optimize pipeline performance and data quality
  • Implement data security, governance, and compliance standards
  • Collaborate with data scientists, analysts, and stakeholders to deliver data solutions
  • Automate workflows and deployments using CI/CD pipelines
  • Maintain documentation for data architecture and processes

Required Skills & Qualifications

  • Bachelor’s degree in Computer Science, Engineering, or related field
  • 10+ years of experience in Azure data engineering
  • Strong hands-on experience with:
  • Azure Databricks (PySpark preferred)
  • Azure Data Factory (ADF)
  • SQL and relational databases
  • Experience with big data technologies and distributed processing
  • Knowledge of data warehousing concepts and dimensional modeling
  • Familiarity with Azure services like:
  • Azure Data Lake Storage (ADLS Gen2)
  • Azure Synapse Analytics
  • Experience with version control (Git) and CI/CD tools
  • Strong problem-solving and debugging skills

Create a job alert for this search

Azure Databricks Engineer - oshawa • oshawa, on, ca

Similar jobs

Data & Analytics Engineer - oshawa

Amaris Consultingoshawa, on, ca
Full-time

Senior Data & Analytics Engineer.This role is ideal for a highly technical professional who can combine hands-on data engineering expertise with platform structuring, infrastructure optimization, a... Show more

 • Promoted

Data Analyst - oshawa

BET99oshawa, on, ca
Full-time

BET99 is Canada's Premiere Online Sportsbook and Casino.Launched in 2020, we have consistently innovated the online gaming landscape every step of the way, exponentially growing our customer base a... Show more

 • Promoted

Senior Statistical Programmer - oshawa

Warman O'Brienoshawa, on, ca
Full-time

Senior Statistical Programmer | Leading CRO | Remote – Canada |.Join a fast-growing, independent CRO recognised for high-quality deliverables, outstanding client service, and a flexible, entreprene... Show more

 • Promoted

Software Engineer – Advanced Systems - oshawa

Draganfly Inc.oshawa, on, ca
Full-time

Company”) has been a recognized technology leader within the commercial UAV space for over two decades.We helped establish the commercial market & adoption of multi-rotor helicopters for public saf... Show more

 • Promoted

Lead Principal Software Engineer - oshawa

Auxo | Growth Partneroshawa, on, ca
Full-time

SaaS products and platforms at scale.You’ll work closely with the Head of Product & Technology to shape technical direction across multiple teams.This is a high-impact IC role where you’ll influenc... Show more

 • Promoted

Développeur principal – Qualité des données (Collibra Data Quality) - oshawa

Astekoshawa, on, ca
Full-time

Astek est un leader mondial en conseil technologique, avec plus de 7 800 experts à travers le monde.Nous accompagnons nos clients dans leur transformation numérique en développant des solutions inn... Show more

 • Promoted

Data Engineer - Minimum 12+ years experience - oshawa

NLB Servicesoshawa, on, ca
Full-time

Lead the migration from Glue/Redshift to Databricks.Deep, hands-on experience with Apache Spark (PySpark and Spark SQL), including performance tuning (partitioning, shuffles, skew, caching, file si... Show more

 • Promoted

GCP Cloud Engineer - oshawa

Quantiphioshawa, on, ca
Full-time

Quantiphi is an award-winning Applied AI and Big Data software and services company, driven by a deep desire to solve transformational problems at the heart of businesses.Our signature approach com... Show more

 • Promoted • New!

Technical Architect (Data) - oshawa

Government Entityoshawa, on, ca
Full-time

Microsoft Fabric, data engineering, and enterprise data transformation.The successful candidate will play a critical role in transforming extracted project application data into scalable, business-... Show more

 • Promoted • New!

Senior Java Developer - oshawa

Luxoftoshawa, on, ca
Full-time

One of the world's largest providers of products and services to the energy industry has a need to develop and support enterprise information system in Oil & Gas domain.Product being developed is a... Show more

 • Promoted

Workday Technical Analyst - oshawa

Modaxooshawa, on, ca
Full-time

Modaxo is looking for a proactive and skilled.In this role, you will contribute to the evolution of Workday from its current state to full adoption across our business, acting as a trusted partner ... Show more

 • Promoted

C++ Developer - oshawa

HCLTechoshawa, on, ca
Full-time

The ideal candidate will have deep expertise in.Design, develop, and maintain features within the.Customize and extend Chromium components such as:.CEF / Electron-like frameworks).Optimize performa... Show more

 • Promoted

DevOps Engineer (AI) - oshawa

Affinityoshawa, on, ca
Full-time

Client: Enterprise class EMR provider.On behalf of our client, Affinity is seeking a DevOps Engineer to build and evolve the infrastructure behind its flagship EMR platform.You’ll own Kubernetes-ba... Show more

 • Promoted

Guidewire Integration Developer - oshawa

Infotek Consulting Inc.oshawa, on, ca
Full-time

Guidewire Integration Developer.We are seeking a highly skilled Guidewire Integration Developer with deep expertise in Guidewire platforms to support ongoing initiatives within Property and Casualt... Show more

 • Promoted

Senior Developer Technical Lead - oshawa

Quarry Consultingoshawa, on, ca
Full-time

We are looking for a highly capable Senior Developer / Dev Lead to join our team.The ideal candidate will be a hands-on technical leader with strong AWS cloud-native development experience, distrib... Show more

 • Promoted

Azure & Databricks Data Engineer - Hybrid Contract

2iSolutions Inc.Oshawa, Durham Region, CA
Full-time

A technology solutions provider is seeking 2 Data Engineers to join their team in Oshawa.The roles are 1-year contracts requiring expertise in Microsoft technologies, particularly Azure and Databri... Show more

 • Promoted

Senior/ Lead - AI Engineer - oshawa

FICOoshawa, on, ca
Full-time

As a Senior Engineer on our Applied AI team, you will be at the forefront of building AI-powered software that transforms how our platform operates.You will design, build, and maintain production-g... Show more

 • Promoted

Senior Consultant, AI - oshawa

Konica Minolta Business Solutions Canadaoshawa, on, ca
Full-time

Exciting Opportunity in Canada - Remote.Lead the design and implementation/delivery of AI solutions, AI Training, Adoption, or Assessments, ensuring alignment with customer objectives, adhering to ... Show more