As an Azure and Databricks Data Engineer, you will be responsible for designing, building and supporting the data driven applications which enable innovative, customer centric digital experiences.W...Show moreLast updated: 5 days ago
OPEN: FinOps Engineer
CPUS Engineering Staffing Solutions Inc.Oshawa
Full-time
Looking for someone who has a passion for cloud financial management, cost optimization, and building automation at scale? We are seeking a FinOps Engineer to join our team and lead the implementat...Show moreLast updated: 30+ days ago
New!
API / Integration Developer
CPUS Engineering Staffing Solutions Inc.Oshawa
Full-time
We are seeking highly skilled Integration Developers with a strong focus on API development and integration platforms.This role involves designing, developing, and maintaining integration solutions...Show moreLast updated: 7 hours ago
Senior Integration Services Developer
Ontario Power GenerationOshawa, ON, CA, L1H 8W8
Full-time
Yearbachelor’s degree in computer science, Engineering, or a related discipline.Electrify your career and help build a brighter tomorrow.Every generation has a challenge that defines them.At OPG, w...Show moreLast updated: 7 days ago
OPEN: API / Integration Developer
Rodan Energy SolutionsOshawa, CA
Full-time
We are currently requesting resumes for the following position.Wednesday, March 4th, (5:00PM EST).Hybrid – 3 days remote per week.We are seeking highly skilled Integration Developers with a strong ...Show moreLast updated: 30+ days ago
OPEN: Lead Software Engineer / Developer
CPUS Engineering Staffing Solutions Inc.Oshawa
Full-time
We are currently requesting resumes for the following position.Lead Software Engineer / Developer.Wednesday, February 18th, 2026 (5:00PM EST).Colonel Sam Drive, Oshawa, Ontario.Work Mode: (Hybrid –...Show moreLast updated: 30+ days ago
OPEN: Senior Architect
Rodan Energy SolutionsOshawa, CA
Full-time
We are currently requesting resumes for the following position.Wednesday, January 14th, (5:00PM EST).University Ave, Toronto, Colonel Sam Drive, Oshawa (Toronto & Oshawa, rotating weekly).We are se...Show moreLast updated: 30+ days ago
Data Engineer - Azure Databricks.Oshawa, ON (Hybrid - 3 days remote).We have a great new opportunity to support one of our Energy Sector clients in a contract capacity!.Please see below for more in...Show moreLast updated: 3 days ago
Quality Engineering Practice Lead
CPUS Engineering Staffing Solutions Inc.Oshawa
Full-time
The Quality Engineering Practice Lead is responsible for establishing, evolving, and championing best practices in software quality across the software engineering organization.This role will drive...Show moreLast updated: 30+ days ago
Senior Integration Services Developer
Ontario Power GenerationOshawa, ON, CA
Full-time
Engineering, or a related discipline.Electrify your career and help build a brighter tomorrow.Every generation has a challenge that defines them.At OPG, we are calling on all innovators, disruptors...Show moreLast updated: 7 days ago
New!
Senior Architect
CPUS Engineering Staffing Solutions Inc.Oshawa
Full-time
We are seeking a highly experienced Solution Architect to lead the design and implementation of enterprise-level architecture solutions that drive innovation, scalability, and operational excellenc...Show moreLast updated: 7 hours ago
Kubernetes Engineer
CPUS Engineering Staffing Solutions Inc.Oshawa
Full-time
Design and implement cloud-native infrastructure using Kubernetes and container orchestration platforms.Develop and manage PaaS infrastructure components including compute, database, storage, and i...Show moreLast updated: 30+ days ago
FinOps Product Owner/Practitioner
CPUS Engineering Staffing Solutions Inc.Oshawa
Full-time
The FinOps Product Owner leads the vision, strategy, and execution of financial operations (FinOps) initiatives centered around Microsoft Azure.This role connects engineering, finance, and business...Show moreLast updated: 30+ days ago
People also ask
The cities near Oshawa, ON that boast the highest number of devops jobs are:
Resume Due Date:Tuesday, March 31, 2026 (5:00PM EST)
Job Overview
As an Azure and Databricks Data Engineer, you will be responsible for designing, building and supporting the data driven applications which enable innovative, customer centric digital experiences.
Will be working as part of a cross-discipline agile team who help each other solve problems across all business areas.
Will build reliable, supportable & performant data lake & data warehouse products to meet the organization’s need for data to drive reporting analytics, applications, and innovation.
Will employ best practice in development, security, and accessibility and design to achieve the highest quality of service for our customers.
Build and productionize modular and scalable data ELT/ETL pipelines and data infrastructure leveraging the wide range of data sources across the organization.
Build curated common data models designed by the Data Modelers that offer an integrated, business-centric single source of truth for business intelligence, reporting, and downstream system use, in collaboration with Data Architect.
Work closely with infrastructure, and cyber teams and Senior Data Developers to ensure data is secure in transit and at rest.
Clean, prepare and optimize datasets for performance, ensuring lineage and quality controls are applied throughout the data integration cycle.
Support Business Intelligence Analysts in modelling data for visualization and reporting, using dimensional data modeling and aggregation optimization methods.
Troubleshoot issues related to ingestion, data transformation and pipeline performance, data accuracy and integrity.
Collaborate with Business Analysts, data scientists, Senior Data Engineers, Data Analysts and solution Architects and Data Modelers to develop data pipelines to feed our data marketplace.
Assist in identifying, designing, and implementing internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Work with tools in the Microsoft Stack; Azure Data Factory, Azure Data Lake, Azure SQL Databases, Azure Data Warehouse, Azure Synapse Analytics Services, Azure Databricks, Microsoft Purview, and Power BI.
Work within the agile SCRUM work management framework in delivery of products and services, including contributing to feature & user story backlog item development, and utilizing related Kanban/SCRUM toolsets.
Assist in building data catalog and maintenance of relevant metadata for datasets published for enterprise use.
Develop optimized, performant data pipelines and models at scale using technologies such as Python, Spark and SQL, consuming data sources in XML, CSV, JSON, REST APIs, or other formats.
Document as-built pipelines and data products within the product description, and utilize source control to ensure a maintainable code-base.
Implement orchestration of data pipeline execution designed by Senior Data Engineers to ensure data products meet customer latency expectations, dependencies are managed, and datasets are as up-to-date as possible, with minimal disruption to end-customer use.
Create tooling in collaboration with senior data engineers and data architects to help with day to day tasks, and reduce toil via automation wherever possible.
Work with Continuous Integration/Continuous Delivery and DevOps pipelines to assist in automate infrastructure, code delivery and product enhancement isolation and proper release management and versioning.
Monitor the ongoing operation of in-production solutions, assist in troubleshooting issues, and provide Tier 2 support for datasets produced by the team, on an as-required basis.
Implement and manage appropriate access to data products via role-based access control based on guidance from senior data engineers.
Write and perform automated unit and regression testing for data product builds, assist with user acceptance testing and system integration testing as required, and assist in design of relevant test cases based on guidance from Data Architects.
Participate in peer code review sessions.
Qualifications
Completion of a four-year University education in computer science, computer/software engineering or other relevant programs within data engineering, data analysis, artificial intelligence, or machine learning.
Must have experience as a Data Engineer designing and building data pipelines.
Must have experience using Azure Data Factory and Databricks - have experience building new Data Pipelines using Azure Data Factory and Databricks must be identified in your resume.
Fluent in creating data processing frameworks using Python, PySpark, SparkSOL and SOLExperience with Azure Data Factory, ADLS, Synapse Analytics and Databricks
Must have experience building data pipelines for Data Lakehouses and Data Warehouses
Excellent understanding of data structures and data processing frameworks
Thorough knowledge of data governance and data quality principles
Must have effective communication skills to translate technical details to non-technical stakeholders
Spirit Omega is committed to a diverse and inclusive workplace. We welcome applications from anyone, including members of Indigenous peoples, Women, visible minorities, persons with disabilities, persons of minority sexual orientations and gender identities, and others with the skills and knowledge to productively engage with diverse communities.
Looking for more opportunities? Check out our website atjobs.spiritomega.com