DataOpsCloud Data EngineerCleo Consulting • Toronto, Ontario, Canada
DataOpsCloud Data Engineer
Cleo Consulting • Toronto, Ontario, Canada
6 days ago
Job type
- Full-time
Job descriptionTo respond to the priorities of the Government of Ontario through the passage of the Bill 5 Protect Ontario by Unleashing Our Economy Act 2025 the resource may be partially assigned to Bill 5 related projects or initiatives on an as needed basis. Designing and developing data pipelines from source to end user Optimizing data pipelines General Skills Experience with Cloud data platforms data management and data exchange tools and technologies Experience with Commercial and opensource data and database development and management and specializing in data storage setting and managing cloud Data As a Service (DaaS). application Database as a Service (DBaaS) Data Warehouses as a Service (DWaaS) and other storage platforms (both in the cloud and on-premise). Experience with Data pipeline and workflow development orchestration deployment and automation and specializing in programming and pipelines to create and managing the dataflow and movement of data. Experience with Cloud data engineer must be familiar and experienced with different programming languages and be able to integrate with many different platforms to create data pipelines automate tasks and write scripts. Experience in DataOPS principle best practice and implementation and Agile project development and deployment Experience in Continuous Integration / Continuous Development / Deployment (CI / CD) and Data provisioning Automation Experience with digital product data analysis data exchange data provisioning and data security Extensive expert experience in designing / developing and implementing data conversation and migration of VLD (Very large Data) of Online analytical processing (OLAP) and online transaction processing (OLTP) environments to Cloud Software-as-a-service (SaaS) Platform-as-a-service (PaaS) and Infrastructure-as-a-service (IaaS) environments. Experience in design development and implementation of fact / dimension model data mapping data warehouse data lake and data lakehouse for enterprise Experience managing Cloud Data services for project delivery including storage repositories Data Lake Data Lakehouse key vault virtual machine disk etc. Experience with structured semi-structured unstructured data collection ingestion provisioning and exchange technological development of enterprise data warehouse and data lake and data lakehouse solutions and operational support. Experience with DataOPS performance monitoring and tuning Excellent analytical problem-solving and decision-making skills; verbal and written communication skills; presentation skills; interpersonal and negotiation skills Mandatory Skills and Experience - 70% Desirable Skills and Experience - 25% Education - 3% Public Sector Experience - 2% Data lake design and development with focus on extracting transforming data coming from various data sources and loading into Lakehouse in medallion architecture. Advanced skills and hands-on experience with Oracle databases Azure SQL Server and Azure Data Factory. Cloud technologies (Azure Google AWS). PL / SQL for data extraction transformation and loading initial setup and other ETL experience management and support such as troubleshooting performance tuning failover and recovery. Scripting languages (Python Unix shell Scala).
Assignment : RQ09822 - DataOps / Cloud Data Engineer - Senior
Job Title : DataOps / Cloud Data Engineer
Requisition (SS) : RQ09822
Start Date :
Client : Land & Resources Cluster
End Date :
Office Location : 40 St Clair Ave W Toronto
Organization : Land & Resources Cluster
Ministry : Ministry of Public and Business Service Delivery and Procurement
# Business Days : 90.00
Onsite - This position is listed as Onsite unless otherwise instructed by the Client; the resource is expected to work 7.25 hours per calendar day between the standard working hours of 8 : 00-5 : 00 PM (excluding lunch breaks) every Monday to Friday inclusive at the identified OPS office location.
Mandatory Skills and Experience (8 years experience) :
- Design build automate and optimize complex data ETL / ELT processes using Databricks Delta Live Tables (DLT) and equivalent.
- Development of unified data platforms using Databricks and Unity catalog or its equivalent.
- Relational databases (Oracle MySQL SQL Server) data modelling (relational & dimensional) advanced SQL query optimization data replication administration.
- Advanced SQL skills (PL / SQL TSQL).
- Big Data processing Frameworks (PySpark).
- Proficient in creating Azure Data Factory pipelines for copy activity and custom data pipelines in Databricks with CI CD (Azure DevOPS Git Integration) .
- Data migration and data integration across different platforms Oracle to Azure Data Lake Oracle to Databricks Oracle to Microsoft Fabric.
Description
Responsibilities
Evaluation Criteria - 100%
Desirable Skills and Experience :
Key Skills
Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala
Employment Type : Full Time
Experience : years
Vacancy : 1
Create a job alert for this search
DataOpsCloud Data Engineer • Toronto, Ontario, Canada
Similar jobs
DACPAC, Oracle, PLSQL, SQL Server, Stored Procedure, DB2, IMS, Oracle DB, Microsoft Azure SQL database, Synapse database.
PL1 development, Azure Key Vault, Portal, VM, DevOps, Data Lake, Data Lakeho...Show more
Supports the development and maintenance of scalable data stores that supply big data in forms needed for business analysis.
Applies experience and seasoned knowledge, skills, and practices to perfo...Show more
Ministry of Public and Business Service Delivery and Procurement.Requisition Closing Date : 2026-02-12, 2 : 00 p.Design, build, automate and optimize complex data ETL / ELT processes using Databricks, De...Show more
Do you have knowledge of Azure and DBA? Are you skilled in SQL and Oracle? If so, this could be a great opportunity for you!.
Senior DataOps / Cloud Data Engineer.Participate in reviewing project, w...Show more
Cloud Engineer - Media & Entertainment Workflows.At GPL Technologies, our mission is to provide powerful, reliable, and innovative technology services and leadership to creative companies by combin...Show more
Supports the development and maintenance of scalable data stores that supply big data in forms needed for business analysis.
Applies experience and seasoned knowledge, skills, and practices to perfo...Show more
A leading bank in Canada is seeking a DevOps Engineer to support their data platform with cloud technologies like GCP, Kubernetes, and Kafka.
This role involves designing scalable infrastructure, ma...Show more
A leading technology company in Toronto is looking for a Software Development Engineer focused on Data Platform Engineering.
The candidate will collaborate with teams to design robust data solutions...Show more
A tech-driven organization is seeking a Senior Software Engineer to oversee the data infrastructure.This role involves the architecture and maintenance of data systems, requiring a minimum of 7 yea...Show more
A recruiting firm is hiring a Platform Engineer in Toronto, Canada for a global software services client.The engineer will develop a cloud-based data platform and collaborate with various teams.Can...Show more
A leading consulting firm in Toronto is seeking a Salesforce Data Cloud Developer to help design and implement solutions for clients.
This role requires 2-4 years of experience with Salesforce Data ...Show more
Toronto, ON | Hybrid | W2 Only Responsibilities.Develop cloud-based applications using Spring Boot Work on Data Lakehouse architecture and Spark Databricks pipelines Automate using Linux / PowerShell...Show more
A leading insurance provider in York Region, Markham is seeking a Data Platform Administrator specialized in AWS and Snowflake.
This role involves designing and optimizing cloud data solutions, auto...Show more
Cloud Engineer - Media & Entertainmen Workflows .At GPL Technologies, our mission is to provide powerful, reliable, and innovative technology services and leadership to creative companies ...Show more
Toronto, ON (Hybrid – 2-3 days onsite per week).AWS Services : IAM, SageMaker, S3.Infrastructure as Code (IaC) : AWS CDK to provision SageMaker resources, Lambda functions, Step Functions.MLOPs, Cont...Show more
About the job RQ09379 - DevOPS / Cloud Engineer.Design, build and support cloud environments to create digital products.Monitor and assess the performance of applications in a cloud environment to en...Show more
Get AI-powered advice on this job and more exclusive features.Your role spans the full DevOps lifecycle—from infrastructure and automation to system performance, cloud cost control, and security go...Show more
About the job RQ09118 - DataOps / Cloud Data Engineer - Senior.Scope of Services and Deliverables.The Services and Deliverables to be provided by the Vendor will include the following : .Participate in...Show more
DataOps cloud Data Engineer 9118-0812
Foilcon • Toronto, Canada
Full-time
Last updated: 30+ days ago • Promoted
Senior Data Engineer (Cloud / AWS)
RBC • Toronto
Full-time
Last updated: 2 days ago • Promoted
RQ09822 – DataOps / Cloud Data Engineer – Senior
Cyber-Infomax Solutions Inc. • Toronto
Full-time
Last updated: 4 days ago • Promoted
Senior DataOps / Cloud Data Engineer
Randstad Canada • Toronto
Full-time +1
Last updated: 4 days ago • Promoted
Cloud Engineer
Breed Staffing • Toronto, Canada
Full-time
Last updated: 23 days ago • Promoted
Senior Data Engineer (Cloud / AWS)
ODAIA • Toronto
Full-time
Last updated: 12 days ago • Promoted
Cloud & Kubernetes DevOps Engineer for Data Platform
Scotiabank • Toronto
Full-time
Last updated: 16 days ago • Promoted
Data Platform Engineer – Cloud Data Pipelines
Intello Technologies Inc. • Toronto, Canada
Full-time
Last updated: 30+ days ago • Promoted
Senior Data Platform Engineer - Cloud Data Pipelines
Gusto • Toronto C6A, ON, Canada
Remote
Full-time
Last updated: 30+ days ago • Promoted
Remote Cloud Data Platform Engineer (AWS)
My Recruiter • Toronto, Canada
Remote
Full-time
Last updated: 23 days ago • Promoted
Salesforce Data Cloud Engineer — Hybrid Toronto
Deloitte Canada • Toronto
Full-time
Last updated: 16 days ago • Promoted
Cloud Engineer
Veracity Software Inc • Toronto, Canada
Full-time
Last updated: 23 days ago • Promoted
Hybrid Cloud Data Platform Engineer (AWS + Snowflake)
Aviva Canada • Markham
Full-time
Last updated: 16 days ago • Promoted
Cloud Engineer
GPL Technologies • Toronto, ON, Canada
Full-time
Last updated: 30+ days ago • Promoted
Cloud Engineer - AWS
Iris Software Inc. • Toronto
Full-time +1
Last updated: 16 days ago • Promoted
RQ09379 - DevOPS / Cloud Engineer
Source Code • Toronto
Full-time
Last updated: 11 days ago • Promoted
Cloud DevOps Engineer
MSCI Inc. • Toronto
Full-time
Last updated: 16 days ago • Promoted
RQ09118 - DataOps / Cloud Data Engineer - Senior
Rubicon Path • Toronto
Full-time
Last updated: 16 days ago • Promoted