Talent.com

Big data engineer Jobs in Toronto, ON

Create a job alert for this search

Big data engineer • toronto on

Last updated: 1 hour ago

Big Data Engineer (PySpark / Spark / Kafka)

Astra North Infoteck Inc.Toronto, ON, ca

Job Description: Big Data Engineer (PySpark / Spark / Kafka).Hybrid – 3 Days a Week in Office.We are seeking an experienced Data Engineer with strong expertise in Big Data technologies to desi... Show more

 • New!

Senior Quantitative Developer: Big Data & Derivatives

Mindlancetoronto, on, Canada

A leading financial services firm in Toronto seeks an experienced professional with over 5 years in capital markets, focusing on Market Risk or Back Office.Candidates must have strong skills in Big... Show more

 • Promoted • New!

Data Engineer

Kumaran Systemstoronto, on, Canada

Application Developer/Support with good knowledge and understanding of Software Development Life Cycle, databases, batch processing, knowledge of firewalls, FTP, and SFTP.Experience in application ... Show more

 • Promoted • New!

Data Engineer

Movable Inktoronto, on, Canada

Movable Ink scales content personalization for marketers through data-activated content generation and AI decisioning.The world’s most innovative brands rely on Movable Ink to maximize revenue, sim... Show more

 • Promoted • New!

Data Engineer Lead - Big Data Specialist

Compunnel Inc.toronto, on, Canada

Become a Data Engineer Lead focusing on big data technologies and cloud-native architecture.Your expertise will guide our data engineering initiatives and elevate team performance through best prac... Show more

 • Promoted • New!

Senior Data Architect - Big Data (AWS) - Canada

Rackspace Technologytoronto, on, Canada
Full-timeFull-time

Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.As a full spectrum AWS integrator, we assist hundreds of companies to realize the value, efficiency, a... Show more

 • Promoted • New!

Big Data Developer

Cynet Systemstoronto, on, Canada

Design and build realtime and batch data pipelines for fraud detection and AML monitoring.Process streaming transaction data using Apache Spark and Kafka.Develop ETLELT workflows supporting custome... Show more

 • Promoted • New!

Senior Data Engineer

BMO Financialtoronto, Canada
Part-timePart-time

Data and AI Technology (DAT) Engineering supports BMO's Digital-First, risk, regulatory and compliance requirements by building data and AI products that provide timely actionable insights to drive... Show more

 • Promoted • New!

Data Engineer

CareRxtoronto, on, Canada

CareRx’s Enterprise Data platforms enable the organisation to harness the power of its data.Core to this is the ability to source, transform and move data from multiple locations and store it in an... Show more

 • Promoted • New!

Data Engineer

Y-Axistoronto, on, Canada

As a Data Scientist at Cogeco, you will develop predictive modeling and machine learning solutions to complex business problems creating value for the business.Transform data into insights that hel... Show more

 • Promoted • New!

Google Big Data Platform Engineer II

The Toronto-Dominion Bank (Canada)Toronto, Ontario
Full-timeFull-time

We are seeking a multi-cloud platform engineer with experience in Google Cloud to work across our engineering teams and business partners.The ideal candidate will have previous public cloud experie... Show more

 • New!

Data Engineer

Lyfttoronto, on, Canada

At Lyft, our purpose is to serve and connect.We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive.The Safety and Customer Care (... Show more

 • Promoted • New!

Senior Data Platform Engineer - AWS & Big Data

Apptoza Inc.toronto, on, Canada

Data Engineer to advance our cloud data platforms in a high-demand environment.You will design and implement data pipelines across AWS services and Hadoop ecosystems, focusing on scalable data ware... Show more

 • Promoted • New!

Data Engineer

Insight Globaltoronto, on, Canada
TemporaryTemporary

Duration: 12 month contract + possible extensions.Data Engineer to support a large enterprise transformation focused on building data pipelines, integrating data, and migrating data workloads from ... Show more

 • Promoted • New!

Senior Big Data & Treasury Analytics Lead

Akkodistoronto, on, Canada
TemporaryTemporary

A professional services firm is seeking a Business Systems Analyst (Spark/Big Data) for a 6-month contract.This role involves leading project teams on high-quality deliverables while managing proje... Show more

 • Promoted • New!

Analyste Données et Analytique – BI & Big Data

BDO Canadatoronto, on, Canada
Permanent, Full-timePermanent, Full-time

BDO Canada, via BDO Digital, recherche un nouveau diplômé en analytique des données / ingénierie des données pour un poste permanent à temps plein à Toronto, axé sur les projets clients et l’évolut... Show more

 • Promoted • New!

Data Engineer

Tata Consultancy Servicestoronto, on, Canada

Tata Consultancy Services (TCS) is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to c... Show more

 • Promoted • New!

Data Engineer

Sun Lifetoronto, on, Canada

You are as unique as your background, experience and point of view.Here, you’ll be encouraged, empowered and challenged to be your best self.You’ll work with dynamic colleagues - experts in their f... Show more

 • Promoted • New!

Data Engineer

Peak Power Inctoronto, on, Canada

Peak Power is a North American cleantech company providing end-to-end battery energy storage solutions for large commercial, industrial, and manufacturing facilities operating in IESO, ISO-NE, PJM,... Show more

 • Promoted • New!

Data Engineer

ZoomInfotoronto, on, Canada

The Data Engineer III is a core builder on the Strategic Partnerships team’s data platform.They design and ship ETL pipelines, semantic models, and the supporting infrastructure that powers cross-f... Show more

 • Promoted • New!
People also ask
Big Data Engineer (PySpark / Spark / Kafka)

Big Data Engineer (PySpark / Spark / Kafka)

Astra North Infoteck Inc.Toronto, ON, ca
1 hour ago
Job description

Job Description

Job Description: Big Data Engineer (PySpark / Spark / Kafka)

Work Mode: Hybrid – 3 Days a Week in Office

Job Overview

We are seeking an experienced Data Engineer with strong expertise in Big Data technologies to design, develop, and support enterprise-scale data platforms. The ideal candidate should have hands-on experience in PySpark, Apache Spark, Kafka, Hadoop ecosystem components, and Apache NiFi, along with a strong understanding of data ingestion, transformation, and real-time processing frameworks.

Key Responsibilities

  • Design, develop, and optimize scalable data pipelines using PySpark, Spark, Hadoop, and Apache NiFi.
  • Build and maintain batch and real-time data processing solutions.
  • Develop and support Kafka-based streaming applications and event-driven architectures.
  • Create and optimize ETL/ELT workflows for large-scale structured and unstructured datasets.
  • Develop complex SQL queries for data extraction, transformation, validation, and troubleshooting.
  • Implement data ingestion solutions from databases, APIs, files, and streaming sources.
  • Monitor, troubleshoot, and enhance the performance of Spark jobs and data pipelines.
  • Collaborate with architects, business analysts, and development teams to deliver high-quality data solutions.
  • Support platform upgrades, deployments, testing, certification, and production releases.
  • Ensure data quality, governance, security, and operational excellence across data platforms.

Mandatory Skills

  • PySpark
  • Apache Spark (Spark SQL, DataFrames)
  • Apache Kafka
  • Hadoop Ecosystem (HDFS, Hive, YARN)
  • Apache NiFi
  • SQL
  • Python

Preferred Skills

  • Spark Streaming
  • Airflow / Oozie
  • Hive
  • Scala
  • Jenkins, Bitbucket, Git
  • JIRA, Confluence
  • Cloud Platforms (GCP/AWS/Azure)
  • Data Warehousing Concepts and Dimensional Modeling



Requirements
Salesforce