Talent.com

Big data engineer Jobs in Old toronto, ON

Create a job alert for this search

Big data engineer • old toronto on

Last updated: less than 1 hour ago

Big Data Engineer (PySpark / Spark / Kafka)

Astra North Infoteck Inc.Toronto, ON, ca

Job Description: Big Data Engineer (PySpark / Spark / Kafka).Hybrid – 3 Days a Week in Office.We are seeking an experienced Data Engineer with strong expertise in Big Data technologies to desi... Show more

Senior Data Engineer

ShyftLabsToronto, , Canada, M5E 1C9
CA$140,000.00–CA$180,000.00 yearlyCA$140,000.00–CA$180,000.00 yearly

At ShyftLabs, we live and breathe data.Since 2020, we've been helping Fortune 500 companies unlock growth with cutting-edge digital solutions that transform industries and create measurable busines... Show more

Senior Data Engineer

0000050176 RBC Capital Markets, LLCToronto, Ontario
Full-timeFull-time

CNB (City National Bank), an RBC company, is modernizing its data architecture as a core part of our digital transformation strategy.We're seeking a Senior Data Engineer to architect and build scal... Show more

Senior Data Engineer

Randstad CanadaToronto, Ontario, CA
TemporaryTemporary
Quick Apply

We are seeking a highly accomplished Senior Data Engineer for an enterprise-level contract opportunity based in Toronto.In this role, you will take on a key data engineering, analytics architecture... Show more

Data Engineer II

The Toronto-Dominion Bank (Canada)Toronto, Ontario
Full-timeFull-time

Provide a broad range of data engineering functions including data modeling, data quality, data profiling, data acquisition and ingestion, extract transform load (ETL), metadata enrichment and mana... Show more

 • New!

Data Engineer

0017 eBay Canada TechnologyToronto
CA$102,400.00 yearlyCA$102,400.00 yearly
Full-timeFull-time

Depop is a peer-to-peer circular fashion marketplace where anyone can buy, sell and discover secondhand fashion.Depop's mission is simple: to make fashion circular by making secondhand as exciting ... Show more

Data Engineer

CityliticsToronto, ON, CA
CA$90,000.00–CA$110,000.00 yearlyCA$90,000.00–CA$110,000.00 yearly
Full-timeFull-time
Quick Apply

Citylitics delivers predictive intelligence on where, how, and why infrastructure investments will occur across North America.Infrastructure includes the foundational systems that shape our quality... Show more

Senior Data Engineer

JLLToronto
RemoteRemote
Full-timeFull-time

JLL empowers you to shape a brighter way.Our people at JLL are shaping the future of real estate for a better world by combining world class services, advisory and technology for our clients.We are... Show more

Data Engineer

FinanceitToronto, ON, CA
CA$75,000.00–CA$105,000.00 yearlyCA$75,000.00–CA$105,000.00 yearly
Full-timeFull-time
Quick Apply

Financeit is a point-of-sale financing provider serving some of the largest home improvement and retail organizations in Canada.Our platform helps businesses close more sales by offering customers ... Show more

Data Integration Engineer

ProphixEtobicoke, ON, CA
CA$80,000.00 yearlyCA$80,000.00 yearly
Full-timeFull-time
Quick Apply

See what you can do with Prophix.Prophix helps finance teams work with greater flexibility and confidence through Prophix One™, our Financial Performance Platform.We bring planning, reporting, and ... Show more

Data Engineer, Lead

University of TorontoToronto, ON, CA
Full-timeFull-time

Institutional Research and Data Governance.Institutional Research and Data Governance.The University’s Institutional Research and Data Governance (IRDG) office was formally launched in 2020.In addi... Show more

Data Engineer

LyftToronto

At Lyft, our purpose is to serve and connect.We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive.The Safety and Customer Care (... Show more

Data Platform Engineer

XanaduToronto, Ontario, CA
Full-timeFull-time

Xanadu’s mission is to build quantum computers that are useful and available to people everywhere.At Xanadu, we are learners, innovators, researchers, collaborators and problem solvers.We are creat... Show more

Data Implementation Engineer

Odaia Intelligence Inc.Toronto, ON, CA
CA$90,000.00–CA$110,000.00 yearlyCA$90,000.00–CA$110,000.00 yearly
Quick Apply

ABOUT ODAIA ODAIA noun o·da·ia | 'oh-day-yeah An Ancient Greek word referring to "ōdē", the word for song, and the root of melody, harmony, and orchestra.We chose it deliberatel... Show more

Senior Data Engineer

RockstarToronto, ON, CA
Quick Apply

Rockstar is recruiting for a fast-growing, mission-driven technology company focused on workforce development.The client is dedicated to building innovative digital solutions that empower individua... Show more

Data Engineer (Data Modeling/Data Governance)

TangerineToronto, ON, CA
PermanentPermanent

Design, build, and support scalable data pipelines, data warehouses, data models, and data products.Develop cloud-based data solutions using GCP, BigQuery, Apache Airflow, Informatica, Python, and ... Show more

Senior Data Engineer

Livingston InternationalToronto, ON, CA
Full-timeFull-time

Join Livingston and grow your career in the constantly changing world of international trade.Livingston is a market leader offering customs brokerage, international trade consulting, compliance and... Show more

People also ask
Big Data Engineer (PySpark / Spark / Kafka)

Big Data Engineer (PySpark / Spark / Kafka)

Astra North Infoteck Inc.Toronto, ON, ca
16 days ago
Job description

Job Description

Job Description: Big Data Engineer (PySpark / Spark / Kafka)

Work Mode: Hybrid – 3 Days a Week in Office

Job Overview

We are seeking an experienced Data Engineer with strong expertise in Big Data technologies to design, develop, and support enterprise-scale data platforms. The ideal candidate should have hands-on experience in PySpark, Apache Spark, Kafka, Hadoop ecosystem components, and Apache NiFi, along with a strong understanding of data ingestion, transformation, and real-time processing frameworks.

Key Responsibilities

  • Design, develop, and optimize scalable data pipelines using PySpark, Spark, Hadoop, and Apache NiFi.
  • Build and maintain batch and real-time data processing solutions.
  • Develop and support Kafka-based streaming applications and event-driven architectures.
  • Create and optimize ETL/ELT workflows for large-scale structured and unstructured datasets.
  • Develop complex SQL queries for data extraction, transformation, validation, and troubleshooting.
  • Implement data ingestion solutions from databases, APIs, files, and streaming sources.
  • Monitor, troubleshoot, and enhance the performance of Spark jobs and data pipelines.
  • Collaborate with architects, business analysts, and development teams to deliver high-quality data solutions.
  • Support platform upgrades, deployments, testing, certification, and production releases.
  • Ensure data quality, governance, security, and operational excellence across data platforms.

Mandatory Skills

  • PySpark
  • Apache Spark (Spark SQL, DataFrames)
  • Apache Kafka
  • Hadoop Ecosystem (HDFS, Hive, YARN)
  • Apache NiFi
  • SQL
  • Python

Preferred Skills

  • Spark Streaming
  • Airflow / Oozie
  • Hive
  • Scala
  • Jenkins, Bitbucket, Git
  • JIRA, Confluence
  • Cloud Platforms (GCP/AWS/Azure)
  • Data Warehousing Concepts and Dimensional Modeling



Requirements
Salesforce