Talent.com

Big data engineer Jobs in Toronto, ON

Create a job alert for this search

Big data engineer • toronto on

Last updated: 1 day ago

Big Data Engineer (PySpark / Spark / Kafka)

Astra North Infoteck Inc.Toronto, ON, ca

Job Description: Big Data Engineer (PySpark / Spark / Kafka).Hybrid – 3 Days a Week in Office.We are seeking an experienced Data Engineer with strong expertise in Big Data technologies to desi... Show more

Senior Data Engineer

ShyftLabsToronto, , Canada, M5E 1C9
CA$140,000.00–CA$180,000.00 yearlyCA$140,000.00–CA$180,000.00 yearly

At ShyftLabs, we live and breathe data.Since 2020, we've been helping Fortune 500 companies unlock growth with cutting-edge digital solutions that transform industries and create measurable busines... Show more

Senior Data Engineer

0000050176 RBC Capital Markets, LLCToronto, Ontario
Full-timeFull-time

CNB (City National Bank), an RBC company, is modernizing its data architecture as a core part of our digital transformation strategy.We're seeking a Senior Data Engineer to architect and build scal... Show more

Lead Data Engineer

PureFacts Financial SolutionsToronto, Ontario, Canada, M2N 5S4
CA$130,000.00–CA$150,000.00 yearlyCA$130,000.00–CA$150,000.00 yearly
Quick Apply

About PureFacts Financial Solutions.PureFacts is the leader in the Revenue Performance Management category for wealth and asset management firms.The PureRevenue™ Platform helps organizations maximi... Show more

Data Engineer

0017 eBay Canada TechnologyToronto
CA$102,400.00 yearlyCA$102,400.00 yearly
Full-timeFull-time

Depop is a peer-to-peer circular fashion marketplace where anyone can buy, sell and discover secondhand fashion.Depop's mission is simple: to make fashion circular by making secondhand as exciting ... Show more

Data Engineer

CityliticsToronto, ON, CA
CA$90,000.00–CA$110,000.00 yearlyCA$90,000.00–CA$110,000.00 yearly
Full-timeFull-time
Quick Apply

Citylitics delivers predictive intelligence on where, how, and why infrastructure investments will occur across North America.Infrastructure includes the foundational systems that shape our quality... Show more

Senior Data Engineer

Randstad CanadaNorth York, Ontario, CA
TemporaryTemporary
Quick Apply

Our client, is seeking an experienced, highly analytical Senior Data Engineer to join their rapidly growing Analytics team.In this high-impact role, you will design, build, and optimize scalable da... Show more

Senior Data Engineer

JLLToronto
RemoteRemote
Full-timeFull-time

JLL empowers you to shape a brighter way.Our people at JLL are shaping the future of real estate for a better world by combining world class services, advisory and technology for our clients.We are... Show more

Data Engineer

GTT, LLCToronto, ON
CA$75.00 hourlyCA$75.00 hourly
ContractorContractor

Hybrid 3 days in office, 2 days work from home (anchor days pod dependent).Monday Friday, core business hours, 37.This role supports data quality and controls development for an.FCRM (Financi... Show more

Data Engineer

FinanceitToronto, ON, CA
CA$75,000.00–CA$105,000.00 yearlyCA$75,000.00–CA$105,000.00 yearly
Full-timeFull-time
Quick Apply

Financeit is a point-of-sale financing provider serving some of the largest home improvement and retail organizations in Canada.Our platform helps businesses close more sales by offering customers ... Show more

Data Integration Engineer

ProphixEtobicoke, ON, CA
CA$80,000.00 yearlyCA$80,000.00 yearly
Full-timeFull-time
Quick Apply

See what you can do with Prophix.Prophix helps finance teams work with greater flexibility and confidence through Prophix One™, our Financial Performance Platform.We bring planning, reporting, and ... Show more

Data Engineer

LyftToronto
Full-timeFull-time

At Lyft, our purpose is to serve and connect.We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive.The Safety and Customer Care (... Show more

Data Platform Engineer

XanaduToronto, Ontario, CA
Full-timeFull-time

Xanadu’s mission is to build quantum computers that are useful and available to people everywhere.At Xanadu, we are learners, innovators, researchers, collaborators and problem solvers.We are creat... Show more

Senior Data Engineer

RockstarToronto, ON, CA
Quick Apply

Rockstar is recruiting for a fast-growing, mission-driven technology company focused on workforce development.The client is dedicated to building innovative digital solutions that empower individua... Show more

Senior Data Engineer

Financial Services Regulatory Authority of OntarioToronto, ON
CA$86,379.00–CA$127,288.00 yearlyCA$86,379.00–CA$127,288.00 yearly
Full-timeFull-time

Provides senior-level data-engineering expertise and technical leadership for the design, development and operation of FSRA’s enterprise data platform.Leads the planning and delivery of complex, cr... Show more

Senior Data Engineer

Livingston InternationalToronto, ON, CA
Full-timeFull-time

Join Livingston and grow your career in the constantly changing world of international trade.Livingston is a market leader offering customs brokerage, international trade consulting, compliance and... Show more

People also ask
Big Data Engineer (PySpark / Spark / Kafka)

Big Data Engineer (PySpark / Spark / Kafka)

Astra North Infoteck Inc.Toronto, ON, ca
15 days ago
Job description

Job Description

Job Description: Big Data Engineer (PySpark / Spark / Kafka)

Work Mode: Hybrid – 3 Days a Week in Office

Job Overview

We are seeking an experienced Data Engineer with strong expertise in Big Data technologies to design, develop, and support enterprise-scale data platforms. The ideal candidate should have hands-on experience in PySpark, Apache Spark, Kafka, Hadoop ecosystem components, and Apache NiFi, along with a strong understanding of data ingestion, transformation, and real-time processing frameworks.

Key Responsibilities

  • Design, develop, and optimize scalable data pipelines using PySpark, Spark, Hadoop, and Apache NiFi.
  • Build and maintain batch and real-time data processing solutions.
  • Develop and support Kafka-based streaming applications and event-driven architectures.
  • Create and optimize ETL/ELT workflows for large-scale structured and unstructured datasets.
  • Develop complex SQL queries for data extraction, transformation, validation, and troubleshooting.
  • Implement data ingestion solutions from databases, APIs, files, and streaming sources.
  • Monitor, troubleshoot, and enhance the performance of Spark jobs and data pipelines.
  • Collaborate with architects, business analysts, and development teams to deliver high-quality data solutions.
  • Support platform upgrades, deployments, testing, certification, and production releases.
  • Ensure data quality, governance, security, and operational excellence across data platforms.

Mandatory Skills

  • PySpark
  • Apache Spark (Spark SQL, DataFrames)
  • Apache Kafka
  • Hadoop Ecosystem (HDFS, Hive, YARN)
  • Apache NiFi
  • SQL
  • Python

Preferred Skills

  • Spark Streaming
  • Airflow / Oozie
  • Hive
  • Scala
  • Jenkins, Bitbucket, Git
  • JIRA, Confluence
  • Cloud Platforms (GCP/AWS/Azure)
  • Data Warehousing Concepts and Dimensional Modeling



Requirements
Salesforce