Talent.com

Big data engineer Jobs in Old toronto, ON

Create a job alert for this search

Big data engineer • old toronto on

Last updated: 2 days ago

Big Data Engineer (PySpark / Spark / Kafka)

Astra North Infoteck Inc.Toronto, ON, ca

Job Description: Big Data Engineer (PySpark / Spark / Kafka).Hybrid – 3 Days a Week in Office.We are seeking an experienced Data Engineer with strong expertise in Big Data technologies to desi... Show more

Senior Data Engineer

ShyftLabsToronto, , Canada, M5E 1C9
CA$140,000.00–CA$180,000.00 yearlyCA$140,000.00–CA$180,000.00 yearly

At ShyftLabs, we live and breathe data.Since 2020, we've been helping Fortune 500 companies unlock growth with cutting-edge digital solutions that transform industries and create measurable busines... Show more

Data Engineer II

TDToronto, Ontario

Provide a broad range of data engineering functions including data modeling, data quality, data profiling, data acquisition and ingestion, extract transform load (ETL), metadata enrichment and mana... Show more

Senior Data Engineer

0000050007 Royal Bank of CanadaTORONTO, Ontario, Canada
Full-timeFull-time

We are seeking a Data Engineer to build and maintain scalable data pipelines supporting enterprise analytics and reporting.The role will focus on developing ETL/ELT pipelines using Informatica and ... Show more

Data Engineer

CityliticsToronto, ON, CA
CA$90,000.00–CA$110,000.00 yearlyCA$90,000.00–CA$110,000.00 yearly
Full-timeFull-time
Quick Apply

Citylitics delivers predictive intelligence on where, how, and why infrastructure investments will occur across North America.Infrastructure includes the foundational systems that shape our quality... Show more

Data Engineer

0017 eBay Canada TechnologyToronto
CA$102,400.00 yearlyCA$102,400.00 yearly
Full-timeFull-time

Depop is a peer-to-peer circular fashion marketplace where anyone can buy, sell and discover secondhand fashion.Depop's mission is simple: to make fashion circular by making secondhand as exciting ... Show more

Senior Data Engineer

JLLToronto
RemoteRemote
Full-timeFull-time

JLL empowers you to shape a brighter way.Our people at JLL are shaping the future of real estate for a better world by combining world class services, advisory and technology for our clients.We are... Show more

Data Engineer, Lead

University of TorontoToronto, ON, CA
Full-timeFull-time

Institutional Research and Data Governance.Institutional Research and Data Governance.The University’s Institutional Research and Data Governance (IRDG) office was formally launched in 2020.In addi... Show more

Data Integration Engineer

ProphixEtobicoke, ON, CA
CA$80,000.00 yearlyCA$80,000.00 yearly
Full-timeFull-time
Quick Apply

See what you can do with Prophix.Prophix helps finance teams work with greater flexibility and confidence through Prophix One™, our Financial Performance Platform.We bring planning, reporting, and ... Show more

Data Engineer

LyftToronto

At Lyft, our purpose is to serve and connect.We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive.The Safety and Customer Care (... Show more

GenAI Data Engineer

Tiger Analytics Inc.Toronto, ON, CA
RemoteRemote
Full-timeFull-time
Quick Apply

Tiger Analytics is a fast-growing advanced analytics consulting firm.Our consultants bring deep expertise in Data Science, Machine Learning and AI.We are the trusted analytics partner for several F... Show more

Data Implementation Engineer

Odaia Intelligence Inc.Toronto, ON, CA
CA$90,000.00–CA$110,000.00 yearlyCA$90,000.00–CA$110,000.00 yearly
Quick Apply

ABOUT ODAIA ODAIA noun o·da·ia | 'oh-day-yeah An Ancient Greek word referring to "ōdē", the word for song, and the root of melody, harmony, and orchestra.We chose it deliberatel... Show more

Data Platform Engineer

XanaduToronto, Ontario, CA
Full-timeFull-time

Xanadu’s mission is to build quantum computers that are useful and available to people everywhere.At Xanadu, we are learners, innovators, researchers, collaborators and problem solvers.We are creat... Show more

Senior Data Engineer

RockstarToronto, ON, CA
Quick Apply

Rockstar is recruiting for a fast-growing, mission-driven technology company focused on workforce development.The client is dedicated to building innovative digital solutions that empower individua... Show more

Senior Data Engineer

Randstad CanadaNorth York, Ontario, CA
TemporaryTemporary
Quick Apply

Our client, is seeking an experienced, highly analytical Senior Data Engineer to join their rapidly growing Analytics team.In this high-impact role, you will design, build, and optimize scalable da... Show more

CRM Data Engineer

AGF InvestmentsToronto, ON
CA$100,000.00–CA$122,500.00 yearlyCA$100,000.00–CA$122,500.00 yearly
Full-timeFull-time

We are seeking a hands-on Data Engineer to own both the underlying CRM data foundation and the Data360 platform.The role will design, build, govern, and support scalable data models, integrations, ... Show more

Data Engineer (Data Modeling/Data Governance)

TangerineToronto, ON, CA
PermanentPermanent

Design, build, and support scalable data pipelines, data warehouses, data models, and data products.Develop cloud-based data solutions using GCP, BigQuery, Apache Airflow, Informatica, Python, and ... Show more

Senior Data Engineer

iQmetrixToronto, ON, CA
CA$110,000.00 yearlyCA$110,000.00 yearly
Quick Apply

What We do: iQmetrix is a global provider of Interconnected Commerce software solutions for telecom retail.Interconnected Commerce is an AI-native telecom commerce platform that acts as a system of... Show more

Senior Data Engineer

Livingston InternationalToronto, ON, CA
Full-timeFull-time

Join Livingston and grow your career in the constantly changing world of international trade.Livingston is a market leader offering customs brokerage, international trade consulting, compliance and... Show more

People also ask
Big Data Engineer (PySpark / Spark / Kafka)

Big Data Engineer (PySpark / Spark / Kafka)

Astra North Infoteck Inc.Toronto, ON, ca
18 days ago
Job description

Job Description

Job Description: Big Data Engineer (PySpark / Spark / Kafka)

Work Mode: Hybrid – 3 Days a Week in Office

Job Overview

We are seeking an experienced Data Engineer with strong expertise in Big Data technologies to design, develop, and support enterprise-scale data platforms. The ideal candidate should have hands-on experience in PySpark, Apache Spark, Kafka, Hadoop ecosystem components, and Apache NiFi, along with a strong understanding of data ingestion, transformation, and real-time processing frameworks.

Key Responsibilities

  • Design, develop, and optimize scalable data pipelines using PySpark, Spark, Hadoop, and Apache NiFi.
  • Build and maintain batch and real-time data processing solutions.
  • Develop and support Kafka-based streaming applications and event-driven architectures.
  • Create and optimize ETL/ELT workflows for large-scale structured and unstructured datasets.
  • Develop complex SQL queries for data extraction, transformation, validation, and troubleshooting.
  • Implement data ingestion solutions from databases, APIs, files, and streaming sources.
  • Monitor, troubleshoot, and enhance the performance of Spark jobs and data pipelines.
  • Collaborate with architects, business analysts, and development teams to deliver high-quality data solutions.
  • Support platform upgrades, deployments, testing, certification, and production releases.
  • Ensure data quality, governance, security, and operational excellence across data platforms.

Mandatory Skills

  • PySpark
  • Apache Spark (Spark SQL, DataFrames)
  • Apache Kafka
  • Hadoop Ecosystem (HDFS, Hive, YARN)
  • Apache NiFi
  • SQL
  • Python

Preferred Skills

  • Spark Streaming
  • Airflow / Oozie
  • Hive
  • Scala
  • Jenkins, Bitbucket, Git
  • JIRA, Confluence
  • Cloud Platforms (GCP/AWS/Azure)
  • Data Warehousing Concepts and Dimensional Modeling



Requirements
Salesforce