Talent.com

Hadoop developer Jobs in Toronto, ON

Create a job alert for this search

Hadoop developer • toronto on

Last updated: 23 hours ago

Data Engineer – Kafka / PySpark / Hadoop

AcestackToronto, ON, Canada
Full-time
Quick Apply

Job Title:</b> Data Engineer Kafka / PySpark / Hadoop</li> <li><b>Location:</b> Toronto, ON</li> <li><b>Work Model:</b> Onsite</li> &... Show more

ServiceNow Developer

Randstad CanadaToronto, Ontario, CA
Temporary
Quick Apply

We are looking for a ServiceNow Developer to join our team in Toronto.This is a 1-year contract with a possible 1-year extension.The successful candidate will play a key role in developing and supp... Show more

Integration Developer

TSX Inc.Adelaide St W,Toronto
Full-time

Venture outside the ordinary - TMX Careers.The TMX group of companies includes leading global exchanges such as the Toronto Stock Exchange, Montreal Exchange, and numerous innovative organizations ... Show more

Software Developer

Bentley SystemsToronto, ON, CA
Full-time

A Software Developer, Subsurface Information Management is responsible for supporting the design, development, and release of software applications, components and high-performance platform service... Show more

Android Developer

Astra North Infoteck Inc.Toronto, ON, ca
Full-time

Android Developer – Kotlin, Jetpack Compose & Android Studio.Schedule: 3 days onsite per week (Tuesday-Thursday).We are seeking an experienced Android Developer with 6-8 years of mobile applica... Show more

ServiceNow Developer

ScotiabankToronto, ON, CA
Full-time

Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.Contributes to the overall success of the Information Technology & Solutions (IT&S) glo... Show more

Software Developer

Sync.comToronto, ON, CA
CA$97,000.00 yearly
Full-time
Quick Apply

Sync is Canada’s largest cloud storage provider and a global leader in secure file sharing and document collaboration.We’re expanding into the enterprise market, and we need your help.J... Show more

Boomi Developer

OSI DigitalToronto, ON, CA
Full-time
Quick Apply

Job Title: Boomi Developer Role: FT Location: Toronto, Canada Job Description: Strong experience in designing and implementing EDI and A2A solutions using Boomi platform.Monitor and maintain EDI an... Show more

Software Developer

Talent Test AccountToronto, Ontario, CA
Full-time
Quick Apply

Show more

IOS Developer

Cloudious LLCToronto, ON, Canada
Full-time
Quick Apply

Who We Are:</b></p> <p style="margin-bottom:11px">Born digital, UST transforms lives through the power of technology.We walk alongside our clients and partners, embeddin... Show more

Software Developer

Innosystech IncToronto, ON, Canada
Full-time
Quick Apply

Job Title:</b> Software Developer - Senior</p> <p><b>Location:</b> Toronto, Ontario</p> <p><b>Work Model:</b> Onsite</p> <p><... Show more

ANDROID DEVELOPER

ITS Global[Toronto, ON], Ontario
CA$55.00–CA$65.00 hourly
Full-time

Our client is looking for an Android Developer to join their team.Must have skills required for this role.Minimum 4 years experience in Android SDK development, Mobile development with Java and Kot... Show more

Software Developer

OceanMDToronto, ON, CA
CA$90,000.00 yearly
Full-time
Quick Apply

Join us as we change healthcare for the better.OceanMD, a WELL Health Company, is the leading provider of EMR-integrated Patient Engagement and eReferral tools in Canada, playing a critical role in... Show more

React Developer

FintrosToronto, Ontario, Canada
Full-time

A stealth new app created by Fintros AI is launching in September 2021.In less than 180 days, our app has attracted 150,000 jobs across 500+ companies.By 2023, our company will power the talent att... Show more

Android Developer

S.i. SystemsToronto
Full-time

We are working with the Digital Android team of a Tier 1 bank to build and expand their online mobile banking capabilities.Experience developing Android Library.Experience developing multi-threaded... Show more

Quantative Developer

Jay AnalytixToronto, Ontario, Canada
Full-time

Toronto, Ontario, Canada — Hybrid .We are seeking a Quantitative Developer with strong expertise in quantitative finance and advanced proficiency in Python.This role focuses on building and impleme... Show more

Application Developer

Livingston InternationalToronto, ON, CA
Full-time

Join Livingston and grow your career in the constantly changing world of international trade.Livingston is a market leader offering customs brokerage, international trade consulting, compliance and... Show more

Backend Developer

Royal Bank of Canada>TORONTO, Canada
Full-time

We are seeking a Software Backend Developer to work with the Retail Credit Cloud Integration team.We write Java SpringBoot microservices in an agile environment and deploy them to OpenShift Kuberne... Show more

Java Developer

Magnum HuntToronto
CA$65,000.00–CA$75,000.00 yearly
Permanent

Experience developing sophisticated enterprise web-based applications using Java based OO technologies.Strong database experience – MSSQL, Oracle, SQL, Hibernate.Strong working knowledge of HTML, J... Show more

Lead iOS Developer

hireVouchToronto, Ontario, USA
Full-time

You will learn and adopt best practices like writing clean and reusable code using practices like TDD, mobile architecture patterns, design, and pair programming.You will use and advocate for conti... Show more

People also ask
Data Engineer – Kafka / PySpark / Hadoop

Data Engineer – Kafka / PySpark / Hadoop

AcestackToronto, ON, Canada
23 hours ago
Job type
  • Full-time
  • Quick Apply
Job description
  • Job Title: Data Engineer Kafka / PySpark / Hadoop
  • Location: Toronto, ON
  • Work Model: Onsite
  • Job Type: Full Time (FTE)

Job Description

We are seeking an experienced Data Engineer with strong hands-on expertise in Kafka, PySpark, Python, and Hadoop to design, develop, and support scalable batch and real-time data pipelines. The ideal candidate will have strong experience working with large-scale distributed data processing environments and enterprise data integration solutions.

Key Responsibilities

  • Design, develop, and maintain scalable batch and real-time data pipelines.
  • Develop data processing applications using Python and PySpark/Apache Spark.
  • Build and support Kafka-based data ingestion and streaming pipelines.
  • Work with Hadoop and related technologies to process large volumes of data.
  • Develop and maintain ETL/ELT pipelines for data ingestion, transformation, cleansing, and integration.
  • Perform data validation, reconciliation, and quality checks.
  • Troubleshoot pipeline failures, data discrepancies, and performance issues.
  • Optimize Spark/PySpark jobs and SQL queries for performance and scalability.
  • Monitor data pipelines and resolve production issues.
  • Collaborate with data architects, developers, analysts, and business teams.
  • Participate in Agile development, testing, deployment, and production support activities.

Required Skills

  • Strong hands-on experience with Python for data engineering and automation.
  • Strong expertise in PySpark / Apache Spark.
  • Hands-on experience with Apache Kafka for real-time data ingestion and streaming.
  • Strong experience with the Hadoop ecosystem and distributed data processing.
  • Strong SQL skills and experience working with large datasets.
  • Experience developing and maintaining ETL/ELT data pipelines.
  • Strong understanding of distributed computing and data processing concepts.
  • Experience with data ingestion, transformation, cleansing, and integration.
  • Strong troubleshooting and performance optimization skills.

Good to Have

  • Hive
  • Databricks
  • AWS, Azure, or GCP
  • Git and CI/CD
  • Unix/Linux
  • Airflow or Autosys
  • Relational and NoSQL databases