Talent.com

Hadoop developer Jobs in Toronto, ON

Create a job alert for this search

Hadoop developer • toronto on

Last updated: 2 days ago

Data Engineer – Kafka / PySpark / Hadoop

AcestackToronto, ON, Canada
Full-time
Quick Apply

Job Title:</b> Data Engineer Kafka / PySpark / Hadoop</li> <li><b>Location:</b> Toronto, ON</li> <li><b>Work Model:</b> Onsite</li> &... Show more

.Net Developer

Kumaran SystemsToronto, Ontario, Canada
Full-time

We are seeking an experienced Full Stack.NETDeveloper to design, develop, and support enterprise applications using Microsoft technologies and modern cloud platforms.The ideal candidate will have s... Show more

Software Developer

Bentley SystemsToronto, ON, CA
Full-time

A Software Developer, Subsurface Information Management is responsible for supporting the design, development, and release of software applications, components and high-performance platform service... Show more

Integration Developer

TSX Inc.Adelaide St W,Toronto
Full-time

Venture outside the ordinary - TMX Careers.The TMX group of companies includes leading global exchanges such as the Toronto Stock Exchange, Montreal Exchange, and numerous innovative organizations ... Show more

Software Developer

Sync.comToronto, ON, CA
CA$97,000.00 yearly
Full-time
Quick Apply

Sync is Canada’s largest cloud storage provider and a global leader in secure file sharing and document collaboration.We’re expanding into the enterprise market, and we need your help.J... Show more

ServiceNow Developer

ScotiabankToronto, ON, CA
Full-time

Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.Contributes to the overall success of the Information Technology & Solutions (IT&S) glo... Show more

Python Developer

GTT, LLCToronto, ON
Full-time

Hybrid 4 days per week onsite, 1 day work from home.Monday to Friday, core business hours.Our technology team builds and supports modern engineering capabilities that help deliver secure, scala... Show more

.Net Developer

Astra North Infoteck Inc.Toronto, ON, ca
Full-time
Quick Apply

Toronto, ON - Hybrid (4 Days WFO).Design, develop, implement, and maintain technical solutions supporting legacy.NET applications on Windows 10/11 and Windows Servers, including desktop application... Show more

Boomi Developer

OSI DigitalToronto, ON, CA
Full-time
Quick Apply

Job Title: Boomi Developer Role: FT Location: Toronto, Canada Job Description: Strong experience in designing and implementing EDI and A2A solutions using Boomi platform.Monitor and maintain EDI an... Show more

SR MAINFRAME DEVELOPER

Pyramid Consulting, IncToronto, ON
Full-time +1

Please review the job description below and contact me ASAP if you are interested.Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and pai... Show more

Software Developer

Talent Test AccountToronto, Ontario, CA
Full-time
Quick Apply

Show more

IOS Developer

Cloudious LLCToronto, ON, Canada
Full-time
Quick Apply

Who We Are:</b></p> <p style="margin-bottom:11px">Born digital, UST transforms lives through the power of technology.We walk alongside our clients and partners, embeddin... Show more

Software Developer

Innosystech IncToronto, ON, Canada
Full-time
Quick Apply

Job Title:</b> Software Developer - Senior</p> <p><b>Location:</b> Toronto, Ontario</p> <p><b>Work Model:</b> Onsite</p> <p><... Show more

ANDROID DEVELOPER

ITS Global[Toronto, ON], Ontario
CA$55.00–CA$65.00 hourly
Full-time

Our client is looking for an Android Developer to join their team.Must have skills required for this role.Minimum 4 years experience in Android SDK development, Mobile development with Java and Kot... Show more

JAVA Developer

Randstad CanadaToronto, Ontario, CA
Temporary
Quick Apply

Our Toronto based client is looking for a Full Stack Engineer – Java / Capital Markets to join their growing team.Work Model: Hybrid – 3 days/week in office.Build the Technology Behind Electronic T... Show more

Quantative Developer

Jay AnalytixToronto, Ontario, Canada
Full-time

Toronto, Ontario, Canada — Hybrid .We are seeking a Quantitative Developer with strong expertise in quantitative finance and advanced proficiency in Python.This role focuses on building and impleme... Show more

React Developer

FintrosToronto, Ontario, Canada
Full-time

A stealth new app created by Fintros AI is launching in September 2021.In less than 180 days, our app has attracted 150,000 jobs across 500+ companies.By 2023, our company will power the talent att... Show more

Software Developer

OceanMDToronto, ON, CA
CA$90,000.00 yearly
Full-time
Quick Apply

Join us as we change healthcare for the better.OceanMD, a WELL Health Company, is the leading provider of EMR-integrated Patient Engagement and eReferral tools in Canada, playing a critical role in... Show more

Salesforce Developer

MonerisToronto
Full-time

Your Moneris Career – The Opportunity.As a Salesforce Developer, you will help design and deliver scalable solutions across Sales Cloud, Experience Cloud, and Revenue Cloud to support key business ... Show more

Backend Developer

Royal Bank of Canada>TORONTO, Canada
Full-time

We are seeking a Software Backend Developer to work with the Retail Credit Cloud Integration team.We write Java SpringBoot microservices in an agile environment and deploy them to OpenShift Kuberne... Show more

People also ask
Data Engineer – Kafka / PySpark / Hadoop

Data Engineer – Kafka / PySpark / Hadoop

AcestackToronto, ON, Canada
2 days ago
Job type
  • Full-time
  • Quick Apply
Job description
  • Job Title: Data Engineer Kafka / PySpark / Hadoop
  • Location: Toronto, ON
  • Work Model: Onsite
  • Job Type: Full Time (FTE)

Job Description

We are seeking an experienced Data Engineer with strong hands-on expertise in Kafka, PySpark, Python, and Hadoop to design, develop, and support scalable batch and real-time data pipelines. The ideal candidate will have strong experience working with large-scale distributed data processing environments and enterprise data integration solutions.

Key Responsibilities

  • Design, develop, and maintain scalable batch and real-time data pipelines.
  • Develop data processing applications using Python and PySpark/Apache Spark.
  • Build and support Kafka-based data ingestion and streaming pipelines.
  • Work with Hadoop and related technologies to process large volumes of data.
  • Develop and maintain ETL/ELT pipelines for data ingestion, transformation, cleansing, and integration.
  • Perform data validation, reconciliation, and quality checks.
  • Troubleshoot pipeline failures, data discrepancies, and performance issues.
  • Optimize Spark/PySpark jobs and SQL queries for performance and scalability.
  • Monitor data pipelines and resolve production issues.
  • Collaborate with data architects, developers, analysts, and business teams.
  • Participate in Agile development, testing, deployment, and production support activities.

Required Skills

  • Strong hands-on experience with Python for data engineering and automation.
  • Strong expertise in PySpark / Apache Spark.
  • Hands-on experience with Apache Kafka for real-time data ingestion and streaming.
  • Strong experience with the Hadoop ecosystem and distributed data processing.
  • Strong SQL skills and experience working with large datasets.
  • Experience developing and maintaining ETL/ELT data pipelines.
  • Strong understanding of distributed computing and data processing concepts.
  • Experience with data ingestion, transformation, cleansing, and integration.
  • Strong troubleshooting and performance optimization skills.

Good to Have

  • Hive
  • Databricks
  • AWS, Azure, or GCP
  • Git and CI/CD
  • Unix/Linux
  • Airflow or Autosys
  • Relational and NoSQL databases