Talent.com
Acestack
Big Data Developer || Mississauga, ON (Hybrid) || Fulltime FTEAcestack • Mississauga, ON, Canada
Big Data Developer || Mississauga, ON (Hybrid) || Fulltime FTE

Big Data Developer || Mississauga, ON (Hybrid) || Fulltime FTE

Acestack • Mississauga, ON, Canada
17 hours ago
Job type
  • Full-time
  • Quick Apply
Job description
Job Title: Big Data Developer Location: Mississauga, ON
Work Model: Hybrid
Employment Type: Full-Time (FTE)
Experience: 10+ Years Job Summary: We are seeking an experienced Big Data Developer with 10+ years of expertise in designing, developing, and optimizing large-scale data processing solutions. The ideal candidate will have strong hands-on experience with the Hadoop ecosystem, Spark, Scala, Kafka, SQL, and big data technologies, along with excellent analytical and problem-solving skills. This role requires collaborating with cross-functional teams to build scalable, high-performance data pipelines and support enterprise data initiatives. Key Responsibilities
  • Design, develop, and maintain scalable big data applications and data pipelines.
  • Analyze complex business problems and translate requirements into technical solutions.
  • Develop high-performance data processing applications using Spark, Scala, Kafka, and Hadoop technologies.
  • Perform data analysis, data wrangling, and transformation on large-scale datasets.
  • Optimize application and query performance across big data platforms.
  • Troubleshoot production issues and provide timely resolution within the Cloudera Big Data ecosystem.
  • Develop and optimize SQL, Hive, and Impala queries for analytics and reporting.
  • Monitor, schedule, and maintain batch jobs using Autosys.
  • Utilize Splunk for application monitoring, log analysis, and troubleshooting.
  • Collaborate with business users, architects, and development teams to deliver high-quality solutions.
  • Follow industry best practices, coding standards, and SDLC processes.
Required Technical Skills
  • Strong experience with:
    • Apache Kafka
    • Apache Spark
    • Scala
    • SQL
    • Hive
    • Impala
    • Hadoop Ecosystem
    • Splunk
    • Autosys
  • Hands-on experience with Cloudera Big Data Platform.
  • Strong data analysis and data wrangling skills for processing high-volume datasets.
  • Experience in performance tuning, troubleshooting, and optimization of big data applications.
  • Good knowledge of Linux-based environments and shell scripting.
  • Experience working with distributed data processing systems.
Required Qualifications
  • 10+ years of experience in Big Data Development.
  • Strong analytical and problem-solving abilities.
  • Excellent verbal and written communication skills.
  • Ability to interact directly with business stakeholders.
  • Self-motivated with a strong desire to learn new technologies.
  • Ability to work effectively in a fast-paced, global team environment.
  • Flexible and capable of delivering high-quality solutions within tight deadlines.
Preferred Qualifications
  • Experience working in enterprise-scale data platforms.
  • Exposure to Agile/Scrum methodologies.
  • Experience in Banking or Financial Services domain is an advantage.
Create a job alert for this search

Big Data Developer || Mississauga, ON (Hybrid) || Fulltime FTE • Mississauga, ON, Canada

Similar jobs

Senior Developer Specializing in Big Data and Innovation

Triton DigitalMississauga, Peel Region, CA
Full-time

Join a vibrant, Agile team as a Senior Developer focused on driving innovation with Big Data technologies.Utilize your expertise in Spark and data pipeline development in a fully remote setting.Thi... Show more

 • Promoted

Senior KDB+/Q Developer (Full Time) - Canada

Saransh Incmississauga, peel region, Canada
Full-time

Location: Mississauga, ON, Canada (Onsite).We are looking for a highly skilled Senior KDB Developer to join our engineering team.The ideal candidate will have strong expertise in kdb+/q, real-time ... Show more

 • Promoted

Lead Full-Stack Data Engineer — ETL & Insights

Chord StrategyMississauga, Peel Region, CA
Full-time

A dynamic growth strategy consultancy in Metro Vancouver is seeking a Data Engineer to improve and maintain ETL processes.The ideal candidate is a leader comfortable with ambiguity and able to work... Show more

 • Promoted

Senior Data Engineer - Python, PySpark and OpenShift Lead

Compunnel, Inc.Mississauga, Peel Region, CA
Full-time

A leading data engineering firm is seeking a Data Engineer to design and maintain scalable data pipelines using Python and PySpark.This role requires managing data storage solutions, orchestrating ... Show more

 • Promoted

Data Engineer

DS Technologies IncMississauga, Peel Region, CA
Full-time

Get AI-powered advice on this job and more exclusive features.About US: We are a company that provides innovative, transformative IT services and solutions.We are passionate about helping our clien... Show more

 • Promoted

Data Engineer for Tech Solutions Firm

Invictus DirectMississauga, Peel Region, CA
Part-time

Support a tech consulting agency as a remote Data Engineer in this part-time role.Drive data integration efforts essential for operational efficiency and AI solutions.This role requires a Data Engi... Show more

 • Promoted

Senior Data Engineer: Build Robust Data Pipelines & Cloud

F. Hoffmann-La Roche GruppeMississauga, Peel Region, CA
Full-time

A global healthcare company based in Mississauga is seeking a Senior Data Engineer to enhance and develop data pipelines.The ideal candidate will have 5+ years of experience, with expertise in Pyth... Show more

 • Promoted

Senior Data Engineer — Remote Canada (Snowflake DW)

Infostrux Solutions Inc.Mississauga, Peel Region, CA
Remote
Full-time

A leading data consultancy in Canada seeks a Senior Data Engineer to guide customers in building cloud-based data warehouses using Snowflake.The role involves data ingestion, transformation, and op... Show more

 • Promoted

Data Engineer with Pipeline Expertise

REDPATH MININGVaughan, ON, CA
Full-time

Step into a vital role as a Data Engineer at Redpath, tasked with building data pipelines that facilitate enterprise analytics and reporting.This role is pivotal in adapting to dynamic project need... Show more

 • Promoted

Capital Markets Bigdata/ Sql Developer

Open Systems TechnologiesMississauga, Peel Region, CA
Full-time

We are looking for a Capital Markets Big Data/SQL Developer for a hybrid contract role in Mississauga.If you possess all the required skills, please apply with an updated resume and contact details... Show more

 • Promoted

Senior Data Engineer

Insight Globalvaughan, york region, Canada
Full-time

This Senior Data Engineer will be responsible for designing, building, and optimizing high-performance data pipelines and platforms within a Databricks and AWS environment.The team is currently in ... Show more

 • Promoted

Data Engineer

JLI Consulting Talent SearchVaughan, York Region, CA
Full-time

Do you love making sure that information is accessible and easy to use? So do we.You are a data engineer who knows how to find, store and present a range of information from.As a Data Engineer, you... Show more

 • Promoted

Senior Big Data Engineer: Spark & SQL | Mississauga Hybrid

AccuroMississauga, Peel Region, CA
Full-time

A leading technology firm in Mississauga is seeking a Big Data Engineer with strong SQL skills and extensive experience in Apache Hadoop and Spark.As part of a hybrid work environment, you will be ... Show more

 • Promoted

Senior Full-Stack Developer in Mississauga

SOTI IncMississauga
Full-time

Transform user experiences as a Senior Full-Stack Developer at SOTI, working in a hybrid model from Mississauga.Lead the charge in developing scalable applications with a focus on excellence.This p... Show more

 • Promoted

Senior Data Engineer - Microsoft Fabric & Data Pipelines

LGS, an IBM CompanyMississauga
Full-time

An innovative technology firm in Mississauga is seeking a Senior Data Engineer to design and build scalable data pipelines within Microsoft Fabric.This role contributes to major digital transformat... Show more

 • Promoted

Data Engineer

ALLTECH CONSULTING SVC INCMississauga
Full-time

This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems.The position calls for someone that is comfortable working wit... Show more

 • Promoted

Mississauga Senior Full Stack Developer

TalentSphere Staffing SolutionsMississauga
Full-time

Expand your skills as a Senior Full Stack Developer based in Mississauga, ON, contributing to an innovative cloud-native platform focused on Industrial IoT.This hands-on position blends modern web ... Show more

 • Promoted

Senior Data & Analytics Engineer

WagepointMississauga, Peel Region, CA
Full-time

Senior Data & Analytics Engineer.This range is provided by Wagepoint.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.At Wagepoint, we’re good pe... Show more

 • Promoted

Data Engineer

TalentOlaMississauga
Full-time

Data Engineer/ Python Developer.Design, develop, and maintain software solutions using Python.Develop Python and pyspark programs for data analysis.Good working experience with Python to develop a ... Show more

 • Promoted

Remote Data Engineer Focused on Scalable ETL and Client Solutions

ShyftLabsMississauga, Peel Region, CA
Remote
Full-time

Transform enterprise data challenges as a versatile Data Engineer.Engage directly with clients while developing robust ETL pipelines and data infrastructures for effective analytics and reporting.T... Show more