Talent.com
Data Engineer
Data EngineerInfinity Arc Technologies • Mississauga (YYZ), ON, Ontario, Canada
Data Engineer

Data Engineer

Infinity Arc Technologies • Mississauga (YYZ), ON, Ontario, Canada
2 hours ago
Job type
  • Full-time
Job description

Job Title :   Data Engineer

Missisauga,Canada

Fulltime

Mandatory Skills : Python, Spark

Pyspark Must

Responsibilities :

  • Design, develop, and maintain software solutions using  Python .
  • Developed Python and pyspark programs for data analysis.. Good working experience with python to develop Custom Framework for generating of rules (just like rules engine).
  • Developed Python code to gather the data from HBase and designs the solution to implement using Pyspark. Apache Spark DataFrames / RDD's were used to apply business transformations and utilized Hive Context objects to perform read / write operations..
  • Develop back-end services, APIs, and integrate databases.
  • Optimize applications for performance, security, and maintainability.
  • Troubleshoot and resolve software defects and issues.

Required Skills :

  • Strong proficiency in  Python and Spark .
Create a job alert for this search

Data Engineer • Mississauga (YYZ), ON, Ontario, Canada

Similar jobs

Azure Databricks Engineer

Tredence Inc.mississauga, on, ca
Full-time

We are seeking a skilled Azure Databricks Engineer with strong experience in Azure Data Factory (ADF) to design, develop, and maintain scalable data pipelines and analytics solutions on the Azure c...Show more

 • Promoted

Senior Data Engineer (Hadoop + GCP Dataproc) - mississauga

TechDoQuestmississauga, on, ca
Full-time

Hadoop ecosystem, with deep expertise in Hive, Hive Metastore, and GCP Dataproc.Strong hands-on experience with Dataproc Serverless, BigQuery, Google Cloud Storage (GCS), Cloud Composer, and Cloud ...Show more

 • Promoted

Data Engineer

ALLTECH CONSULTING SVC INCMississauga, Peel Region, CA
Full-time

This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems.The position calls for someone that is comfortable working wit...Show more

 • Promoted

Senior Data Engineer: Data Pipelines & Cloud

RocheMississauga, Peel Region, CA
Full-time

A global healthcare company is seeking a Senior Data Engineer in Mississauga.In this role, you will work with an Agile team to develop and maintain data pipelines and management systems.Ideal candi...Show more

 • Promoted

Senior Data Engineer (Databricks experience is a must) - Dawn InfoTek

Dawn InfoTekmississauga, on, ca
Full-time

IT consulting firm that partners with major financial institutions, investment firms, and government organizations.We are dedicated to delivering cutting-edge consulting services and recruiting top...Show more

 • Promoted • New!

Data Engineer

AccuroMississauga, Peel Region, CA
Full-time +1

Job Title: Big Data Engineer with Strong SQL Exp.Location: Mississauga, ON (Hybrid/ 03 days onsite).Strong Experience in Apache Hadoop, Spark, Spark SQL, Hive, Impala, Yam, Talend.Have strong exper...Show more

 • Promoted

Data Engineer

Mphasismississauga, on, ca
Full-time

This role is a great opportunity to grow into a subject matter expert in data management and database optimization within a cloud-based, high-scale environment.You’ll be working alongside a team of...Show more

 • Promoted

Data Engineer Python/PySpark/OpenShift

Compunnel, Inc.Mississauga, Peel Region, CA
Full-time

The Data Engineer will design, develop, and maintain scalable data pipelines and workflows using Python, PySpark, and cloud technologies.This role involves managing data storage solutions, orchestr...Show more

 • Promoted

Sr. Azure Data engineer - mississauga

Cognizantmississauga, on, ca
Full-time

Location - Remote- US or Canada.Technical Skills- DataBricks, Unity Catalog, Hive -- is mandatory.MUST HAVE - 5 + years of experience.Hive Metastore to Unity Catalog.Unity Catalog–compliant access ...Show more

 • Promoted • New!

GCP Data Engineer

Tata Consultancy Servicesmississauga, on, ca
Full-time

Tata Consultancy Services (TCS) is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to c...Show more

 • Promoted

Data Engineer for Advanced Cloud Solutions and Data Processing

CovetusMississauga, Peel Region, CA
Full-time

Join us as a Data Engineer, where your expertise in data processing and cloud platforms will shine.Design, build, and optimize data pipelines to support critical analytics and business strategies.T...Show more

 • Promoted

Lead Data Engineer

Launch PotatoMississauga, Peel Region, CA
Full-time

As The Discovery and Conversion Company, our mission is to connect consumers with the world’s leading brands through data-driven content and technology.Headquartered in South Florida with a remote-...Show more

 • Promoted

Big Data Engineer

KTek ResourcingMississauga, Peel Region, CA
Full-time

Required Skills, Experience and Qualifications:.Banking/Capital Markets Domain - Good to have.Experience in Big data technologies, real-time data processing platform (Spark Streaming) experience wo...Show more

 • Promoted

Tech Lead, Data Platform Engineer

COMPASS GROUP CANADAMississauga, Peel Region, CA
Full-time +1

We are CDAI—the data and artificial intelligence engine of Compass Group North America.We design and deliver custom, in-house solutions tailored to the unique complexities of food service and hospi...Show more

 • Promoted

Senior Data Engineer

WellnessLivingVaughan, York Region, CA
Permanent

Based on experience + Benefits + Vacation.At WellnessLiving, we empower thousands of health and wellness business owners to turn their entrepreneurial dreams into reality.Our mission‑critical softw...Show more

 • Promoted

Data Engineer -- Data Bricks

Acunorbrampton, on, ca
Full-time

We are looking for a Data Engineer with strong experience in Databricks and Azure cloud to build scalable data pipelines and support data driven solutions in an insurance environment.Develop and op...Show more

 • Promoted • New!

Innovative Data Engineer Specializing in Azure and ETL Solutions

ApptadMississauga, Peel Region, CA
Full-time

Become a vital part of our data-driven team as a Data Engineer.Bring your expertise in SQL and Azure cloud solutions to design scalable data architectures that empower analytics.This position requi...Show more

 • Promoted

Senior Data Engineer

TJX CANADAMississauga, Peel Region, CA
Full-time

TJX is an exciting place to work and we count on our Associates to bring our business to life.Staying true to our open, collaborative culture and values of honesty, integrity, and treating each oth...Show more