Talent.com
Alltech Consulting Services
Data EngineerAlltech Consulting Services • Mississauga
Data Engineer

Data Engineer

Alltech Consulting Services • Mississauga
30+ days ago
Job type
  • Full-time
Job description

Job Description

Job Description

This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise.

Major Responsibilities:

  • Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.
  • Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data.
  • Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.
  • Proficient in developing programs in Python and SQL
  • Experience with Data warehouse Dimensional data modeling.
  • Working with event based/streaming technologies to ingest and process data.
  • Working with structured, semi structured and unstructured data.
  • Optimize Databricks jobs for performance and scalability to handle big data workloads.
  • Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
  • Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
  • Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process.
  • Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.

Skills:

  • 5+ years Python coding experience.
  • 5+ years – SQL Server based development of large datasets
  • 5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
  • Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
  • Experience in Data warehousing – OLTP, OLAP, Dimensions, Facts, and Data modeling.
  • Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
  • Experience with Cloud based data architectures, messaging, and analytics.
  • Cloud certification(s).
  • Any experience with Airflow is a Plus.

Must Have:

  • Snowflake
  • SQL
  • Python
  • ADF
  • PySpark
  • Data Warehouse Concepts
Create a job alert for this search

Data Engineer • Mississauga

Similar jobs

Data Engineer

ALLTECH CONSULTING SVC INCMississauga, Peel Region, CA
Full-time

This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems.The position calls for someone that is comfortable working wit... Show more

 • Promoted

Staff Software Engineer: AI-Powered Data Platform Architect

AlphaSenseMississauga, Peel Region, CA
Full-time

A leading market intelligence firm in Canada is seeking an experienced individual to own the architecture of a large-scale data extraction platform.The role involves designing high-reliability syst... Show more

 • Promoted

Data Warehouse Support Engineer - SQL, Python & AI

CAA Club GroupVaughan, York Region, CA
Full-time

A leading member-based organization is looking for a candidate to assist with troubleshooting application system issues and lead various projects.Candidates must have at least 1 year of experience ... Show more

 • Promoted

Remote AI Data Quality & Evaluation Engineer

Veeva SystemsMississauga, Peel Region, CA
Remote
Full-time

A leading cloud technology company in Toronto is seeking an experienced professional to validate and ensure the reliability of Veeva AI Agents.The ideal candidate should have expertise in data qual... Show more

 • Promoted

Data Engineer - Contractor

LGS, an IBM CompanyMississauga, Peel region, Canada
Permanent

At LGS, we strive to provide a workplace that values your professional growth.Our company culture fosters diversity and inclusivity, and we welcome talents from both local and international backgro... Show more

 • Promoted

Data Engineer

GFL Environmental Inc.Vaughan, York region, Canada
Full-time

Ready to elevate your career? GFL is expanding! We are officially hunting for our next Data Engineer in Vaughan, ON—someone ready to bring fresh ideas and grow alongside a dynamic team.GFL is one o... Show more

 • Promoted

Remote Data Engineer Role at HIVERY

HiveryMississauga, Peel Region, CA
Remote
Full-time

Enhance your career as a Data Engineer with HIVERY, focusing on advanced AI tools in a remote setting.Your expertise in Python or Go will drive improvements in our retail solutions.HIVERY, a startu... Show more

 • Promoted

Full-stack Data Engineer (Remote)

Chord StrategyMississauga, Peel Region, CA
Remote
Full-time

The Battle of Giants exists to answer a simple but important question:.Will a company’s strategy lead to growth?.We do this to help investors and corporate execs assess a company’s growth potential... Show more

 • Promoted

Remote Platform Engineer — Cloud, Kubernetes & Data

RealmMississauga, Peel Region, CA
Remote
Full-time

A forward-thinking technology company is seeking a Platform Engineer to design, build, and maintain infrastructure for a data platform used by developers worldwide.This fully remote position requir... Show more

 • Promoted

Data Engineer

JLI Consulting Talent SearchVaughan, York Region, CA
Full-time

Do you love making sure that information is accessible and easy to use? So do we.You are a data engineer who knows how to find, store and present a range of information from.As a Data Engineer, you... Show more

 • Promoted

Big Data Engineer

KTek ResourcingMississauga, Peel Region, CA
Full-time

Required Skills, Experience and Qualifications:.Banking/Capital Markets Domain - Good to have.Experience in Big data technologies, real-time data processing platform (Spark Streaming) experience wo... Show more

 • Promoted

Remote Data Engineer for Cyber Security & AI Pipelines

Coalition, Inc.Mississauga, Peel Region, CA
Remote
Full-time

A leading cybersecurity company in Canada is seeking a Data Engineer to develop and manage a data platform for Cyber Security operations.This role involves designing robust data models, building sc... Show more

 • Promoted

Python & Kubernetes Data Engineer for AI/ML Analytics

CanonicalMississauga, Peel region, Canada
Full-time

Join a pioneering tech firm at the forefront of the open-source movement.As a Python and Kubernetes Software Engineer, you'll develop cutting-edge data analytics solutions using popular machine lea... Show more

 • Promoted

Data Engineer

AltimetrikMississauga
Full-time

Direct message the job poster from Altimetrik.Design, develop, and maintain software solutions using Python.Design, develop, and maintain software solutions using.Develop Python and pyspark program... Show more

 • Promoted

Senior Data Engineer

IKO North AmericaMississauga
Full-time

IKO is a Canadian owned and operated business with production facilities worldwide and has many years of unparalleled success in the roofing materials industry.Quality, integrity, and trustworthine... Show more

 • Promoted

Senior Engineer for Data Solutions at Confluent

ConfluentMississauga, Peel Region, CA
Full-time

Contribute to revolutionary data management solutions at Confluent as a Senior Engineer.In this role, you will enhance Kora, the next-gen cloud-native event streaming platform focused on real-time ... Show more

 • Promoted

Senior Data & Analytics Engineer

WagepointMississauga, Peel Region, CA
Full-time

Senior Data & Analytics Engineer.This range is provided by Wagepoint.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.At Wagepoint, we’re good pe... Show more

 • Promoted

Backend Data Engineer – Lakeflow & Job Development

Buchanan TechnologiesMississauga, Peel Region, CA
Full-time

Backend Data Engineer – Lakeflow & Job Development.Contract – 6 months and for possible extensions.Canadian Citizen/Permanent Resident only.The Backend Data Engineer is responsible for designing, b... Show more

 • Promoted

Advanced Data Engineer for Large Datasets and ETL Pipelines

LumenaltaMississauga, Peel region, Canada
Full-time

Transform data into insights as an Advanced Data Engineer specializing in complex ETL pipelines.Embrace this remote opportunity to use your Python or Java and SQL skills effectively.This role invit... Show more

 • Promoted

Data Engineer

REDPATH MININGVaughan, Ontario, Canada
Full-time

The Data Engineer is a core member of the Connected Data team, responsible for building and maintaining data pipelines and datasets that support enterprise reporting and analytics.Working within a ... Show more