Talent.com
Alltech Consulting Services
Data EngineerAlltech Consulting Services • Mississauga
Data Engineer

Data Engineer

Alltech Consulting Services • Mississauga
30+ days ago
Job type
  • Full-time
Job description

Job Description

Job Description

This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise.

Major Responsibilities:

  • Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.
  • Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data.
  • Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.
  • Proficient in developing programs in Python and SQL
  • Experience with Data warehouse Dimensional data modeling.
  • Working with event based/streaming technologies to ingest and process data.
  • Working with structured, semi structured and unstructured data.
  • Optimize Databricks jobs for performance and scalability to handle big data workloads.
  • Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
  • Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
  • Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process.
  • Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.

Skills:

  • 5+ years Python coding experience.
  • 5+ years – SQL Server based development of large datasets
  • 5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
  • Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
  • Experience in Data warehousing – OLTP, OLAP, Dimensions, Facts, and Data modeling.
  • Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
  • Experience with Cloud based data architectures, messaging, and analytics.
  • Cloud certification(s).
  • Any experience with Airflow is a Plus.

Must Have:

  • Snowflake
  • SQL
  • Python
  • ADF
  • PySpark
  • Data Warehouse Concepts
Create a job alert for this search

Data Engineer • Mississauga

Similar jobs

Data Engineer for Tech Solutions Firm

Invictus DirectMississauga, Peel Region, CA
Part-time

Support a tech consulting agency as a remote Data Engineer in this part-time role.Drive data integration efforts essential for operational efficiency and AI solutions.This role requires a Data Engi... Show more

 • Promoted

Data Engineer

ALLTECH CONSULTING SVC INCMississauga, Peel Region, CA
Full-time

This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems.The position calls for someone that is comfortable working wit... Show more

 • Promoted

Data Engineer Role: Python & Pyspark Focus

VeriiproMississauga, Peel Region, CA
Full-time

Harness your skills in Python and Pyspark as a Data Engineer.This role emphasizes your experience in software solutions and backend services to streamline data operations.We are looking for someone... Show more

 • Promoted

BI Data Engineer

Lakefield Veterinary Groupburlington, halton region, Canada
Full-time

The Data Analyst position is responsible for the collection and analysis of data to support strategic initiatives and operational decision making.This position will work closely with business stake... Show more

 • Promoted

Senior Data Engineer: Build Scalable Data Platform for ML

MyprosperaMississauga, Peel Region, CA
Full-time

A wealth management technology firm is seeking a Senior Data Engineer to architect and build data infrastructure from scratch.The role requires 5+ years of experience in cloud data warehouses, espe... Show more

 • Promoted

Senior Data Engineer: Build Robust Data Pipelines & Cloud

F. Hoffmann-La Roche GruppeMississauga, Peel Region, CA
Full-time

A global healthcare company based in Mississauga is seeking a Senior Data Engineer to enhance and develop data pipelines.The ideal candidate will have 5+ years of experience, with expertise in Pyth... Show more

 • Promoted

Senior Data Engineer — Remote Canada (Snowflake DW)

Infostrux Solutions Inc.Mississauga, Peel Region, CA
Remote
Full-time

A leading data consultancy in Canada seeks a Senior Data Engineer to guide customers in building cloud-based data warehouses using Snowflake.The role involves data ingestion, transformation, and op... Show more

 • Promoted

Remote Data Engineer Role at HIVERY

HiveryMississauga, Peel Region, CA
Remote
Full-time

Enhance your career as a Data Engineer with HIVERY, focusing on advanced AI tools in a remote setting.Your expertise in Python or Go will drive improvements in our retail solutions.HIVERY, a startu... Show more

 • Promoted

Full-stack Data Engineer (Remote)

Chord StrategyMississauga, Peel Region, CA
Remote
Full-time

The Battle of Giants exists to answer a simple but important question:.Will a company’s strategy lead to growth?.We do this to help investors and corporate execs assess a company’s growth potential... Show more

 • Promoted

Senior Data Engineer

Insight Globalvaughan, york region, Canada
Full-time

This Senior Data Engineer will be responsible for designing, building, and optimizing high-performance data pipelines and platforms within a Databricks and AWS environment.The team is currently in ... Show more

 • Promoted

Data Engineer Role in Alberta’s Digital Division

PathlionMississauga, Peel Region, CA
Full-time

Be part of Alberta's digital transformation as a Data Engineer.Contribute to innovative projects by creating data pipelines and deriving insights that meet the needs of citizens.As a core member of... Show more

 • Promoted

Data Engineer

JLI Consulting Talent SearchVaughan, York Region, CA
Full-time

Do you love making sure that information is accessible and easy to use? So do we.You are a data engineer who knows how to find, store and present a range of information from.As a Data Engineer, you... Show more

 • Promoted

Lead Data Engineer Innovating Healthcare Data Architecture

Synthesis HealthMississauga, Peel Region, CA
Full-time

Drive data engineering excellence as a Staff Data Engineer and help transform healthcare data practices.Spearhead architecture optimizations and educate teams in a fully remote role.As a leader in ... Show more

 • Promoted

Senior Data Engineer - Data Governance & Platform Lead

XsollaMississauga, Peel Region, CA
Full-time

A global commerce company in Canada is seeking a Data Engineer to lead efforts in building and optimizing the User Platform and Recommendation Engine.The role involves ensuring data accuracy and pe... Show more

 • Promoted

Azure Data Engineer: Fabric Pipelines & Data Models

Symbiotic GroupMississauga, Peel Region, CA
Full-time

A leading IT consulting firm is looking for an experienced Azure Data Engineer to build and manage a scalable data integration platform.The successful candidate will work on Microsoft Fabric to des... Show more

 • Promoted

Big Data Engineer

KTek ResourcingMississauga, Peel Region, CA
Full-time

Required Skills, Experience and Qualifications:.Banking/Capital Markets Domain - Good to have.Experience in Big data technologies, real-time data processing platform (Spark Streaming) experience wo... Show more

 • Promoted

Data Engineer

BorrowellMississauga, Peel Region, CA
Full-time

At Borrowell, we're on a mission to help Canadians feel confident about their money.We empower individuals to take control of their financial futures by providing the tools and insights needed to u... Show more

 • Promoted

Senior Data & Analytics Engineer

WagepointMississauga, Peel Region, CA
Full-time

Senior Data & Analytics Engineer.This range is provided by Wagepoint.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.At Wagepoint, we’re good pe... Show more

 • Promoted

Backend Data Engineer – Lakeflow & Job Development

Buchanan TechnologiesMississauga, Peel Region, CA
Full-time

Backend Data Engineer – Lakeflow & Job Development.Contract – 6 months and for possible extensions.Canadian Citizen/Permanent Resident only.The Backend Data Engineer is responsible for designing, b... Show more

 • Promoted

Remote Data Engineer Focused on Scalable ETL and Client Solutions

ShyftLabsMississauga, Peel Region, CA
Remote
Full-time

Transform enterprise data challenges as a versatile Data Engineer.Engage directly with clients while developing robust ETL pipelines and data infrastructures for effective analytics and reporting.T... Show more