Talent.com

Big data engineer Jobs in Etobicoke, ON

Create a job alert for this search

Big data engineer • etobicoke on

Last updated: 5 days ago

Data Engineer

Alltech Consulting ServicesMississauga
Full-time

This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems.The position calls for someone that is comfortable working wit... Show more

Data Engineer

VeemToronto, ON, CA
Full-time
Quick Apply

Role: Data Engineer Location: Fully Remote (Canada, EST time zone) Compensation: Salary + Bonus + Health Benefits About Veem Veem is transforming global money movement.Traditional cross-border paym... Show more

Data Engineer

Equitable BankToronto
Full-time

Developing of Data Pipelines (50%).Design, develop, and maintain scalable Synapse pipelines for data ingestion, processing, and transformation in Azure data platform.Develop and optimize T-SQL and ... Show more

Data Engineer

Artech LLCMISSISSAUGA, ON
Full-time

We are seeking a highly skilled and experienced Senior Engineer specializing in Information Technology.This role is crucial for managing and optimizing data processes within our organization.Requir... Show more

Data Engineer

Inizio Partners CorpToronto, ON, Canada
Remote
Full-time
Quick Apply

Job Title: Consultant Data Engineer.We're looking for a Senior Data Engineer with strong data platform experience to help with support of existing AWS/dbt platform and that can help with standing u... Show more

DevOps Data Engineer

Royal Bank of Canada>TORONTO, Canada
Full-time

Designs, develops, and optimizes data solutions, ensuring the delivery of high quality data assets, reporting, and business intelligence to support organizational objectives.Manages data engineerin... Show more

Data Engineer II

TD Bank, N.A.Toronto, Ontario
Full-time

Provide a broad range of data engineering functions including data modeling, data quality, data profiling, data acquisition and ingestion, extract transform load (ETL), metadata enrichment and mana... Show more

Senior Data Engineer – Big Data & Analytics Platforms

NearSourceToronto, ON, Canada
Full-time
Quick Apply

Job Title: Senior Data Engineer – Big Data & Analytics Platforms.Job Location: Hybrid (3 days remote), Toronto, Canada.NearSource is looking for a Senior Data Engineer to design and scale enter... Show more

PySpark Big Data Senior Developer - Vice President

08763 Citi Canada Technology Services ULCMississauga Ontario Canada
Full-time

PySpark Big Data Senior Developer to join our dynamic and focused squads.This role is for a hands-on player/coach who thrives in a high-autonomy environment, is deeply committed to leveraging AI fo... Show more

GenAI Data Engineer

Tiger Analytics Inc.Toronto, ON, CA
Remote
Full-time
Quick Apply

Tiger Analytics is a fast-growing advanced analytics consulting firm.Our consultants bring deep expertise in Data Science, Machine Learning and AI.We are the trusted analytics partner for several F... Show more

Big Data Architect

BMO Financial GroupToronto, ON Canada
Temporary

BMO is an organization driven by a shared Purpose: Boldly Grow the Good in business and life.It calls on members of its team, to create lasting, positive change for its customers, its communities, ... Show more

Data Engineer

Randstad CanadaEtobicoke, Ontario, CA
Full-time +1
Quick Apply

We are seeking a highly skilled Data Engineer for a permanent role to lead the design and implementation of robust data pipelines and advanced analytics models.In this position, you will be the bac... Show more

Data Engineer

The Toronto-Dominion Bank (Canada)Toronto, Ontario
Full-time

We are seeking a Senior Data Engineer with deep, hands-on experience in Databricks, Apache Spark, and Python to design, build, and operate scalable, secure, and analytics-ready data platforms on Mi... Show more

Senior Data Engineer

Canadian Tire Corporation, LimitedToronto, ON
Full-time

We are seeking an experienced Senior Data Engineer to join the CTC Triangle Program - Loyalty Data Product Engineering team, reporting to the Engineering Manager.Leveraging a broad range of data te... Show more

Big Data Engineer

TSX Inc.Adelaide St W,Toronto
Full-time

Venture outside the ordinary - TMX Careers.The TMX group of companies includes leading global exchanges such as the Toronto Stock Exchange, Montreal Exchange, and numerous innovative organizations ... Show more

Scala Developer with Spark, Hadoop, Big Data

Astra North Infoteck Inc.Toronto, ON, ca
Full-time

Role Descriptions: Job Title Spark Scala DeveloperJob Description We are seeking a skilled Spark Scala Developer to join our team.The ideal candidate will have experience developing data processing... Show more

Data Engineer

ScotiabankToronto, ON, CA
Full-time

Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.We are seeking a dedicated and enthusiastic Junior Developer to support automation and innovati... Show more

Sr. Data Engineer

0000050823 RBC Insurance Services Inc.MISSISSAUGA, Ontario, Canada
Full-time

RBC Insurance, through its operating entities, provides a wide range of travel, life, health, home, auto, wealth and insurance products and solutions.Also, it offers creditor and business reinsuran... Show more

Data Engineer

AutodeskToronto, ON, CAN
Full-time

Autodesk is looking for diverse engineering candidates to join Compliance team, a collection of systems and teams focused on detecting and exposing non-compliant users of Autodesk software.This is ... Show more

People also ask
Data Engineer

Data Engineer

Alltech Consulting ServicesMississauga
30+ days ago
Job type
  • Full-time
Job description

Job Description

Job Description

This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise.

Major Responsibilities:

  • Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.
  • Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data.
  • Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.
  • Proficient in developing programs in Python and SQL
  • Experience with Data warehouse Dimensional data modeling.
  • Working with event based/streaming technologies to ingest and process data.
  • Working with structured, semi structured and unstructured data.
  • Optimize Databricks jobs for performance and scalability to handle big data workloads.
  • Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
  • Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
  • Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process.
  • Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.

Skills:

  • 5+ years Python coding experience.
  • 5+ years – SQL Server based development of large datasets
  • 5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
  • Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
  • Experience in Data warehousing – OLTP, OLAP, Dimensions, Facts, and Data modeling.
  • Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
  • Experience with Cloud based data architectures, messaging, and analytics.
  • Cloud certification(s).
  • Any experience with Airflow is a Plus.

Must Have:

  • Snowflake
  • SQL
  • Python
  • ADF
  • PySpark
  • Data Warehouse Concepts