Talent.com

Big data engineer Jobs in Etobicoke, ON

Create a job alert for this search

Big data engineer • etobicoke on

Last updated: 4 days ago

Data Engineer

Alltech Consulting ServicesMississauga
Full-time

This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems.The position calls for someone that is comfortable working wit...Show more

Data Engineer

VeemToronto, ON, CA
Full-time
Quick Apply

Role: Data Engineer Location: Fully Remote (Canada, EST time zone) Compensation: Salary + Bonus + Health Benefits About Veem Veem is transforming global money movement.Traditional cross-border paym...Show more

Lead, Data Engineer

MCKESSONMISSISSAUGA, Ontario, Canada
Full-time

McKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare.We are known for delivering insights, products, and services that make quality care more accessibl...Show more

Data Engineer

Inizio Partners CorpToronto, ON, Canada
Remote
Full-time
Quick Apply

Job Title: Consultant Data Engineer.We're looking for a Senior Data Engineer with strong data platform experience to help with support of existing AWS/dbt platform and that can help with standing u...Show more

Senior Data Engineer

0000050007 Royal Bank of CanadaTORONTO, Ontario, Canada
Full-time

RBC’s Data Analytics and Insights Team is responsible for developing and implementing automated processes, creating applications, and building dashboards to assist in decision making.We work alongs...Show more

Senior Data Engineer – Big Data & Analytics Platforms

NearSourceToronto, ON, Canada
Full-time
Quick Apply

Job Title: Senior Data Engineer – Big Data & Analytics Platforms.Job Location: Hybrid (3 days remote), Toronto, Canada.NearSource is looking for a Senior Data Engineer to design and scale enterpris...Show more

PySpark Big Data Senior Developer - Vice President

08763 Citi Canada Technology Services ULCMississauga Ontario Canada
Full-time

PySpark Big Data Senior Developer to join our dynamic and focused squads.This role is for a hands-on player/coach who thrives in a high-autonomy environment, is deeply committed to leveraging AI fo...Show more

Data Integration Engineer

ProphixEtobicoke, ON, CA
Full-time
Quick Apply

See what you can do with Prophix.Prophix helps finance teams work with greater flexibility and confidence through Prophix One™, our Financial Performance Platform.We bring planning, reporting, and ...Show more

Big Data Architect

BMO Financial GroupToronto, ON Canada
Temporary

BMO is an organization driven by a shared Purpose: Boldly Grow the Good in business and life.It calls on members of its team, to create lasting, positive change for its customers, its communities, ...Show more

Data Engineer

Artech LLCToronto, ON
Full-time

Location: Toronto, ON/Onsite .Pay Rate - T4 - 55 | INC - 64.We are seeking a skilled and experienced Data Engineer to join our team in Toronto.The ideal candidate will be responsible for managing a...Show more

Data Engineer

Foresters FinancialToronto
Full-time

Develop and optimize high-performance, end-to-end data transformation and reporting solutions using PySpark, Spark SQL, and T-SQL within cloud-native environments like Databricks.Architect and impl...Show more

Data Engineer

The Toronto-Dominion Bank (Canada)Toronto, Ontario
Full-time

We are seeking a Senior Data Engineer with deep, hands-on experience in Databricks, Apache Spark, and Python to design, build, and operate scalable, secure, and analytics-ready data platforms on Mi...Show more

Senior Data Engineer

Munich ReCanada (Life), Toronto
Full-time

As a Senior Data Engineer, you will be responsible for building and maintaining robust data integration and transformation solutions that support financial and regulatory reporting, including IFRS1...Show more

Senior Data Engineer

Canadian Tire Corporation, LimitedToronto, ON
Full-time

We are seeking an experienced Senior Data Engineer to join the CTC Triangle Program - Loyalty Data Product Engineering team, reporting to the Engineering Manager.Leveraging a broad range of data te...Show more

Big Data Engineer

TSX Inc.Adelaide St W,Toronto
Full-time

Venture outside the ordinary - TMX Careers.The TMX group of companies includes leading global exchanges such as the Toronto Stock Exchange, Montreal Exchange, and numerous innovative organizations ...Show more

Scala Developer with Spark, Hadoop, Big Data

Astra North Infoteck Inc.Toronto, ON, ca
Full-time

Role Descriptions: Job Title Spark Scala DeveloperJob Description We are seeking a skilled Spark Scala Developer to join our team.The ideal candidate will have experience developing data processing...Show more

Data Engineer

ScotiabankToronto, ON, CA
Full-time

Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.We are seeking a dedicated and enthusiastic Junior Developer to support automation and innovati...Show more

Data Engineer

Randstad CanadaEtobicoke, Ontario, CA
Full-time +1
Quick Apply

We are seeking a highly skilled Data Engineer for a permanent role to lead the design and implementation of robust data pipelines and advanced analytics models.In this position, you will be the bac...Show more

Sr Data Engineer

MaarutToronto, ON, ca
Full-time

Candidate must be experienced working in ETL based projects involving Ab Initio.Must have expertise in the following.Understands where to obtain information needed to make the appropriate decisions...Show more

People also ask
Data Engineer

Data Engineer

Alltech Consulting ServicesMississauga
30+ days ago
Job type
  • Full-time
Job description

Job Description

Job Description

This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise.

Major Responsibilities:

  • Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.
  • Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data.
  • Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.
  • Proficient in developing programs in Python and SQL
  • Experience with Data warehouse Dimensional data modeling.
  • Working with event based/streaming technologies to ingest and process data.
  • Working with structured, semi structured and unstructured data.
  • Optimize Databricks jobs for performance and scalability to handle big data workloads.
  • Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
  • Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
  • Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process.
  • Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.

Skills:

  • 5+ years Python coding experience.
  • 5+ years – SQL Server based development of large datasets
  • 5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
  • Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
  • Experience in Data warehousing – OLTP, OLAP, Dimensions, Facts, and Data modeling.
  • Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
  • Experience with Cloud based data architectures, messaging, and analytics.
  • Cloud certification(s).
  • Any experience with Airflow is a Plus.

Must Have:

  • Snowflake
  • SQL
  • Python
  • ADF
  • PySpark
  • Data Warehouse Concepts