Talent.com

Big data engineer Jobs in Toronto, ON

Create a job alert for this search

Big data engineer • toronto on

Last updated: 2 hours ago

Data Engineer

Equitable BankToronto
Full-time

Developing of Data Pipelines (50%).Design, develop, and maintain scalable Synapse pipelines for data ingestion, processing, and transformation in Azure data platform.Develop and optimize T-SQL and ...Show more

 • New!

Data Engineer

VeemToronto, ON, CA
Full-time
Quick Apply

Role: Data Engineer Location: Fully Remote (Canada, EST time zone) Compensation: Salary + Bonus + Health Benefits About Veem Veem is transforming global money movement.Traditional cross-border paym...Show more

Data Engineer

Inizio Partners CorpToronto, ON, Canada
Remote
Full-time
Quick Apply

Job Title: Consultant Data Engineer.We're looking for a Senior Data Engineer with strong data platform experience to help with support of existing AWS/dbt platform and that can help with standing u...Show more

Data Engineer II

TD Bank, N.A.Toronto, Ontario
Full-time

Provide a broad range of data engineering functions including data modeling, data quality, data profiling, data acquisition and ingestion, extract transform load (ETL), metadata enrichment and mana...Show more

Sr Data Engineer

MaarutToronto, ON, ca
Full-time

Candidate must be experienced working in ETL based projects involving Ab Initio.Must have expertise in the following.Understands where to obtain information needed to make the appropriate decisions...Show more

Senior Data Engineer – Big Data & Analytics Platforms

NearSourceToronto, ON, Canada
Full-time
Quick Apply

Job Title: Senior Data Engineer – Big Data & Analytics Platforms.Job Location: Hybrid (3 days remote), Toronto, Canada.NearSource is looking for a Senior Data Engineer to design and scale enterpris...Show more

Data Integration Engineer

ProphixEtobicoke, ON, CA
Full-time
Quick Apply

See what you can do with Prophix.Prophix helps finance teams work with greater flexibility and confidence through Prophix One™, our Financial Performance Platform.We bring planning, reporting, and ...Show more

GenAI Data Engineer

Tiger Analytics Inc.Toronto, ON, CA
Remote
Full-time
Quick Apply

Tiger Analytics is a fast-growing advanced analytics consulting firm.Our consultants bring deep expertise in Data Science, Machine Learning and AI.We are the trusted analytics partner for several F...Show more

Senior Data Engineer

Wellington-AltusToronto, ON, CA
Full-time +1

This posting is for an existing vacancy in Wellington-Altus’ Toronto, Winnipeg, or Calgary office.Founded in 2017, Wellington-Altus Financial Inc.Wellington-Altus) is the parent company to Wellingt...Show more

Big Data Architect

BMO Financial GroupToronto, ON Canada
Temporary

BMO is an organization driven by a shared Purpose: Boldly Grow the Good in business and life.It calls on members of its team, to create lasting, positive change for its customers, its communities, ...Show more

Data Engineer

The Toronto-Dominion Bank (Canada)Toronto, Ontario
Full-time

We are seeking a Senior Data Engineer with deep, hands-on experience in Databricks, Apache Spark, and Python to design, build, and operate scalable, secure, and analytics-ready data platforms on Mi...Show more

Data Engineer

Artech LLCToronto, ON
Permanent

Location: Toronto, Ontario.We are seeking an experienced Senior Consultant to lead the strategic migration of legacy SAS applications to a modern Python-based ecosystem.This role involves spearhead...Show more

Data Engineer

Randstad CanadaEtobicoke, Ontario, CA
Full-time +1
Quick Apply

We are seeking a highly skilled Data Engineer for a permanent role to lead the design and implementation of robust data pipelines and advanced analytics models.In this position, you will be the bac...Show more

Data Engineer

Royal Bank of Canada>TORONTO, Canada
Full-time

We are seeking a talented Data Engineer to join our rapidly expanding Centralized Data Hub.This is a strategic initiative transforming how our organization manages and leverages data at scale.As a ...Show more

Big Data Engineer

TSX Inc.Adelaide St W,Toronto
Full-time

Venture outside the ordinary - TMX Careers.The TMX group of companies includes leading global exchanges such as the Toronto Stock Exchange, Montreal Exchange, and numerous innovative organizations ...Show more

Scala Developer with Spark, Hadoop, Big Data

Astra North Infoteck Inc.Toronto, ON, ca
Full-time
Quick Apply

Role Descriptions: Job Title Spark Scala DeveloperJob Description We are seeking a skilled Spark Scala Developer to join our team.The ideal candidate will have experience developing data processing...Show more

Data Engineer

BFL CanadaToronto, ON, CA
Full-time

We offer more than a job, we offer a career!.We support our employees to shape their career by encouraging continuing education and investing in training and development.We put our employees at the...Show more

Data Engineer

ScotiabankToronto, ON, CA
Full-time

Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.We are seeking a dedicated and enthusiastic Junior Developer to support automation and innovati...Show more

Lead Data Engineer

0000050007 Royal Bank of CanadaTORONTO, Ontario, Canada
Full-time

This position is to research and design new and complex technology, provide the best in class and most cost effective technical solutions for Contact Center Reporting to meet business and technical...Show more

People also ask
Data Engineer

Data Engineer

Equitable BankToronto
2 hours ago
Job type
  • Full-time
Job description

Main Activities:

  • 1. Developing of Data Pipelines (50%)
· Design, develop, and maintain scalable Synapse pipelines for data ingestion, processing, and transformation in Azure data platform. · Develop and optimize T-SQL and Python-based data processing scripts and integrate them with Synapse pipelines for ETL tasks and data transformations. · Design and develop mapping dataflow solutions for complex data transformations. · Develop and maintain data storage solutions, ensuring efficient data retrieval and storage on Azure Data Lake and databases. · Implement and maintain API integrations, including REST APIs, for seamless data flow between systems. · Design and test the end-to-end process for data ingestion, data transformation, data cleansing, data delivery, data quality and data timeliness. · Implement and ensure data security and privacy measures, complying with industry standards and regulations. · Monitor and optimize the performance of Azure data services, Azure Synapse pipelines, Function Apps, and Logic Apps. · Improve the scalability, efficiency, and cost-effectiveness of data pipelines.
  • 2. Requirements gathering and Technical Documentation (10%)
· Participate in Joint Application Development sessions with business units to gather and understand their data and reporting requirements. · Create and maintain technical documentations for tools, development, and procedures.
  • 3. Data Strategy and Planning (10%)
· Provide inputs and assist in enablement of Cloud based data solutions. · Develop and recommend innovative approaches to solve business and technical problems. · Work and collaborate with the larger team to exchange knowledge, solutions, and practices to build a more consistent, robust approach to development.
  • 4. Support and Maintenance of Enterprise Data Warehouse and BAU Tasks (30%)
· Continuously improve performance and proactively identify and resolve bottlenecks that will reduce time to build and deliver our products. · Troubleshoot and resolve data-related issues in a timely manner for production and other environments (DEV,UAT,QA) · Perform business as usual tasks (BAU) that assigned

Skills/Knowledge Requirements:

  • Bachelor's degree or equivalent in the field of Computer Science or Engineering
  • 3+ years of Proven experience as a Data Engineer, specifically working with Microsoft Azure technologies.
  • Proficient in T-SQL, Pyspark, Mapping Dataflow and Python programming language
  • Hands-on experience with Azure data services, including Azure Data Factory, Azure Data Lake, Azure Function App, Azure Logic App, Azure SQL Database, Azure Synapse Analytics, mapping dataflow, and Event Hub.
  • Understanding of data warehousing concepts and best practices.
  • Experience with Data modeling.
  • Experience in working with structured, semi-structured and unstructured data.
  • Excellent written and verbal communication skills
  • Excellent multi-tasking and organizational skills