Talent.com
Astra North Infoteck Inc.
Senior Data Engineer GCP, Python, PySparkAstra North Infoteck Inc. • Toronto, Ontario, Canada
Senior Data Engineer GCP, Python, PySpark

Senior Data Engineer GCP, Python, PySpark

Astra North Infoteck Inc. • Toronto, Ontario, Canada
Il y a 25 jours
Type de contrat
  • Temps plein
Description de poste

Data Engineer Google Cloud Platform (GCP) BigQuery Python & Data Pipelines

Location: Hybrid 3 Days per Week On-Site

Job Summary

Skilled Data Engineer with hands-on Google Cloud Platform (GCP) experience to design build and maintain scalable data pipelines and cloud-based data solutions
Expertise in data warehousing ETL/ELT development big data technologies and GCP services to support enterprise analytics and business intelligence initiatives

Key Responsibilities

Design develop and maintain scalable batch and real-time data pipelines on GCP
Build and optimize data ingestion frameworks from multiple structured and unstructured data sources
Develop ETL/ELT processes using GCP-native services and modern data engineering tools
Design and implement data models for analytics reporting and machine learning use cases
Manage and optimize data storage solutions using BigQuery and Cloud Storage
Monitor data quality performance security and governance standards
Collaborate with business stakeholders data analysts architects and data scientists to deliver enterprise data solutions
Implement CI/CD automation and DevOps practices for data engineering workloads
Troubleshoot data processing issues and optimize pipeline performance
Ensure compliance with data security and privacy requirements

Required Skills

Strong experience in Data Engineering and data pipeline development
Hands-on experience with Google Cloud Platform (GCP) services including:
BigQuery
Cloud Storage
Dataflow
Pub/Sub
Dataproc
Cloud Composer (Airflow)
Cloud Functions
Cloud Run
Strong programming skills in:
Python
SQL
PySpark
Experience with ETL/ELT frameworks and data integration tools
Strong knowledge of data warehousing concepts and dimensional modeling
Experience working with relational and NoSQL databases
Knowledge of real-time and streaming data architectures
Understanding of CI/CD pipelines GitHub and DevOps practices
Experience with data quality metadata management and governance

Preferred Skills

Experience with Apache Spark Hadoop Kafka and Airflow
Exposure to machine learning data pipelines and MLOps
Experience with Terraform or Infrastructure as Code (IaC)
Knowledge of containerization technologies such as Docker and Kubernetes
Experience in Banking Financial Services Insurance or large enterprise environments

Required Qualifications

Bachelors or Masters degree in Computer Science Information Technology Engineering or a related field
Excellent analytical and problem-solving skills
Strong communication and stakeholder management skills
Experience working in Agile/Scrum environments

Essential Skills

Google Cloud Platform (GCP)
BigQuery
Python
SQL
PySpark
ETL/ELT
Dataflow
Cloud Composer (Airflow)
Cloud Storage
CI/CD




Employment Type : Full Time
Experience: years
Vacancy: 1
Créer une alerte emploi pour cette recherche

Senior Data Engineer GCP, Python, PySpark • Toronto, Ontario, Canada

Offres similaires

Senior Data Engineer

MorningstarToronto, ON, CA
Temps plein

The ideal candidate should have strong hands‑on expertise in.Design, build, and maintain end‑to‑end data pipelines with Snowflake as the primary data warehouse.Implement and support Medallion Archi... Voir plus

 • Offre sponsorisée

Senior AI Engineer Python

enableITToronto, Ontario, Canada
Temps plein

Lead the design, development, and delivery of Gen AI products and solutions using modern AI frameworks, AWS cloud services, and cloud-native architectures.Partner with cross-functional teams to bui... Voir plus

 • Offre sponsorisée

Senior Engineer in Data Solutions

Canadian Tire CorporationToronto, ON, CA
Temps plein

Drive innovation in data solutions at Canadian Tire Corporation as a Senior Data Engineer in Toronto, ON.Your role will focus on developing automated data processes for enhanced analytics.As part o... Voir plus

 • Offre sponsorisée

Senior Software Engineer for Cutting-Edge Data Infrastructure

AutodeskToronto, ON, CA
Temps plein

Transform how data infrastructure is built as a Senior Software Engineer.Play a crucial role in developing AI-native, scalable systems that advance our capabilities across analytics and insights.Th... Voir plus

 • Offre sponsorisée

Senior Python Engineer - Microservices & Banking Platform

VySystemsToronto
Temps plein

A tech company in Ontario is seeking a Senior Software Engineer to enhance its banking platform.The role involves designing scalable solutions, mentoring engineers, and participating in sprint plan... Voir plus

 • Offre sponsorisée

Senior Data Engineer

Loblaw Companies LimitedToronto
Temps plein +1

Work with stakeholders to develop solutions that support various data consumers.Help automating reporting pipelines, and build real-time streaming dashboard.Build and implement robust data models a... Voir plus

 • Offre sponsorisée

Senior Snowflake Data Engineer | AWS, Spark & AI Growth

Tiger Analytics, LLCtoronto, on, Canada
Temps plein

A fast-growing analytics consulting firm is seeking a Data Engineer to architect and implement advanced analytics capabilities.The role requires expertise in data engineering with extensive experie... Voir plus

 • Offre sponsorisée

Senior Data Engineer (Python, Spark, Snowflake) - Toronto, ON

TechedinToronto, ON, CA
Temps plein

Job Title: Senior Data Engineer (Python, Spark, Snowflake) – Location: Hybrid (2 days remote), Toronto, Canada – Experience: 5+ Years – Rate: 65-72 CAD per hour.We are hiring for the Senior Data En... Voir plus

 • Offre sponsorisée

Senior Python Engineer, Integrations

Fulfiltoronto, on, Canada
Temps plein

Fulfil is hiring a Senior Python Engineer in Toronto to become a key technical partner for our North American customers, our India-based engineering team, and our Product Lead for Integrations.This... Voir plus

 • Offre sponsorisée

Senior Snowflake & Python Data Engineer (Hybrid)

Themesoft Inc.toronto, on, Canada
Temporaire

A technology solutions provider is seeking a Senior Snowflake Developer to join their Toronto team in a hybrid capacity.The successful candidate will design, develop, and optimize data solutions us... Voir plus

 • Offre sponsorisée

GCP Data Engineer: Spark, Python & BigQuery Expert

Aarorn Technologies IncToronto, ON, CA
Temps plein

A leading IT services company is seeking a skilled GCP Data Engineer to design, develop, and maintain data pipelines on Google Cloud Platform.The ideal candidate will have expertise in Spark Server... Voir plus

 • Offre sponsorisée

Senior Data Engineer - Snowflake, AWS & Spark

Tiger AnalyticsToronto, ON, CA
Temps plein

An analytics consulting firm in Toronto is seeking a Data Engineer to architect and implement advanced analytics capabilities.The ideal candidate will have over 12 years of experience in data engin... Voir plus

 • Offre sponsorisée

Senior Data Engineer: Microsoft Fabric Pipelines (Hybrid Toronto)

Symbiotic GroupToronto, ON, CA
Temps plein

A leading digital solutions provider in Toronto is seeking a Senior Data Engineer with expertise in SQL and Python.The role involves designing data pipelines, ensuring data quality, and utilizing M... Voir plus

 • Offre sponsorisée

Senior Cloud Data Engineer

Rubicon PathToronto
Temps plein

Become a pivotal Senior Software Developer focused on data engineering.Leverage your strong background in Python and AWS to create innovative data solutions in a hybrid setup.In this role, you will... Voir plus

 • Offre sponsorisée

Senior Data Platform Engineer: Cloud Data & Analytics

GravityToronto, ON, CA
Temps plein

A data solutions company in Toronto is looking for a Senior Data Platform Engineer to design, build, and scale data platforms for mission-critical government technology solutions.The ideal candidat... Voir plus

 • Offre sponsorisée

Lead Data Engineer / Data Platform Lead

Apexontoronto, on, Canada
Temps plein

Bloor st E, Toronto, Canada (onsite 5days).Lead Data Engineer / Data Platform Lead.In addition to hands‑on engineering, it emphasizes.It also introduces preferred experience in.GenAI/LLM-enabled da... Voir plus

 • Offre sponsorisée

Senior Platform Engineer (Python)

Acquird.iotoronto, on, Canada
Temps plein

B2B SaaS company, teams are based out of North America.Role is 95% remote in Toronto (we meet up 1x a month).Must be able to legally work in Canada (visa or sponsorship won't be provided).We're gro... Voir plus

 • Offre sponsorisée

Remote Senior Data Engineer with AWS/GCP Skills

Inizio Partners CorpToronto, ON, CA
Télétravail
Temps plein

Take the next step in your career as a Remote Senior Data Engineer.Bring your expertise in AWS and GCP to enhance our data systems and platforms.We are seeking a Consultant Data Engineer with stron... Voir plus

 • Offre sponsorisée

Senior Data Engineer & ETL Architect (Snowflake + Python)

HRbrain Inc.Toronto
Temps plein

Senior Data Engineer, 10+ years Experience.For ESG (Environmental and sustainability) Project: will want this person to do actual engineering.They will be creating from scratch- pure through and th... Voir plus

 • Offre sponsorisée

Remote Lead Data Engineer - Databricks & PySpark

LumenaltaToronto, ON, CA
Télétravail
Temps plein

A technology company is seeking an experienced Data Engineering Lead to guide technical direction for critical initiatives in data engineering.This fully remote position requires 10+ years of exper... Voir plus