Talent.com
Astra North Infoteck Inc.
Senior Data Engineer GCP, Python, PySparkAstra North Infoteck Inc. • Toronto, Ontario, Canada
Senior Data Engineer GCP, Python, PySpark

Senior Data Engineer GCP, Python, PySpark

Astra North Infoteck Inc. • Toronto, Ontario, Canada
22 days ago
Job type
  • Full-time
Job description

Data Engineer Google Cloud Platform (GCP) BigQuery Python & Data Pipelines

Location: Hybrid 3 Days per Week On-Site

Job Summary

Skilled Data Engineer with hands-on Google Cloud Platform (GCP) experience to design build and maintain scalable data pipelines and cloud-based data solutions
Expertise in data warehousing ETL/ELT development big data technologies and GCP services to support enterprise analytics and business intelligence initiatives

Key Responsibilities

Design develop and maintain scalable batch and real-time data pipelines on GCP
Build and optimize data ingestion frameworks from multiple structured and unstructured data sources
Develop ETL/ELT processes using GCP-native services and modern data engineering tools
Design and implement data models for analytics reporting and machine learning use cases
Manage and optimize data storage solutions using BigQuery and Cloud Storage
Monitor data quality performance security and governance standards
Collaborate with business stakeholders data analysts architects and data scientists to deliver enterprise data solutions
Implement CI/CD automation and DevOps practices for data engineering workloads
Troubleshoot data processing issues and optimize pipeline performance
Ensure compliance with data security and privacy requirements

Required Skills

Strong experience in Data Engineering and data pipeline development
Hands-on experience with Google Cloud Platform (GCP) services including:
BigQuery
Cloud Storage
Dataflow
Pub/Sub
Dataproc
Cloud Composer (Airflow)
Cloud Functions
Cloud Run
Strong programming skills in:
Python
SQL
PySpark
Experience with ETL/ELT frameworks and data integration tools
Strong knowledge of data warehousing concepts and dimensional modeling
Experience working with relational and NoSQL databases
Knowledge of real-time and streaming data architectures
Understanding of CI/CD pipelines GitHub and DevOps practices
Experience with data quality metadata management and governance

Preferred Skills

Experience with Apache Spark Hadoop Kafka and Airflow
Exposure to machine learning data pipelines and MLOps
Experience with Terraform or Infrastructure as Code (IaC)
Knowledge of containerization technologies such as Docker and Kubernetes
Experience in Banking Financial Services Insurance or large enterprise environments

Required Qualifications

Bachelors or Masters degree in Computer Science Information Technology Engineering or a related field
Excellent analytical and problem-solving skills
Strong communication and stakeholder management skills
Experience working in Agile/Scrum environments

Essential Skills

Google Cloud Platform (GCP)
BigQuery
Python
SQL
PySpark
ETL/ELT
Dataflow
Cloud Composer (Airflow)
Cloud Storage
CI/CD




Employment Type : Full Time
Experience: years
Vacancy: 1
Create a job alert for this search

Senior Data Engineer GCP, Python, PySpark • Toronto, Ontario, Canada

Similar jobs

Senior AI Engineer Python

enableITtoronto, on, Canada
Full-time

Lead the design, development, and delivery of Gen AI products and solutions using modern AI frameworks, AWS cloud services, and cloud-native architectures.Partner with cross-functional teams to bui... Show more

 • Promoted

Senior Snowflake Data Engineer | AWS, Spark & AI Growth

Tiger Analytics, LLCtoronto, on, Canada
Full-time

A fast-growing analytics consulting firm is seeking a Data Engineer to architect and implement advanced analytics capabilities.The role requires expertise in data engineering with extensive experie... Show more

 • Promoted

Senior Data Engineer (Python, Spark, Snowflake) - Toronto, ON

TechedinToronto, ON, CA
Full-time

Job Title: Senior Data Engineer (Python, Spark, Snowflake) – Location: Hybrid (2 days remote), Toronto, Canada – Experience: 5+ Years – Rate: 65-72 CAD per hour.We are hiring for the Senior Data En... Show more

 • Promoted

Senior Python Engineer, Integrations

Fulfiltoronto, on, Canada
Full-time

Fulfil is hiring a Senior Python Engineer in Toronto to become a key technical partner for our North American customers, our India-based engineering team, and our Product Lead for Integrations.This... Show more

 • Promoted

Senior Data Engineer & ETL Architect (Snowflake + Python)

HRbrain Inc.Toronto, ON, CA
Full-time

Senior Data Engineer, 10+ years Experience.For ESG (Environmental and sustainability) Project: will want this person to do actual engineering.They will be creating from scratch- pure through and th... Show more

 • Promoted

Senior Data Engineer

NEARSOURCE TECHNOLOGIESToronto, ON, CA
Full-time

Job Title: Senior Data Engineer.Job Location: Hybrid, Toronto, Ontario, Canada.NearSource is looking for a Data Platform Engineer with expertise in Python, Spark, and Snowflake to join our engineer... Show more

 • Promoted

Senior Snowflake & Python Data Engineer (Hybrid)

Themesoft Inc.toronto, on, Canada
Temporary

A technology solutions provider is seeking a Senior Snowflake Developer to join their Toronto team in a hybrid capacity.The successful candidate will design, develop, and optimize data solutions us... Show more

 • Promoted

Senior Data Engineer

Aarorn Technologies IncToronto, ON, CA
Full-time

Senior Data Engineer – Contract – Toronto, ON (3x onsite a week).Provide technical expertise in designing, coding, and documenting ETL processes for new initiatives.Independently support existing a... Show more

 • Promoted

Senior Python Engineer (Toronto)

Fitch Group, Inc.Toronto, ON, CA
Full-time

Senior Software Engineer, Python Programmer.Fitch Ratings is currently seeking a Senior Software Engineer specializing in Python Programming or applications to join our team in Toronto.In this role... Show more

 • Promoted

Senior Data Engineer - Snowflake, AWS & Spark

Tiger AnalyticsToronto, ON, CA
Full-time

An analytics consulting firm in Toronto is seeking a Data Engineer to architect and implement advanced analytics capabilities.The ideal candidate will have over 12 years of experience in data engin... Show more

 • Promoted

Senior Data Engineer - ETL, Python, Docker/Kubernetes

Aarorn Technologies IncToronto, ON, CA
Full-time

A technology solutions firm in Toronto is looking for a Senior Data Engineer for a contract position.The role requires expertise in ETL processes, Python, and database management, alongside skills ... Show more

 • Promoted

Senior Python Engineer - Microservices & Banking Platform

VySystemsToronto, ON, CA
Full-time

A tech company in Ontario is seeking a Senior Software Engineer to enhance its banking platform.The role involves designing scalable solutions, mentoring engineers, and participating in sprint plan... Show more

 • Promoted

Lead Data Engineer / Data Platform Lead

Apexontoronto, on, Canada
Full-time

Bloor st E, Toronto, Canada (onsite 5days).Lead Data Engineer / Data Platform Lead.In addition to hands‑on engineering, it emphasizes.It also introduces preferred experience in.GenAI/LLM-enabled da... Show more

 • Promoted

Senior Platform Engineer (Python)

Acquird.iotoronto, on, Canada
Full-time

B2B SaaS company, teams are based out of North America.Role is 95% remote in Toronto (we meet up 1x a month).Must be able to legally work in Canada (visa or sponsorship won't be provided).We're gro... Show more

 • Promoted

Senior Data Platform Engineer

Tubitoronto, on, Canada
Full-time

We're hiring Senior and Staff Data Platform Engineers to join the Data Infrastructure teams in Toronto.Together these teams own the infrastructure that processes billions of events per day: Spark-o... Show more

 • Promoted

Remote Senior Data Engineer with AWS/GCP Skills

Inizio Partners CorpToronto, ON, CA
Remote
Full-time

Take the next step in your career as a Remote Senior Data Engineer.Bring your expertise in AWS and GCP to enhance our data systems and platforms.We are seeking a Consultant Data Engineer with stron... Show more

 • Promoted

Senior Data Engineer

Loblaw Companies Limitedtoronto, on, Canada
Permanent

Work with stakeholders to develop solutions that support various data consumers.Help automating reporting pipelines, and build real-time streaming dashboard.Build and implement robust data models a... Show more

 • Promoted

Senior Data Platform Engineer

Riverside Natural Foods Ltd. (Home of MadeGood)toronto, on, Canada
Full-time

Join Riverside Natural Foods Ltd.Canadian-based, family-owned, and globally operating business.As a B-Corp certified, Triple-Bottom Line company, we manufacture nutritious, 'better-for-you' snacks ... Show more

 • Promoted

Senior Python Software Engineer

Quantum Technology Recruiting Inc. (QTR)Toronto, ON, CA
Permanent

Downtown Toronto, Hybrid/Onsite.We're partnering with a growing financial technology firm looking to add a Senior Backend Engineer to their engineering team in Toronto.This position focuses on buil... Show more

 • Promoted

Senior Data Engineer

TechDoQuestMarkham, ON, CA
Full-time

Snowflake, dbtCore/Cloud, and AWS Cloud Technologies.Technical Expertise: Deep knowledge of relational databases (Snowflake, PostgreSQL, Amazon Aurora).Data Visualization Proficiency: Skilled in to... Show more