Talent.com
E-Solutions
Data Architect with Airflow + AstronomerE-Solutions • Mississauga, ON
Data Architect with Airflow + Astronomer

Data Architect with Airflow + Astronomer

E-Solutions • Mississauga, ON
30+ days ago
Job type
  • Full-time
Job description

Data Architect with Airflow + Astronomer
Mississauga, Canada In-person interview and banking exp is must
Long Term Contract

The Solutions Architect specializing in Cloud Orchestration, will work with a small group of technologists and become a trusted advisor delivering technical solutions leveraging Apache Airflow hosted on the Astronomer platform. In this role, he will engineer a wide range of use cases where, Apache Airflow sits at the center of the solution, with the goal of rapidly developing solutions for the use cases.
Help guide a small group of technologists in their Apache Airflow journeys, including identifying new use cases and onboarding new domain teams.
Review, optimize, and tune data ingestion and extraction pipelines orchestrated by Airflow.
Development of frameworks to manage and engineer a large number of pipelines for the entire domain.
Build architecture, data flow, and operational diagrams and documents, with detailed physical and logical layers.
Provide reference implementations of various activities, including composing data pipelines in Airflow, implementing new Airflow features, or integrating Airflow with rd party solutions.
Keep up with the latest Astro and Airflow features, in order to better advise the technologies on impactful improvements they can make.
Collaborate to build reusable assets, automation tools, and documented best practices.
Interact with Domain and Engineering teams to channel product feedback and requirements discussions.
Work with technology team members to ensure that are realizing value in their Airflow and Astronomer journeys
Skills Required:
Experience with Apache Airflow in production environments.
Experience in designing and implementing ETL, Data Warehousing, and ML/AI use cases.
Proficiency in Python.
Knowledge of Azure cloud-native data architecture.
Demonstrated technical leadership on team projects.
Strong oral and written communication skills.
Willingness to learn new technologies and build reference implementations.
Experience in migrating workflows from legacy schedulers (Tidal) to Apache Airflow.
Experience in integrating with Azure Data Factory pipelines.
Snowflake and Databricks experience.
Experience working with containers.
SQL experience.
Kubernetes experience, either on-premise or in the cloud.
Enterprise data experience in regulated environments.
Create a job alert for this search

Data Architect with Airflow + Astronomer • Mississauga, ON

Similar jobs

AI and Data - Data Architect (Snowflake)

EYMississauga, Peel Region, CA
Full-time

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you.And we’re counting on your u... Show more

 • Promoted

SAP-focused GCP Data Architect Role

Tech Talent InternationalMississauga, Peel Region, CA
Temporary

Drive enterprise-grade data solutions as a GCP Data Architect with SAP expertise.Design scalable systems using the Google Cloud Platform while ensuring robust data governance and security.In this r... Show more

 • Promoted

Senior Databricks Architect

Data ElephantMississauga, Peel Region, CA
Full-time

Data Elephant is a boutique data and analytics consulting firm based in Vancouver, BC, helping Canadian organizations develop data strategies, modernize their data platforms and unlock the power of... Show more

 • Promoted

Senior Data Architecture and Sensor Fusion Role

AECOMMississauga
Full-time

Take on a pivotal role at AECOM as a Senior Data Architecture and Sensor Fusion Lead based in Mississauga.Drive innovation in one of the world's most sustainable airports through advanced sensor so... Show more

 • Promoted

Data Architect (15 Months Contract) - C$100,467 - C$138,142 A Year

SobeysMississauga, Canada
Temporary

The Data Architect will design and develop data architectures for supply chain and merchandising, collaborating with various teams, ensuring data quality, and documenting data components.They will ... Show more

 • Promoted

Principal Software Architect — AI-Driven Data Platforms Lead

AlphaSenseMississauga, Peel Region, CA
Full-time

A leading market intelligence firm in Canada seeks an experienced engineer to own the architecture and evolution of a large-scale data extraction platform.The role involves designing reliable syste... Show more

 • Promoted

Senior CRO Leader - Remote & AI-Driven Revenue Architect

PuffyMississauga, Peel Region, CA
Remote
Full-time

A leading eCommerce brand is looking for a Senior CRO Manager in Toronto to drive on-site conversion optimization.This role requires expertise in analytics and A/B testing, with the goal of enhanci... Show more

 • Promoted

AI Architect

Synopsys IncMississauga
Full-time

We Are: Synopsys is the leader in engineering solutions from silicon to systems, enabling customers to rapidly innovate AI-powered products.We deliver industry-leading silicon design, IP, simul... Show more

 • Promoted

AI Architect

Synopsys, Inc.Mississauga
Full-time

We Are: Synopsys is the leader in engineering solutions from silicon to systems, enabling customers to rapidly innovate AI-powered products.We deliver industry-leading silicon design, IP, simul... Show more

 • Promoted

Senior Data Architect

CEI Fleet Collision and SafetyMississauga, Peel Region, CA
Full-time

We’re looking for a collaborative and strategic Senior Data Architect to join our team as Senior Data Architect.In this role, you will be responsible for optimizing the value delivered by our Data ... Show more

 • Promoted

Data Architect for Analytics at BMC

BMC Software, Inc.Mississauga, Peel Region, CA
Full-time

Transform analytics and AI capabilities at BMC as a Data Architect.This remote opportunity in Canada focuses on building innovative and efficient data architectures.BMC is seeking a Data Architect ... Show more

 • Promoted

Data Team Lead / Data Architect (MongoDB, Redshift, Glue) B2B SaaS

Confidential CompanyMississauga, Peel Region, CA
Full-time +1

Get AI-powered advice on this job and more exclusive features.This range is provided by Confidential Company.Your actual pay will be based on your skills and experience — talk with your recruiter t... Show more

 • Promoted

Senior Data Architect for Strategic Data Governance and Solutions

PathlionMississauga, Peel Region, CA
Full-time

Take the lead as a Senior Data Architect, specializing in strategic governance and innovative data solutions in a federated ecosystem.Foster data quality and collaboration across multiple initiativ... Show more

 • Promoted

Senior Azure Data & AI Architect - Remote

InvisoMississauga, Peel Region, CA
Remote
Full-time

A leading cloud solutions provider is seeking a remote Lead Cloud Architect based in Canada.The ideal candidate will have over 8 years of experience with Microsoft data and analytics solutions, inc... Show more

 • Promoted

Lead Azure Data Architect(15+ Years Required) - $150,000 - $180,000 A Year - Remote

QData IncVaughan, Canada
Remote
Full-time

Lead Azure Data Architect to design and optimize data solutions, ensuring data quality and security in a remote setting. Show more

 • Promoted

GCP Data Migration Architect

HRBMississauga, Peel Region, CA
Full-time

An established industry player is seeking a skilled professional to lead data migration projects to the Google Cloud Platform.This role involves working closely with technical leads and client team... Show more

 • Promoted

Visionary Solutions Architect Driving Customer Success and AI Innovation

neptune.aiMississauga, Peel Region, CA
Full-time

Become a Principal Solutions Architect dedicated to customer success.Lead technical engagements with top research labs, ensuring high-value product adoption through expert support.This hands-on rol... Show more

 • Promoted

Senior Power BI & Snowflake Data Architect

SynechronMississauga, Peel Region, CA
Full-time

A global consulting firm is seeking a skilled Power BI Developer in Mississauga.The role involves developing data warehousing solutions, optimizing data models, and creating insightful reports usin... Show more

 • Promoted

Remote Lead Architect - Cloud, AI & Data Platform

ResonaiteMississauga, Peel Region, CA
Remote
Full-time

A client in the Fintech space is looking for a Lead Architect to evolve their core technology architecture across cloud infrastructure, distributed systems, data platforms, and AI-enabled systems.T... Show more

 • Promoted

Remote Senior Solutions Architect with Databricks Expertise

LumenaltaMississauga, Peel Region, CA
Remote
Full-time

Elevate data ecosystems as a Senior Solutions Architect, focusing on Databricks and AWS.This role allows you to design impactful, cloud-native data architectures remotely.As a key player in our arc... Show more