Technical Architect

VDart Inc
Canada
Temporary
Quick Apply

Job Title : Technical Architect

Location : Canada - Remote

Duration : / Term : 6+ months Contract

Job Description :

12+ years of experience in ETL, python and GCP.

  • Professional experience in Data Engineering using Google Big Query (GBQ) and Google Cloud Platform (GCP) data sets and building data pipelines.
  • Hands on and deep experience working with Google Data Products (e.g. BigQuery, Dataflow, Dataproc, Dataprep, Cloud Composer, Airflow, DAG etc.).
  • Python Programming Expert PySpark, Pandas
  • Experience in Airflow (Create DAG, Configure the variables in Airflow, Scheduling)
  • Big Data technologies and solutions (Spark, Hadoop, Hive, MapReduce) and multiple scripting and languages (YAML, Python).
  • Experience in DBT to create the lineage in GCP. Optional
  • Worked in Dev-Sec-Ops (CICD) environment.
  • Design and develop the ETL ELT framework using BigQuery, Expertise in Big Query concepts like Nested Queries, Clustering, Partitioning, etc.
  • Experience in Data Integration, Data Transformation, Data Quality and Data Lineage tools.
  • Should be able to automate the data load from Big Query using APIs or scripting language.
  • E2E Data Engineering and Lifecycle (including non-functional requirements and operations) management.
  • E2E Solution Design skills Prototyping, Usability testing and data visualization literacy.
  • Experience with SQL and NoSQL modern data stores.

Key Skills :

Data Engineering, Big Query, GCP, Airflow, ETL, SQL, Data Integration, Python.

4 days ago
Related jobs
KPMG
Canada, Canada

Lead the technical design and architecture of D365 F&O, ensuring that they meet the client's technical and business requirements. Develop and maintain technical design documents, including architecture diagrams, data models and perform code reviews. Lead technical workshops with the client to ensure...

VDart Inc
Canada

Job Title:</b> Technical Architect</p> <p style="margin-bottom:8px"><b>Location: </b>Canada - Remote</p> <p style="margin-bottom:8px"><b>Duration: / Term: </b>6+ months Contract</p> <p style="margin-bottom:8p...

Verndale
Remote, Canada, CA
Remote

About the Technical Architect B2B Commerce Position The Technical Architect will be responsible for the comprehensive architecture, design, and implementation of Salesforce B2B Commerce solutions. Salesforce Certified Technical Architect (CTA) or equivalent Salesforce architecture certifications. Le...

VDart Inc
Canada

Role: Technical Architect ETL, Python, GCP</b></p> <p><b>Location: Canada Remote<br /> Mode: Contract</b></p> <p> </p> <p>12+ years of experience in ETL, python and GCP</p> <p> </p> <p> Professional expe...

Nuvei
CA
Remote

This hybrid Solutions Architect/Systems Analyst/Technical Business Analyst position. System Analyst/Solutions Architect or Technical Business Analyst. ...

Nuvei
Canada

This hybrid Solutions Architect/Systems Analyst/Technical Business Analyst position. System Analyst/Solutions Architect or Technical Business Analyst. ...

Great Canadian Gaming Corp.
Canada, Canada

Develop technical architectures, frameworks and strategies for MS Dynamics 365 application and server architecture. Technical Architect Job# 62054. Review application and program design or technical design to ensure adherence to standards and to recommend performance improvements. Liaise with cloudi...

Promoted
Procom
Canada

Job Title: Storage Architect (Level 3). ...

WSP Canada
Canada, Canada

The Project Manager - Mining Consulting will be involved in all stages of a project's life cycle (i. This project management role will work closely with technical managers and ensure the correct delivery of projects within budget and schedule. Use additional project management tools, methods, and be...

VENAFI
Canada
Remote

Join Venafi as a Solutions Architect (Sales Engineer), where you'll play a pivotal role as the primary technical expert supporting our sales team. As a Solutions Architect, you'll meticulously identify all technical decision criteria, guiding customers through a structured process to ensure well-inf...