Talent.com
United Software Group Inc
Senior Technology Consultant - Data / AI Native EngineerUnited Software Group Inc • Vancouver, BC, Canada
Senior Technology Consultant - Data / AI Native Engineer

Senior Technology Consultant - Data / AI Native Engineer

United Software Group Inc • Vancouver, BC, Canada
4 hours ago
Job type
  • Full-time
  • Quick Apply
Job description

Data / AI Native Engineer

Toronto, Ontario Canada (Remote)
Overall Experience: 7+ Years

Role Summary

We are seeking a hands-on Senior Data / AI Native Engineer with strong expertise in Databricks, AWS, PySpark, and modern Lakehouse architecture. The ideal candidate combines deep Data Engineering expertise with strong Software Engineering practices and has experience leading complex enterprise data initiatives.

This role requires daily hands-on use of GitHub Copilot and/or Claude Code CLI to accelerate software and data pipeline development. The candidate should be comfortable rapidly building POCs and MVPs and applying AI directly within data engineering workflows - not just using AI for application development.

Day to Day Job Duties:
Design, develop, and optimize high-volume enterprise data pipelines using PySpark, Spark, and Databricks
Build scalable Lakehouse solutions using Delta Lake and Medallion Architecture (Bronze/Silver/Gold)
Implement data governance, access controls, and cataloging using Databricks Unity Catalog
Design and develop cloud-native data solutions using AWS S3, EMR, Glue, Lambda, and Redshift
Lead complex Data Engineering initiatives and provide technical guidance to engineering teams
Develop batch and real-time data processing pipelines for large-scale enterprise datasets
Use GitHub Copilot and/or Claude Code CLI daily to accelerate coding, pipeline development, testing, troubleshooting, and documentation
Rapidly develop POCs and MVPs using AI-assisted engineering practices
Apply AI within data pipelines for schema inference, automated data-quality rule generation, anomaly detection, and PySpark transformation generation
Build AI-ready data platforms supporting RAG, embeddings, vector stores, and AI/ML applications
Develop streaming pipelines using Structured Streaming, Kafka, Kinesis, or Databricks Auto Loader
Implement modern data engineering patterns including CDC, SCD Type 2, schema evolution, idempotent processing, and data contracts
Implement data quality, validation, monitoring, lineage, and observability across data pipelines
Conduct code/design reviews and establish reusable Data Engineering patterns and standards
Collaborate with Data Architects, AI/ML Engineers, Software Engineers, and business stakeholders to deliver enterprise data products

Basic Qualifications Must Have:
7+ years of experience in Data Engineering and Software Engineering, building production-grade enterprise data solutions
4+ years of hands-on experience with Databricks, Delta Lake, Medallion Architecture, and PySpark/Spark
4+ years of experience with the AWS data ecosystem, including S3, EMR, Glue, Lambda, and/or Redshift
Proven experience leading complex Data Engineering initiatives or providing technical leadership to Data Engineering teams
Strong hands-on experience processing high-volume datasets using PySpark, rather than Scala-only Spark development
Demonstrated daily use of GitHub Copilot and/or Claude Code CLI, with the ability to explain specific examples of how these tools improve Data Engineering productivity
Proven experience rapidly developing POCs and MVPs using AI-assisted development practices

Technical Skills:
Data Platform: Databricks, Delta Lake, Unity Catalog
Data Processing: PySpark, Apache Spark
Cloud: AWS S3, EMR, Glue, Lambda, Redshift
Architecture: Lakehouse, Medallion Architecture, Data Lakes
Streaming: Spark Structured Streaming, Kafka, Kinesis, Auto Loader

eye

Create a job alert for this search

Senior Technology Consultant - Data / AI Native Engineer • Vancouver, BC, Canada

Similar jobs

AI Innovation Consultant — Prototyping & Integration

EmpoweristsVancouver, Metro Vancouver Regional District, CA
Full-time

A dynamic consulting firm in Canada is seeking an experienced AI Innovation Specialist – Consultant to support AI enablement initiatives.This role involves configuring AI tools, building prototypes... Show more

 • Promoted

Senior Engineer - AI Workflows

XeroVancouver, British Columbia, Canada
Permanent

The role / impact As a Senior Engineer within the Internal AI Accelerator Squad, you will be at the forefront of Xero’s transformation into an AI-native company.You will act as a forward-deployed e... Show more

 • Promoted

AI Governance Engineer for Retail Innovation

Insight GlobalVancouver, Metro Vancouver Regional District, Canada
Full-time

Lead AI governance initiatives as an AI Governance Engineer at a premier Vancouver retail company.Your expertise will ensure responsible scaling of AI engineering tools.This role calls for an exper... Show more

 • Promoted

Senior Technical Consultant - R&D

Veeva SystemsVancouver, Metro Vancouver Regional District, CA
Full-time +1

Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster.As one of the fastest-growing SaaS companies, Veeva ... Show more

 • Promoted

Senior AI Engineer, AI Inference Systems

BrixVancouver, British Columbia, Canada
Full-time

Senior AI Engineer, AI Inference Systems.Senior AI Engineer, AI Inference Systems.Location : Palo Alto, CA Employment type : Full-time Salary : $250k - $350k USD/year + Equity Responsibilities.Over... Show more

 • Promoted

Senior Software Engineer (Full Stack + Data) - $155,000 - $172,000 A Year

ArticleRichmond, Canada
Full-time

Seeking a Senior Software Engineer with full-stack and data engineering expertise to design, develop, and maintain scalable web and data applications.Role involves building end-to-end features and ... Show more

 • Promoted

Data & AI Strategy Leader (Remote Canada)

WELL Health Technologies Corp. (TSX: WELL)Vancouver, Metro Vancouver Regional District, CA
Remote
Full-time

A leading healthcare technology company in Canada is seeking a Chief Data and AI Officer to lead the enterprise data vision.This executive role involves developing data strategies that drive organi... Show more

 • Promoted

Enterprise Cloud-Native Full-Stack AI Engineer

ApexonVancouver, Metro Vancouver Regional District, CA
Full-time

A digital-first technology services firm is looking for a Talent Acquisition Leader for the Mexico & Canada region.This mid-senior level role involves developing cloud-native software for B2B produ... Show more

 • Promoted

Senior Business Engagement Specialist in AI

Borealis AIVancouver, Metro Vancouver Regional District, CA
Full-time

Join Borealis AI at RBC as a Senior Business Engagement Lead, focused on connecting AI research with strategic goals in the banking sector.Your expertise in machine learning will drive significant ... Show more

 • Promoted

Remote Senior Software Engineer Ai-Native Platform - C$145,000 - C$165,000 A Year - Remote

AplosRichmond, Canada
Remote
Full-time

Seeking a Senior Software Engineer for a nonprofit software provider to design AI-integrated core systems and optimize performance. Show more

 • Promoted

Senior Data & Analytics Engineer

WagepointVancouver, Metro Vancouver Regional District, CA
Full-time

Senior Data & Analytics Engineer.This range is provided by Wagepoint.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.At Wagepoint, we’re good pe... Show more

 • Promoted

Remote AI Research Sales Consultant (Contract)

MercorVancouver, Metro Vancouver Regional District, CA
Remote
Full-time

A leading AI talent connection company is seeking a Sales Representative for wholesale and manufacturing.The position offers flexible remote work with a commitment of 15-30+ hours a week.Candidates... Show more

 • Promoted

CX Strategy & AI Consultant — Transform Digital CX

TELUS DigitalVancouver, Metro Vancouver Regional District, Canada
Full-time

A major telecommunications consultancy in Vancouver is looking for a CX Strategy & AI Consultant to lead digital and AI transformation initiatives.This critical role involves defining digital custo... Show more

 • Promoted

AI Engineer

DialpadVancouver, British Columbia, Canada
Full-time

About Dialpad Dialpad is the AI-native business communications platform.We unify calling, messaging, meetings, and contact center on a single platform - powered by AI that understands every convers... Show more

 • Promoted

Senior Developer: Clinical Communications & Ai - C$128,000 - C$200,000 A Year

SaaS companyRichmond, Canada
Full-time

Seeking a Senior Developer Manager for a SaaS company in Canada to lead product development and enhance clinic communication tools, requiring 8+ years of experience. Show more

 • Promoted

Senior Engineer Specializing in AI Workflows

ToastVancouver, Metro Vancouver Regional District, CA
Full-time

Join a leading AI software company in Vancouver as a Senior Software Engineer.Focus on creating LLM-powered educational products that enable actionable market intelligence.This Senior Software Engi... Show more

 • Promoted

AI Lead: Drive Global AI Strategy—Remote-First

Super.comVancouver, Metro Vancouver Regional District, CA
Remote
Full-time

A tech-driven company is looking for an AI Lead in Canada to spearhead AI integration across teams.The ideal candidate will have expertise in AI technologies and a track record of implementing AI s... Show more

 • Promoted

Agentic AI & Integration Technology Lead

Village Farms International Inc.Delta, Metro Vancouver Regional District, CA
Full-time

Take the lead in technology integration at Village Farms International, focusing on Agentic AI and enterprise workflows.This position offers a chance to ensure robust and secure integrations within... Show more

 • Promoted

Applied Ai Developer - C$90,000 - C$110,000 A Year

Delta Intelligent Building TechnologiesDelta, Canada
Full-time

Responsible for designing, developing, and deploying internal AI tools and agents to enhance productivity and operational efficiency.Focuses on practical, secure, and scalable AI applications acros... Show more

 • Promoted

Senior QA Automation Engineer: AI-Driven Testing & CI/CD

New Value SolutionsRichmond, Metro Vancouver Regional District, Canada
Full-time

A national IT consulting company is seeking a QA Automation Engineer in Canada to ensure the quality and performance of enterprise applications.Responsibilities include analyzing requirements, defi... Show more