Join us in a high-impact, high-visibility role where you will pioneer world-class Data & AI engineering solutions, building the next generation of intelligent, agent-driven systems that power real-time business decisions.We are seeking an expert Lead Data & AI Engineer with 9 to 12+ years of experience to architect and deploy AI agents into business workflows, focusing on Databricks and AWS environments. You will lead data engineering, AI agent orchestration, and scalable, production-grade AI architectures.Join us in a high-impact, high-visibility role where you will pioneer world-class Data & AI engineering solutions, building the next generation of intelligent, agent-driven systems that power real-time business decisions.
We are seeking an expert Lead Data & AI Engineer with 9 to 12+ years of experience to architect and deploy AI agents into business workflows, focusing on Databricks and AWS environments. You will lead data engineering, AI agent orchestration, and scalable, production-grade AI architectures.
Key Responsibilities:
Architect and build reusable, metadata-driven data and AI engineering frameworks that standardize ingestion, transformation, feature engineering, and AI workflow deployment. Leverage Databricks, lakehouse architecture, declarative pipelines, and cloud-native services to enable scalable, governed, and reusable data products across the organization.
Architect and deploy Delta Live Tables and Lakeflow jobs on Databricks to automate data processing, AI pipelines, and agent data refresh cycles.
Leverage Databricks Workflows and Job Orchestration to schedule and monitor AI agent deployments across multiple business workflows.
Integrate Lakeflow for real-time data stream processing, ensuring AI agents are updated and responsive to live data.
Ensure seamless orchestration between AI models and data pipelines, using event-driven architectures for real-time inference and deployment.
Implement and orchestrate AI agents using frameworks such as Agentic systems, AgentOps tooling, and solutions like Agents on Databricks (Agent-bricks).
Hands-on experience deploying AI agents using RAG, Graph RAG, MCP-enabled integrations, and agent orchestration frameworks such as AgentOps, AgentBricks, LangGraph, or cloud-native orchestration services.
Manage AI agent lifecycles, monitoring, and scaling using tools like SageMaker, Bedrock, or AI orchestration frameworks on AWS.
Ensure robust data governance, metadata management, and AI observability through Unity Catalog, AWS Glue, or custom metadata layers.
Design for scalability and modularity, ensuring AI agents are reusable across multiple business processes.
Qualifications:
9–12+ years in data engineering, specializing in AI deployment within cloud ecosystems (Databricks, AWS).
Hands-on experience deploying AI agents using frameworks like RAG, graph RAG, and orchestrating agents (AgentOps, Agent-bricks, etc.).
Proficient in AWS AI/ML services (SageMaker, Bedrock) and orchestration tools (MWAA, Step Functions).
Strong knowledge of lakehouse architecture, Unity Catalog, and data modeling best practices.
Deep experience in data orchestration, monitoring, and scalable AI-driven workflows.
How We Work
Vanguard has implemented a hybrid working model for the majority of our crew members, designed to capture the benefits of enhanced flexibility while enabling in-person learning, collaboration, and connection. We believe our mission-driven and highly collaborative culture is a critical enabler to support long-term client outcomes and enrich the employee experience.
Senior Lead Data & AI Engineer • Toronto, ON, CA
A global consulting firm is seeking a Snowflake Data Architect to lead projects and develop innovative data solutions.The role requires strong technical leadership and a proven track record in data... Show more
Lead Data Engineer and Associate Director in Toronto, responsible for cloud and AI initiatives.Requires expertise in Python, Java, Snowflake, and AWS. Show more
Lead Architect role focusing on defining and building next-gen cloud, data, and AI platforms, requiring extensive experience in software engineering, data systems, and distributed architecture. Show more
Become a key player at Paytm Labs as a Lead Data Engineer.Drive innovations in data engineering through designing pipelines that handle petabytes of data efficiently in a hybrid work environment.As... Show more
This role focuses on ensuring the reliability and accuracy of Veeva AI Agents through rigorous evaluation and systematic validation methodologies. Show more
At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you.And we’re counting on your u... Show more
Shape the future of AI at IBM as a Senior AI Development Lead.Utilize advanced generative AI techniques to optimize organizational processes and boost efficiency.In this role at IBM’s AI Center of ... Show more
A leading home improvement retailer in Canada seeks a Senior Manager, BAI and Data Management.This role involves implementing AI strategies across business operations, managing a team of data scien... Show more
A national professional organization is seeking a Data & Analytics Specialist to support their digital transformation and AI initiatives.This role involves designing modern data infrastructure, int... Show more
Go-to-Market Lead - Data and AI Team.Get AI-powered advice on this job and more exclusive features.Accenture Song accelerates growth and value for our clients through sustained customer relevance.O... Show more
A leading tech company is seeking a Senior Data Engineer to lead data pipeline development and ensure high-quality data delivery.The ideal candidate should have over 8 years of experience in data e... Show more
Seeking a Data Architect to design a cloud-native data platform on Google Cloud. Show more
Location: Toronto Other locations: Primary Location Only Date: Sep 14, 2025 Requisition ID: Overview At EY, you’ll have the chance to build a career as unique as you are, with the global scale, sup... Show more
Gen AI Lead / Data Scientist (PhD) – Prospect 33 (P33.Work Model: In-House Leadership Role.Prospect 33 is expanding its Data, AI & Research Technology (DART) practice and is seeking an exceptional ... Show more
Join QuantumBlack, AI by McKinsey as a Senior Data Engineer focusing on architecting transformative AI solutions.Bring your expertise in data engineering and enhance client capabilities.In this sen... Show more
A global consumer goods company based in Toronto is seeking a Senior Manager, Data Engineering to lead and manage their data and architecture platform.This leadership role collaborates closely with... Show more
Shape the future of AI at IBM as a Senior AI Development Lead.Utilize advanced generative AI techniques to optimize organizational processes and boost efficiency.In this role at IBM’s AI Center of ... Show more
A leading home improvement retailer in Canada seeks a Senior Manager, BAI and Data Management.This role involves implementing AI strategies across business operations, managing a team of data scien... Show more
A technology consulting firm is seeking a Senior Technology Architect to conduct assessments and develop recommendations for technical architectures.You will play a critical role in enhancing gover... Show more
Data Analyst sought to use machine learning for insights, model development, and business strategy. Show more
