Talent.com
Momento USA
Lead AI Engineer, Agentic Data LineageMomento USA • Quebec, Quebec, Canada
Lead AI Engineer, Agentic Data Lineage

Lead AI Engineer, Agentic Data Lineage

Momento USA • Quebec, Quebec, Canada
30+ days ago
Job type
  • Full-time
Job description

JD: Lead AI Engineer Agentic Data Lineage

What You Will Do:

  • Define and drive the technical strategy for a Firmwide column-level data lineage platform built on AI reasoning agents.
  • Architect parsers that build Abstract Syntax Trees (ASTs) from SQL across multiple dialects stored procedures Python Java Scala and Spark jobs then resolve column-level transformations from those trees.
  • Design ingestion of no-code signals from ETL and transformation tools workflow orchestrators data catalogs and BI platforms normalizing them into a common lineage model.
  • Build a multi-agent system in which specialized deep agents parse reason disambiguate and reconcile conflicting signals then assemble a coherent end-to-end lineage graph.
  • Establish how agents handle ambiguity (dynamic SQL runtime configuration hand-written transformations) by reasoning over context rather than failing silently or guessing.
  • Model and persist lineage as a queryable knowledge graph supporting impact analysis root-cause tracing and regulatory evidence generation.
  • Build confidence scoring and validation so every lineage edge carries a provenance signal and a measure of certainty with low-confidence inferences surfaced for human review.
  • Partner with the Firmwide Data Office Risk Compliance and the divisional technology teams to align the platform with the Firms data governance obligations including BCBS 239 CCAR GDPR and SOX.
  • Lead mentor and grow a team of AI and data engineers setting engineering standards reviewing designs and owning delivery.
  • Operate within Morgan Stanleys controls for AI safety data confidentiality and model governance.


Required Qualifications:

  • 8 years of software and data engineering experience including a track record of leading complex platform builds end to end.
  • Strong background in program analysis or compiler techniques: parsing ASTs intermediate representations and static analysis. Hands-on experience with tools such as ANTLR tree-sitter sqlglot or language-native AST libraries.
  • Practical experience building LLM-powered agents or multi-agent systems including reasoning loops tool use retrieval and orchestration frameworks (LangGraph LlamaIndex AutoGen or equivalent in-house systems).
  • Deep data engineering expertise: SQL fluency across dialects plus experience with Spark distributed pipelines and modern transformation tooling such as dbt.
  • Experience modeling and querying graph data with a graph database such as Neo4j Amazon Neptune or Janus Graph.
  • Strong software engineering fundamentals: testing CI/CD and production-grade systems at scale.
  • Demonstrated technical leadership including mentoring engineers and influencing architecture across teams.

Preferred Qualifications:

  • Experience in financial services capital markets or another heavily regulated data environment.
  • Familiarity with data lineage and metadata standards and tools such as OpenLineage Marquez DataHub Apache Atlas Egeria Collibra or Alation.
  • Working knowledge of BCBS 239 data aggregation and risk reporting principles and how they translate into engineering requirements.
  • Experience harvesting metadata from enterprise ETL tools (Informatica Talend) and BI platforms (Tableau Power BI).
  • Background in knowledge representation semantic reasoning or evaluation of LLM output quality and hallucination control.


Tech Stack:
Python SQL Spark and Scala or Java for parsing targets. LLM and agent frameworks for reasoning. Graph databases for lineage storage. Workflow orchestration for pipeline execution. Cloud and on-premise deployment with containerized services. OpenLineage-aligned metadata models.

Note: Momento USA is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race color religion sex pregnancy sexual orientation gender identity national origin age protected veteran status or disability status.


Employment Type : Full Time
Experience: years
Vacancy: 1
Create a job alert for this search

Lead AI Engineer, Agentic Data Lineage • Quebec, Quebec, Canada

Similar jobs

AI Lead

Super.comQuebec, Capitale-Nationale, CA
Full-time

This range is provided by Super.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.For our employees, our promise is that Super.We are more than a ... Show more

 • Promoted

Senior AI Developer: Agentic Systems & Platform Lead

Constellation Dealer GroupQuebec, Capitale-Nationale, CA
Full-time

A North American software provider is seeking a Senior Developer to design and build AI-native systems that impact business outcomes.The role emphasizes collaborative system design and engineering ... Show more

 • Promoted

AI/ML Lead (Senior Machine Learning Engineer – Full-time Leadership Role)

Aurelian Venture AIQuebec, Capitale-Nationale, CA
Full-time

AI/ML Lead (Senior Machine Learning Engineer – Full-time Leadership Role).Full-Time, Contract, Hands‑on Technical Leadership.CAD $180,000 – $250,000 base + significant equity + performance bonuses ... Show more

 • Promoted

Remote SaaS Data & AI Engineering Lead

Harvey NashQuebec, Capitale-Nationale, CA
Remote
Full-time

A leading technology consultancy is seeking a Data & AI Engineering Manager to lead teams in building scalable data and AI products in a SaaS environment.The role combines technical leadership and ... Show more

 • Promoted

Snowflake Data Architect: Lead Analytics & AI Solutions

EYQuebec, Capitale-Nationale, CA
Full-time

A global consulting firm is seeking a Snowflake Data Architect to lead projects and develop innovative data solutions.The role requires strong technical leadership and a proven track record in data... Show more

 • Promoted

AI Code Generation Staff Engineer Role

MongoDBquebec, capitale nationale, Canada
Full-time

Transform legacy systems with MongoDB by joining as a Staff Engineer focused on AI code generation tools.Drive innovation in modernizing applications to microservices architectures.This role requir... Show more

 • Promoted

Remote AI Engineer - Build Next-Gen ML Solutions

Yeah! GlobalQuebec, Capitale-Nationale, CA
Remote
Full-time

A global technology firm is seeking highly skilled AI Engineers to join their team.This remote position requires proficiency in programming languages like Python and experience in developing AI mod... Show more

 • Promoted

Senior AI Agent Engineer: Deploy & Integrate

CrestaQuebec, Capitale-Nationale, CA
Full-time

A leading AI technology company in Canada is seeking an AI Agent Engineer to develop and deploy intelligent AI agents.The ideal candidate will have a strong background in software development and A... Show more

 • Promoted

AI Engineer

BioRenderQuebec, Capitale-Nationale, CA
Full-time

At BioRender, we don’t settle for average, and neither should you.We’re building tools that transform how scientists communicate complex ideas, and we need someone who’s ready to turn ambitious ide... Show more

 • Promoted

Lead Software Engineer in AI Development

AlphaSenseQuebec, Capitale-Nationale, CA
Full-time

Take the lead as a Software Engineer focusing on AI at a premier Market Intelligence firm.Drive innovation and architecture while fostering a collaborative and inclusive workplace.This role seeks c... Show more

 • Promoted

Remote Lead Data Engineer - Databricks & PySpark

LumenaltaQuebec, Capitale-Nationale, CA
Remote
Full-time

A technology company is seeking an experienced Data Engineering Lead to guide technical direction for critical initiatives in data engineering.This fully remote position requires 10+ years of exper... Show more

 • Promoted

Senior Data Engineer - Data Governance & Platform Lead

XsollaQuebec, Capitale-Nationale, CA
Full-time

A global commerce company in Canada is seeking a Data Engineer to lead efforts in building and optimizing the User Platform and Recommendation Engine.The role involves ensuring data accuracy and pe... Show more

 • Promoted

AI Engineer: LLM Agents & Product Insights

OpenReplayQuebec
Full-time

A tech startup based in Quebec is looking for a talented AI Engineer.This role involves designing and maintaining agents, collaborating with engineering on data pipelines, and delivering innovative... Show more

 • Promoted

Remote Lead Data Engineer Specializing in Data Pipeline Architecture

LumenaltaQuebec, Capitale-Nationale, CA
Remote
Full-time

Join as a Remote Lead Data Engineer specializing in sophisticated data pipeline architectures.Leverage your technical skills to lead transformative data initiatives while mentoring a team.With over... Show more

 • Promoted

Python & Kubernetes AI/ML Data Engineer — Remote/Distributed

CanonicalQuebec, Capitale-Nationale, CA
Remote
Full-time

Canonical, a leader in open source software, seeks a Python and Kubernetes Software Engineer focused on Data, AI/ML, and Analytics Solutions.Collaborate on end-to-end data analytics solutions and c... Show more

 • Promoted

Remote Lead Architect - Cloud, AI & Data Platform

ResonaiteQuebec, Capitale-Nationale, CA
Remote
Full-time

A client in the Fintech space is looking for a Lead Architect to evolve their core technology architecture across cloud infrastructure, distributed systems, data platforms, and AI-enabled systems.T... Show more

 • Promoted

Data Team Lead / Data Architect (MongoDB, Redshift, Glue) B2B SaaS

Confidential CompanyQuebec, Capitale-Nationale, CA
Full-time +1

Get AI-powered advice on this job and more exclusive features.This range is provided by Confidential Company.Your actual pay will be based on your skills and experience — talk with your recruiter t... Show more

 • Promoted

Python & Kubernetes Data Engineer for AI/ML Analytics

CanonicalQuebec, Capitale-Nationale, CA
Full-time

Join a pioneering tech firm at the forefront of the open-source movement.As a Python and Kubernetes Software Engineer, you'll develop cutting-edge data analytics solutions using popular machine lea... Show more

 • Promoted

Freelance AI Engineer: Scale ML Pipelines and Retrieval

TwineQuebec, Capitale-Nationale, CA
Full-time

A leading freelance marketplace in Canada is seeking an experienced AI Engineer to optimize and scale its AI-powered influencer marketing platform.You will enhance data pipelines for performance an... Show more

 • Promoted

Agentic AI Developer - Senior Level

Tech Talent InternationalQuebec, Capitale-Nationale, CA
Full-time

Shape the future of AI applications as a Senior Developer.Build robust systems with LLMs and autonomous agents while leveraging the benefits of remote work within the U.This role involves leading t... Show more