Job Description
What's the opportunity?We are seeking a Lead Data and AI Quality Engineering to join our Risk and Compliance team and take ownership of quality assurance for AI and Non-Financial Risk Reporting initiatives. This role combines strategic test planning with hands-on automation and manual testing expertise to ensure the delivery of robust, high-quality solutions that meet regulatory and compliance standards.What will you do?Ensures that products being built and processes being used adhere to all standards and requirements. Applies extensive, in-depth knowledge, skills, and practices to perform complex assignments.Test Strategy & PlanningDesign and implement comprehensive test strategies aligned with risk, compliance, and regulatory requirements
Define test scope, acceptance criteria, and quality gates for AI and risk reporting solutions
Collaborate with Risk and Compliance stakeholders to understand requirements and translate them into testable specifications
Identify quality risks and develop mitigation plans in alignment with compliance frameworks
Design and code application programs for testing purposes, including test utilities and quality assurance tools
Perform comprehensive testing for developed applications, including functional, integration, and system-level testing
Validate system performance and reliability across Risk and Compliance workflows
Proven expertise building production server applications (APIs, microservices, backends)
Design and execute comprehensive test strategies for AI code agents and autonomous systems
Test AI code agents' ability to generate, review, and validate code across risk and compliance applications
Perform edge case testing and failure scenario analysis for AI agent decision-making processes
Evaluate AI agent performance metrics, including accuracy rates, false positives, and code quality standards
Validate database schemas, data models, and data integrity for risk and compliance reporting systems
Design and execute SQL queries to test data consistency, accuracy, and completeness across databases
Develop and maintain scalable, automated test frameworks and test suites using extensive Python expertise
Leverage Python libraries (pytest, requests, django, fastapi) for comprehensive test coverage
Execute automated tests as part of CI/CD pipelines and regression testing cycles
Extensive Python proficiency with 5+ years of hands-on development experience
Advanced Python expertise including OOP principles, design patterns, async programming, and advanced data structures
Strong software development background with experience in designing, coding, and debugging applications
Hands-on experience testing AI models and machine learning systems
Experience designing and testing AI code agents, autonomous systems, or LLM-powered applications
Demonstrated expertise in Large Language Model (LLM) testing, including prompt engineering, output validation, and hallucination detection
Experience testing Model Context Protocol (MCP) implementations and integrations
Knowledge of relational and non-relational databases (e.g., Oracle, SQL Server, PostgreSQL, MongoDB)
Solid understanding of DevOps practices and containerization
Proficiency with Git and GitHub Actions for CI/CD pipeline automation and workflow orchestration
Software development certifications or advanced programming credentials
Experience with data governance, data quality frameworks, and metadata management
Experience with AI agent frameworks and orchestration tools
Knowledge of Infrastructure as Code (IaC) and containerization best practices
A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable
Leaders who support your development through coaching and managing opportunities
Ability to make a difference and lasting impact.
Work in a dynamic, collaborative, progressive, and high-performing team
A world-class training program in financial services
Opportunities to do challenging work
Opportunities to take on progressively greater accountabilities
Access to a variety of job opportunities across business and geographies
Address:
RBC WATERPARK PLACE, 88 QUEENS QUAY W:TORONTOCity:
TorontoCountry:
CanadaWork hours/week:
37.5Employment Type:
Full timePlatform:
TECHNOLOGY AND OPERATIONSJob Type:
RegularPay Type:
SalariedPosted Date:
2026-04-15Application Deadline:
2026-08-10Note: Applications will be accepted until 11:59 PM on the day prior to the application deadline date aboveOur Employment OpportunitiesAt RBC, we are guided by living shared values of Client First, Integrity, Collaboration, Respect and Excellence and winning together as One RBC. We believe an inclusive workplace that has diverse perspectives is core to our continued growth as one of the largest and most successful banks in the world. Maintaining a workplace where our employees feel supported to perform at their best, effectively collaborate, drive innovation, and grow professionally helps to bring our Purpose to life and create value for our clients and communities. RBC strives to deliver this through policies and programs intended to foster a workplace based on respect, belonging and opportunity for all.Join our Talent Community
Stay in-the-know about great career opportunities at RBC. Sign up and get customized info on our latest jobs, career tips and Recruitment events that matter to you.
Expand your limits and create a new future together at RBC. Find out how we use our passion and drive to enhance the well-being of our clients and communities at jobs.rbc.com.
Lead Data and AI Quality Engineer • TORONTO, Ontario, Canada
Go-to-Market Lead - Data and AI Team.Get AI-powered advice on this job and more exclusive features.Accenture Song accelerates growth and value for our clients through sustained customer relevance.O... Show more
Wealth Management Data & AI is responsible for delivering a global data foundation and innovative AI capabilities across all of Wealth Management’s global businesses.We are looking to hire a talent... Show more
Lead Engineer – AI Research, Innovation.Bay is seeking a dedicated, highly skilled, and technically hands-on Lead Engineer to join our AIRI division.This is a great opportunity to help lead a highl... Show more
Software Engineer role in Toronto focused on designing AI evaluation infrastructure, building automated tests, and ensuring AI response quality.Requires 6+ years of software engineering experience ... Show more
Seeking a Lead Data AI Architect to design and guide the creation of scalable data and AI architectures using Azure services.This role involves setting standards for data platforms, analytics, and ... Show more
Thrive as a Lead Research Engineer at Thomson Reuters, where you will harness AI and Deep Learning to create transformative solutions for clients.Drive innovative projects in a dynamic hybrid work ... Show more
A national professional organization is seeking a Data & Analytics Specialist to support their digital transformation and AI initiatives.This role involves designing modern data infrastructure, int... Show more
A leading global insurance provider in Toronto is seeking a Data Quality Analyst for Data Governance.This role involves monitoring data quality and ensuring data is AI ready through collaborative e... Show more
Enhance Rootly's AI capabilities as an AI Quality Engineer focused on rigorous testing and evaluation.Your role will ensure our incident management platform performs flawlessly.As an AI Quality Eng... Show more
Application Deadline: 08/06/2026.Job Family Group: Data Analytics & Reporting.Creates and implements an integrated roadmap for all aspects of data & AI governance.Develops, maintains and monitors d... Show more
The salary range listed reflects the base pay for this role at Altus Group and is provided where required by local regulations.Actual offers may differ based on experience, market conditions, and o... Show more
Lead Data + AI Architect to design secure, scalable data and AI architectures, translate business strategy into technical specifications, and guide teams in building modern data platforms and AI/ML... Show more
A leading digital consultancy in Canada is seeking a Manager, Data Insights & Quality.This role is pivotal in managing AI solutions to enhance customer engagement, requiring strong analytical skill... Show more
At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you.And we’re counting on your u... Show more
Join QuantumBlack, AI by McKinsey as a Senior Data Engineer focusing on architecting transformative AI solutions.Bring your expertise in data engineering and enhance client capabilities.In this sen... Show more
We are looking for a Staff Generative AI Engineer to design, build, and ship production-grade Generative AI and Agentic AI applications that delivery business value across the organization.This rol... Show more
AI Data Quality & Evaluation Engineer needed to validate and ensure the reliability of AI Agents using expertise in data quality, prompt engineering, and Python. Show more
Thrive as a Lead Research Engineer at Thomson Reuters, where you will harness AI and Deep Learning to create transformative solutions for clients.Drive innovative projects in a dynamic hybrid work ... Show more
Seeking an AI Quality/Evaluation Engineer to design and build evaluation infrastructure for AI platforms, ensuring accurate and high-quality AI responses through automated testing and quality monit... Show more
Other locations: Primary Location Only.At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best vers... Show more
