QA Engineer, Data Science

What is the opportunity?

As the Senior/Lead QA Engineer, Data Science, you will apply quality assurance expertise, statistics, and machine learning knowledge to validate the robustness, reliability, and business effectiveness of advanced analytics, machine learning, and Agentic GenAI solutions developed by the team.

You will partner closely with Data Scientists, Engineers, and Business SMEs to understand business objectives and translate them into comprehensive validation strategies, test frameworks, and quality metrics. Your work will ensure that ML models and GenAI agents behave as expected across diverse real-world scenarios, meet stakeholder and governance expectations, and deliver measurable business value.

In addition to testing and validation, you will play a key role in improving model quality, strengthening QA processes, and introducing automation and best practices across the Data Science and GenAI lifecycle.

What will you do?

• Design and perform end-to-end validation of machine learning models and Agentic GenAI solutions, independently assessing methodology, data usage, modeling techniques, assumptions, and outcomes to ensure adherence to data science best practices, governance standards, and intended business objectives across diverse datasets and scenarios.

• Validate Agentic GenAI solutions, including:

  • Testing agent workflows, tool usage, orchestration logic, and decision paths.

  • Evaluating LLM outputs for accuracy, consistency, bias, hallucination risk, and alignment

  • with business objectives.

  • Assessing guardrails, prompt strategies, fallback mechanisms, and failure handling.

• Create statistical robustness and performance tests for trained models and GenAI systems, including simulated datasets that reflect real-world and edge-case scenarios.

• Develop automated evaluation frameworks to measure model and agent quality, including precision, recall, stability, drift, response quality, and business KPIs.

• Define and track data quality and model quality metrics, including input data validation, feature integrity, and output reliability.

• Test and validate machine learning models and Agentic GenAI solutions using Python and

• related tools, analyze outputs and behaviors across scenarios, produce detailed validation reports, debug issues, and propose corrective actions to address methodological, data, or implementation gaps.

• Collaborate with Data Scientists to deeply understand data pipelines, feature engineering, models, prompts, and agent architectures.

• Work with Business SMEs to ensure models and GenAI agents meet stated objectives and risk tolerances.

• Continuously seek better ways to test, validate, and monitor solutions through automation, new tools, and emerging technologies.

What do you need to succeed?
Must-have

• Bachelor’s degree in computer science, Computational Science, Engineering, or a related field.

• Strong Quality Assurance experience, preferably in data, analytics, or software-intensive environments.

• Solid foundation in statistics, statistical testing, and experimental design (e.g., controlled

• trials, A/B testing).

• Experience validating machine learning models and working with complex datasets.

• Experience validating GenAI / LLM-based systems, including prompt testing, output evaluation, and agent workflows.

• Working knowledge of big data environments and data pipelines.

• Strong programming skills (e.g., Python) for test development, automation, and debugging.

• Demonstrated passion for simplifying and automating work, continuous learning, solving open-ended problems, and improving efficiency.

• Excellent communication and organizational skills, with the ability to collaborate across technical and business teams and manage multiple priorities.

Nice-to-have

• Experience with distributed analytics platforms (e.g., Hadoop, Spark).

• Familiarity with model risk management, fairness, explainability, and governance concepts.

• Experience with Information Security or secure-by-design principles.

• Experience working in an Agile environment.

• Exposure to monitoring model or GenAI performance in production (drift, degradation, feedback loops).

What's in it for you?

We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.

• A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable

• Leaders who support your development through coaching and managing opportunities

• Ability to make a difference and lasting impact

• Work in a dynamic, collaborative, progressive, and high-performing team

• A world-class training program in financial services

#LI-ASPOST

#TechPJ

Job Skills

Application Testing, Decision Making, Detail-Oriented, Group Problem Solving, IT Quality Assurance, Long Term Planning, Predictive Analytics, Programming Languages, Software Product Testing, Test Automation

Additional Job Details

16 YORK ST:TORONTOTorontoCanada37.5Full timeTECHNOLOGY AND OPERATIONSRegularSalaried2026-02-192026-04-01

Note: Applications will be accepted until 11:59 PM on the day prior to the application deadline date above

Our Employment Opportunities

At RBC, we are guided by living shared values of Client First, Integrity, Collaboration, Respect and Excellence and winning together as One RBC. We believe an inclusive workplace that has diverse perspectives is core to our continued growth as one of the largest and most successful banks in the world. Maintaining a workplace where our employees feel supported to perform at their best, effectively collaborate, drive innovation, and grow professionally helps to bring our Purpose to life and create value for our clients and communities. RBC strives to deliver this through policies and programs intended to foster a workplace based on respect, belonging and opportunity for all.

RBC is presently inviting candidates to apply for this existing vacancy. Applying to this posting allows you to express your interest in this current career opportunity at RBC. Qualified applicants may be contacted to review their resume in more detail.