Job Description
WHAT IS THE OPPORTUNITY?We're building the engine that judges how good our agents actually are. Claimshave to be data-driven: you can't build on what you can't see, so how can youhonestly say one version is 10% better than the last? Evaluation runs both beforewe ship and after; this role owns the runtime side — judging agents live inproduction, from the traces they generate serving real traffic.The hard part is the data. Agent behaviour generates verbose traces with highcardinality, and we need a system that can analyze them real-time, providingactionable insights in low latency. Join us to build it: the engineering looks alot like site reliability engineering meeting user analytics, combininghigh-throughput low latency data with evaluating user behaviour and outcomes.WHAT WILL YOU DO?Build the ingestion path that takes agent traces at production volume and keeps up with it.
Score agent behaviour live — judge quality straight from the trace as it happens, not in a batch job hours later.
Enforce quality and safety guardrails in the request path stopping it before it reaches the user, within a fixed latency budget and at predictable cost.
Correlate spans across services so one request reads as one trace.
Own the experience of turning production traces back into datasets and test cases the next version is measured against.
Set the technical direction for this burgeoning field, and push it into the open through open source contributions and conference talks.
In this role, you will communicate and interact frequently with RBC partners and/or employees located across Canada and/or worldwide
8+ years in software or platform engineering, with 5+ in SRE, real-time data infrastructure, observability, or large-scale stream processing.
A track record running high-volume telemetry in production with hands-on work on ingestion, storage, and query at scale.
Distributed tracing and Open Telemetry: semantic conventions, collector configuration, span correlation across services.
Familiarity with routing traffic on live signal, whether that's weighted load balancing, canary rollouts, or multi-armed-bandit routing.
Turning telemetry into decisions in real time — scoring, anomaly detection, or
rule/threshold evaluation on streaming data.
An LLM observability platform (`Langfuse`, `MLFlow`, or equivalent) and the trace-to-evaluation feedback loop.
A feel for the latency and backpressure trade-offs of doing work in the live request path — collectors, proxies, sidecars.
Experience in a regulated industry (financial services, healthcare) and its constraints on AI infrastructure.
AI security controls in the request path: prompt-injection mitigation, output filtering, PII detection.
AI governance, model audit logging, and runtime drift detection.
Open-source contributions or published work in observability, tracing, or LLM evaluation.
A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable
Leaders who support your development through coaching and managing opportunities
Ability to make a difference and lasting impact
Work in a dynamic, collaborative, progressive, and high-performing team
A world-class training program in financial services
Opportunities to do challenging work
Address:
RBC WATERPARK PLACE, 88 QUEENS QUAY W:TORONTOCity:
TorontoCountry:
CanadaWork hours/week:
37.5Employment Type:
Full timePlatform:
TECHNOLOGY AND OPERATIONSJob Type:
RegularPay Type:
SalariedPosted Date:
2026-06-22Application Deadline:
2026-07-31Note: Applications will be accepted until 11:59 PM on the day prior to the application deadline date aboveOur Employment OpportunitiesAt RBC, we are guided by living shared values of Client First, Integrity, Collaboration, Respect and Excellence and winning together as One RBC. We believe an inclusive workplace that has diverse perspectives is core to our continued growth as one of the largest and most successful banks in the world. Maintaining a workplace where our employees feel supported to perform at their best, effectively collaborate, drive innovation, and grow professionally helps to bring our Purpose to life and create value for our clients and communities. RBC strives to deliver this through policies and programs intended to foster a workplace based on respect, belonging and opportunity for all.Join our Talent Community
Stay in-the-know about great career opportunities at RBC. Sign up and get customized info on our latest jobs, career tips and Recruitment events that matter to you.
Expand your limits and create a new future together at RBC. Find out how we use our passion and drive to enhance the well-being of our clients and communities at jobs.rbc.com.
Staff AI Engineer • TORONTO, Ontario, Canada
Step into the role of Lead Staff Engineer in Generative AI to create scalable AI applications that leverage cutting-edge cloud technologies.Drive innovation and engineering excellence within our te... Show more
A leading cloud-based network management company in Toronto is seeking a Staff Software Developer to join their AI & Platform team.The ideal candidate will oversee the design and implementation of ... Show more
Vacancy Status: No: This posting is not for an existing vacancy within the organization and is open to new applications.AI Disclosure: As part of the application process, Artificial Intelligence wi... Show more
At Tangerine, we’re redefining banking.As Canada’s leading digital bank, we thrive on innovation, agility, and bold thinking, tackling every challenge head‑on with leading technology and the unstop... Show more
Staff Software Engineer - Agentic AI Systems.We are seeking a Staff Agentic AI Engineer to lead the architecture, implementation, and production deployment of advanced agentic AI systems.In this ro... Show more
About the Role We are a small team of AI builders in Paytm Labs.As a Staff AI Platform Engineer, you will work across inference and agentic systems.You will contribute to Paytm's AI inference platf... Show more
A technology firm specializing in identity solutions is seeking a Staff Machine Learning Engineer to drive the development of scalable AI systems.This role involves designing and implementing AI in... Show more
A leading AI solutions provider in Toronto is seeking a Staff Software Engineer to join their AI Compute team.The successful candidate will lead technical initiatives, mentor engineers, and design ... Show more
Engineering Group, Engineering Group >.As a leading technology innovator, Qualcomm pushes the boundaries of what's possible to enable next-generation experiences and drive digital transformation to... Show more
Is this role right for you? In this role, you will:.Deliver and Scale Agentic AI Solutions:.Design, build, and productionize LLM-powered and agentic applications, including retrieval-augmented gene... Show more
This is a tremendous opportunity to reinvent architecture in the AI Age.As a Staff AI Architect/Engineer, you will build AI‑powered solutions to aid our AI Architecture practices, governance and AI... Show more
A leading global information services company in Toronto is seeking a Staff Software Engineer (AI) to join their Forward Engineering team.The role involves architecting and implementing enterprise-... Show more
MasterClass is building the next generation of learning products with AI at the core.Foundation models and agentic systems are central to how we design and deliver every new product, powering intel... Show more
We are a small team of AI builders in Paytm Labs.As a Staff AI Platform Engineer, you will work across inference and agentic systems.You will contribute to Paytm's AI inference platform (Pi), servi... Show more
Be at the forefront of AI solutions as a Staff Software Engineer.Architect robust infrastructure that enhances AI product performance and develops innovative deployment strategies for maximum effic... Show more
A leading software company in Toronto is seeking a Staff Engineer to shape its technical direction and influence various strategic areas.The role involves navigating complex problems, championing s... Show more
About SecurityScorecard SecurityScorecard is the global leader in cybersecurity ratings, with over 12 million companies continuously rated, operating in 64 countries.Founded in 2013 by security and... Show more
We’re looking for a Staff Engineer with strong hands‑on experience in agentic AI systems who will contribute to accelerating agentic AI adoption across RBC.This role offers the opportunity to build... Show more
Ignite transformative AI development as a Staff Software Engineer.Redefine sales performance strategies through expert architecture and mentorship in this remote and hybrid role.In this important l... Show more
Join as a Staff Forward Deployed AI Engineer, specializing in cloud-native AI solutions that deliver real business value.This role is hands-on, focusing on coding, system designs, and quick prototy... Show more
