Headquartered in San Francisco, our investors include.AI Model Evaluation Specialist.Write realistic prompts that reflect how professionals and consumers seek domain-specific guidance.Identify fabr...Show moreLast updated: 2 days ago
Senior Program Manager – Corporate Treasury Liquidity Program
SiaToronto, Ontario, Canada
Full-time
Please note - this is a contractual position.Banking / FSI experience highly preferred.We are seeking a Senior Program Manager to lead Corporate Treasury’s Liquidity Enhancement Program - a multi-y...Show moreLast updated: 23 days ago
Program Activation Lead
MCD McKesson Canada Corporation / La Corporation McKesson CanadaMississauga, ON, CAN
Full-time
The Program Activation Lead owns the Talent & Performance activation approach—sequencing programs, enforcing standards, and shaping digital experiences that make complex talent and culture strategi...Show moreLast updated: 15 days ago
Director, Program Enablement
Royal Bank of Canada>TORONTO, Canada
Full-time
Reporting to the Senior Director, Climate in the Chief Data Office, the Director, Program Enablement is accountable for designing, operating, and continuously improving the enterprise enablement la...Show moreLast updated: 18 days ago
Program Advisor
Toronto Film SchoolToronto, ON, CA
Full-time
Quick Apply
Who we are At Yorkville University and Toronto Film School, we believe education is more than the pursuit of knowledge – it is a catalyst for transformation.Our mission, grounded in democratizing e...Show moreLast updated: 1 day ago
Program Manager
BMO Financial GroupToronto, Ontario Canada
Temporary
BMO is an organization driven by a shared Purpose: Boldly Grow the Good in business and life.It calls on members of its team, to create lasting, positive change for its customers, its communities, ...Show moreLast updated: 30+ days ago
Client Experience & Program Operations Lead - Longevity Program
Legacy+Toronto, ON, CA
Full-time
Quick Apply
Legacy+ is a purpose‑driven organization that helps founders, public figures, and institutions turn vision into measurable impact.We operate as a trifecta—strategic consultant, brand agency, and im...Show moreLast updated: 19 days ago
Program Manager 6014
FoilconToronto, Ontario, Canada
Full-time
Experience with pharmacy dispensed medication workflows.Experience with pharmacy dispensed medication data.Experience with the provincial Electronic Health Record.Knowledge of the Digital Health Dr...Show moreLast updated: 30+ days ago
Evaluation Warehouse Clerk
ConMedMississauga, Ontario
Full-time
CONMED Corporation is a progressive, global medical device company, operating in.Through thoughtful leadership, innovation and team work, we are changing the future of healthcare.Our 3,500 employee...Show moreLast updated: 30+ days ago
Program Manager
MSX InternationalToronto, Ontario, Canada
Full-time
The Program Manager oversees the coordination and administration of all aspects of an ongoing program including planning, organizing, developing, staffing, leading, and controlling program activiti...Show moreLast updated: 18 days ago
Program Assistant
University of TorontoToronto, ON, CA
Full-time
The Rotman School of Management is part of the University of Toronto, a global centre of research and academic excellence at the heart of Canada’s commercial and financial capital.Rotman is a catal...Show moreLast updated: 8 days ago
Program Director
Company 1 - The Manufacturers Life Insurance CompanyCAN, Ontario, Toronto, 200 Bloor Street East
Full-time
We’re seeking a Program Manager to lead our Salesforce portfolio, driving cross-functional initiatives that enhance customer experience, data integrity, and business agility.You will own end-to-end...Show moreLast updated: 11 days ago
Senior Program Manager
0000050007 Royal Bank of CanadaToronto, Ontario
Full-time
We are seeking an ambitious and high-energy Senior Project Manager to drive and coordinate our numerous modernization initiatives for financial systems, including General Ledger (GL) and Enterprise...Show moreLast updated: 17 days ago
Assistant Program Coordinator
Ontario Camps AssociationToronto, ON, CA
Full-time +1
Preseason) Manager of Recreation; (Camp Season) Program Coordinator.Camp Woodeden (London, ON) and Camp Merrywood (Perth, ON) each require 1 Asst.Employment Dates and Compensation:.Pre-season: Marc...Show moreLast updated: 30+ days ago
Applied AI Evaluation Engineer
BMOToronto, ON, CAN
Full-time +1
As an Engineering & Data Science Specialist in Applied AI Evaluations, you will design, implement, and optimize evaluation frameworks and pipelines that measure the quality, safety, and performance...Show moreLast updated: 24 days ago
Program Manager
ScotiabankToronto, ON, CA
Full-time
Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.The Program Manager, Program Management, Canadian Banking Transformation Office contributes to ...Show moreLast updated: 4 days ago
Program Manager
Randstad CanadaToronto, Ontario, CA
Temporary
Quick Apply
Cella by Randstad Digital is currently recruiting for a dynamic Program / Account Manager to join the creative team of one of our premier clients in the retail and brand space.This is a high-impact...Show moreLast updated: 30+ days ago
Program Manager
TekWissen LLCToronto, ON, Canada
Temporary
Quick Apply
Overview: TekWissen is a global workforce management provider headquartered in Ann Arbor, Michigan that offers strategic talent solutions to our clients world-wide.The below job opportunity...Show moreLast updated: 5 days ago
Sr AI Research Scientist, AI Evaluation and Reliability
UpworkToronto, Ontario, Canada
Full-time
Nasdaq: UPWK) family of companies connects businesses with global, AI-enabled talent across every contingent work type including freelance, fractional, and payrolled.This portfolio includes the Upw...Show moreLast updated: 30+ days ago
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: AI Model Evaluation Specialist Type:Contract Compensation:$50–$75/hour Commitment:~20 hours/week
Role Responsibilities
Write realistic prompts that reflect how professionals and consumers seek domain-specific guidance.
Evaluate AI-generated responses for factual accuracy, regulatory or clinical correctness, and practical usefulness.
Identify fabricated claims, incorrect references, or misleading reasoning across model outputs.
Score and rank multiple model responses using structured rubrics across dimensions.
Provide written justifications with specific evidence for each evaluation.
Qualifications
Must-Have
Master’s degree or higher in Legal or a relevant professional field.
Professional experience applying domain expertise in a practitioner or advisory capacity.
Familiarity with industry-specific standards, regulations, or clinical guidelines.
Strong written communication and critical reasoning skills.
Application Process (Takes 20–30 mins to complete)
Submit your resume to begin.
Complete the Model Response Evaluation assessment.
Resources & Support
For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.