Headquartered in San Francisco, our investors include.AI Model Evaluation Specialist.Write realistic prompts that reflect how professionals and consumers seek domain-specific guidance.Identify fabr...Show moreLast updated: 5 days ago
Senior Program Manager – Corporate Treasury Liquidity Program
SiaToronto, Ontario, Canada
Full-time
Please note - this is a contractual position.Banking / FSI experience highly preferred.We are seeking a Senior Program Manager to lead Corporate Treasury’s Liquidity Enhancement Program - a multi-y...Show moreLast updated: 25 days ago
Program Coordinator
University of TorontoToronto, ON, CA
Full-time +1
Home to over 40 departments and institutes, the University of Toronto's Temerty Faculty of Medicine lies at the heart of the Toronto Academic Health Science Network and is a global leader in ground...Show moreLast updated: 1 day ago
Program Manager
Artech LLCToronto, ON
Full-time
We are seeking a dynamic and experienced QA Program Manager for an Oracle Fusion project.The ideal candidate will have a strong background in project management and a deep understanding of Oracle F...Show moreLast updated: 25 days ago
Director, Program Enablement
Royal Bank of Canada>TORONTO, Canada
Full-time
Reporting to the Senior Director, Climate in the Chief Data Office, the Director, Program Enablement is accountable for designing, operating, and continuously improving the enterprise enablement la...Show moreLast updated: 20 days ago
Program Manager
BMO Financial GroupToronto, Ontario Canada
Temporary
BMO is an organization driven by a shared Purpose: Boldly Grow the Good in business and life.It calls on members of its team, to create lasting, positive change for its customers, its communities, ...Show moreLast updated: 30+ days ago
Program Advisor
Toronto Film SchoolToronto, ON, CA
Full-time
Quick Apply
Who we are At Yorkville University and Toronto Film School, we believe education is more than the pursuit of knowledge – it is a catalyst for transformation.Our mission, grounded in democratizing e...Show moreLast updated: 4 days ago
Client Experience & Program Operations Lead - Longevity Program
Legacy+Toronto, ON, CA
Full-time
Quick Apply
Legacy+ is a purpose‑driven organization that helps founders, public figures, and institutions turn vision into measurable impact.We operate as a trifecta—strategic consultant, brand agency, and im...Show moreLast updated: 22 days ago
Program Lead
Rogers CommunicationsNorth York, ON, CA
Full-time +1
At Rogers, we put our customers first in everything we do! We’re growing our Customer Experience teams and are looking for team members who are committed to showing our customers and Canadians that...Show moreLast updated: 8 days ago
Program Manager
MSX InternationalToronto, Ontario, Canada
Full-time
The Program Manager oversees the coordination and administration of all aspects of an ongoing program including planning, organizing, developing, staffing, leading, and controlling program activiti...Show moreLast updated: 21 days ago
Program Manager 5976
FoilconToronto, Ontario, Canada
Temporary
Strategize, implement, and maintain program initiatives that adhere to strategic objectives.Formulate, organize and monitor inter-connected projects, including coordination of cross-project activit...Show moreLast updated: 30+ days ago
Assistant Program Coordinator
Ontario Camps AssociationToronto, ON, CA
Full-time +1
Preseason) Manager of Recreation; (Camp Season) Program Coordinator.Camp Woodeden (London, ON) and Camp Merrywood (Perth, ON) each require 1 Asst.Employment Dates and Compensation:.Pre-season: Marc...Show moreLast updated: 30+ days ago
Strategic Development Program Trainee
EMCO Fire ProtectionToronto, Ontario, Canada
Full-time
As a Strategic Development Program Trainee, you will progress through a 5 phased program to learn every aspect of our business from shipping and receiving, to sales, operations, purchasing, account...Show moreLast updated: 21 days ago
Program Manager
ScotiabankToronto, ON, CA
Full-time
Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.The Program Manager, Program Management, Canadian Banking Transformation Office contributes to ...Show moreLast updated: 7 days ago
RQ10420 - Program Manager
Source CodeToronto, ON, Canada
Full-time
Quick Apply
Downtown Toronto, Ontario (onsite).Contract (1+ year with high possibility of extension).This is a Technical PM Role so the client is looking for a hands-on Technical PM with excellent communicatio...Show moreLast updated: 30+ days ago
Senior Program Manager
0000050007 Royal Bank of CanadaTORONTO, Ontario, Canada
Full-time
We are seeking an ambitious and high-energy Senior Project Manager to drive and coordinate our numerous modernization initiatives for financial systems, including General Ledger (GL) and Enterprise...Show moreLast updated: 20 days ago
New!
DSM Evaluation Manager - EM&V
Resource InnovationsToronto, ON, CA
Remote
Full-time
Quick Apply
Impact Evaluation Manager to join our expanding team.In this role, you will provide technical support and project management services within the Advisory Services Group business unit, focusing on e...Show moreLast updated: 7 hours ago
Program Manager
Randstad CanadaToronto, Ontario, CA
Temporary
Quick Apply
We are seeking a seasoned Program Manager to lead a critical systems integration initiative focused on modernizing and harmonizing digital networks.This role is pivotal in ensuring that stakeholder...Show moreLast updated: 30+ days ago
Program Manager
TekWissen LLCToronto, ON, Canada
Temporary
Quick Apply
Overview: TekWissen is a global workforce management provider headquartered in Ann Arbor, Michigan that offers strategic talent solutions to our clients world-wide.The below job opportunity...Show moreLast updated: 8 days ago
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: AI Model Evaluation Specialist Type:Contract Compensation:$50–$75/hour Commitment:~20 hours/week
Role Responsibilities
Write realistic prompts that reflect how professionals and consumers seek domain-specific guidance.
Evaluate AI-generated responses for factual accuracy, regulatory or clinical correctness, and practical usefulness.
Identify fabricated claims, incorrect references, or misleading reasoning across model outputs.
Score and rank multiple model responses using structured rubrics across dimensions.
Provide written justifications with specific evidence for each evaluation.
Qualifications
Must-Have
Master’s degree or higher in Legal or a relevant professional field.
Professional experience applying domain expertise in a practitioner or advisory capacity.
Familiarity with industry-specific standards, regulations, or clinical guidelines.
Strong written communication and critical reasoning skills.
Application Process (Takes 20–30 mins to complete)
Submit your resume to begin.
Complete the Model Response Evaluation assessment.
Resources & Support
For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.