Headquartered in San Francisco, our investors include.AI Model Evaluation Specialist.Write realistic prompts that reflect how professionals and consumers seek domain-specific guidance.Identify fabr...Show moreLast updated: 10 days ago
Senior Program Manager – Corporate Treasury Liquidity Program
SiaToronto, Ontario, Canada
Full-time
Please note - this is a contractual position.Banking / FSI experience highly preferred.We are seeking a Senior Program Manager to lead Corporate Treasury’s Liquidity Enhancement Program - a multi-y...Show moreLast updated: 30+ days ago
Program Manager 5999
FoilconToronto, Ontario, Canada
Temporary
Ontario and #x27;s Public Safety Radio Network (PSRN) is one of the largest and most complex public safety radio networks in North America.It covers approximately 750,000 km2 of area.PSRN serves mo...Show moreLast updated: 30+ days ago
Program Coordinator
University of TorontoToronto, ON, CA
Full-time +1
Home to over 40 departments and institutes, the University of Toronto's Temerty Faculty of Medicine lies at the heart of the Toronto Academic Health Science Network and is a global leader in ground...Show moreLast updated: 7 days ago
Site Lead - Program Development and Evaluation (East Region)
Toronto Community HousingToronto
Temporary
As a Site Lead on the Program Development and Evaluation team, you will lead and inspire a team to deliver a high-quality program for TCHC youth aged 6-12.You will supervise program staff, have res...Show moreLast updated: 3 days ago
Program Advisor
Toronto Film SchoolToronto, ON, CA
Full-time
Quick Apply
Who we are At Yorkville University and Toronto Film School, we believe education is more than the pursuit of knowledge – it is a catalyst for transformation.Our mission, grounded in democratizing e...Show moreLast updated: 10 days ago
Program Manager
BMO Financial GroupToronto, Ontario Canada
Temporary
BMO is an organization driven by a shared Purpose: Boldly Grow the Good in business and life.It calls on members of its team, to create lasting, positive change for its customers, its communities, ...Show moreLast updated: 30+ days ago
Client Experience & Program Operations Lead - Longevity Program
Legacy+Toronto, ON, CA
Full-time
Quick Apply
Legacy+ is a purpose‑driven organization that helps founders, public figures, and institutions turn vision into measurable impact.We operate as a trifecta—strategic consultant, brand agency, and im...Show moreLast updated: 27 days ago
Program Director
Company 1 - The Manufacturers Life Insurance CompanyCAN, Ontario, Toronto, 200 Bloor Street East
Full-time
We’re seeking a Program Manager to lead our Salesforce portfolio, driving cross-functional initiatives that enhance customer experience, data integrity, and business agility.You will own end-to-end...Show moreLast updated: 20 days ago
Program Lead
Rogers CommunicationsNorth York, ON, CA
Full-time +1
At Rogers, we put our customers first in everything we do! We’re growing our Customer Experience teams and are looking for team members who are committed to showing our customers and Canadians that...Show moreLast updated: 14 days ago
Program Manager
MSX InternationalToronto, Ontario, Canada
Full-time
The Program Manager oversees the coordination and administration of all aspects of an ongoing program including planning, organizing, developing, staffing, leading, and controlling program activiti...Show moreLast updated: 27 days ago
Senior Program Manager
0000050007 Royal Bank of CanadaToronto, Ontario
Full-time
We are seeking an ambitious and high-energy Senior Project Manager to drive and coordinate our numerous modernization initiatives for financial systems, including General Ledger (GL) and Enterprise...Show moreLast updated: 26 days ago
Manager, Performance Evaluation
BaycrestToronto, CA
Full-time +1
The Centre for Aging + Brain Health Innovation (CABHI).Manager, Performance Evaluation.Day, no weekends (subject to change).The Centre for Aging + Brain Health Innovation (CABHI), powered by Baycre...Show moreLast updated: 5 days ago
Site Lead - Program Development and Evaluation (MLSE) (Repost)
Toronto Community HousingToronto
Temporary
As a Site Lead on the Program Development and Evaluation team, you will lead and inspire a team to deliver a high-quality program for TCHC youth aged 6-12.You will supervise program staff, have res...Show moreLast updated: 3 days ago
Program Manager
ScotiabankToronto, ON, CA
Full-time
Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.The Program Manager, Program Management, Canadian Banking Transformation Office contributes to ...Show moreLast updated: 12 days ago
DSM Evaluation Manager - EM&V
Resource InnovationsToronto, ON, CA
Remote
Full-time
Quick Apply
Impact Evaluation Manager to join our expanding team.In this role, you will provide technical support and project management services within the Advisory Services Group business unit, focusing on e...Show moreLast updated: 6 days ago
Program Manager
Randstad CanadaToronto, Ontario, CA
Temporary
Quick Apply
We are seeking a seasoned Program Manager to lead a critical systems integration initiative focused on modernizing and harmonizing digital networks.This role is pivotal in ensuring that stakeholder...Show moreLast updated: 30+ days ago
New!
Program Manager
LancesoftToronto, ON, CA
Full-time
Quick Apply
Location Address: 44 King Street W 13th Floor (44K-13) –hybrid –onsite 3-4x/week.Contract Duration: ASAP –10/30/2026.Possibility of extension and conversion to FTE.Schedule Hours: 9am-5pm Monday-Fr...Show moreLast updated: 2 hours ago
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: AI Model Evaluation Specialist Type:Contract Compensation:$50–$75/hour Commitment:~20 hours/week
Role Responsibilities
Write realistic prompts that reflect how professionals and consumers seek domain-specific guidance.
Evaluate AI-generated responses for factual accuracy, regulatory or clinical correctness, and practical usefulness.
Identify fabricated claims, incorrect references, or misleading reasoning across model outputs.
Score and rank multiple model responses using structured rubrics across dimensions.
Provide written justifications with specific evidence for each evaluation.
Qualifications
Must-Have
Master’s degree or higher in Legal or a relevant professional field.
Professional experience applying domain expertise in a practitioner or advisory capacity.
Familiarity with industry-specific standards, regulations, or clinical guidelines.
Strong written communication and critical reasoning skills.
Application Process (Takes 20–30 mins to complete)
Submit your resume to begin.
Complete the Model Response Evaluation assessment.
Resources & Support
For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.