Program evaluation Jobs in Old toronto, ON
Create a job alert for this search
Program evaluation • old toronto on
Last updated: 2 days ago
Headquartered in San Francisco, our investors include.AI Model Evaluation Specialist.Write realistic prompts that reflect how professionals and consumers seek domain-specific guidance.Identify fabr...Show moreLast updated: 3 days ago
Please note - this is a contractual position.Banking / FSI experience highly preferred.We are seeking a Senior Program Manager to lead Corporate Treasury’s Liquidity Enhancement Program - a multi-y...Show moreLast updated: 24 days ago
We are seeking a dynamic and experienced QA Program Manager for an Oracle Fusion project.The ideal candidate will have a strong background in project management and a deep understanding of Oracle F...Show moreLast updated: 24 days ago
Reporting to the Senior Director, Climate in the Chief Data Office, the Director, Program Enablement is accountable for designing, operating, and continuously improving the enterprise enablement la...Show moreLast updated: 19 days ago
Who we are At Yorkville University and Toronto Film School, we believe education is more than the pursuit of knowledge – it is a catalyst for transformation.Our mission, grounded in democratizing e...Show moreLast updated: 2 days ago
BMO is an organization driven by a shared Purpose: Boldly Grow the Good in business and life.It calls on members of its team, to create lasting, positive change for its customers, its communities, ...Show moreLast updated: 30+ days ago
Legacy+ is a purpose‑driven organization that helps founders, public figures, and institutions turn vision into measurable impact.We operate as a trifecta—strategic consultant, brand agency, and im...Show moreLast updated: 20 days ago
Experience with pharmacy dispensed medication workflows.Experience with pharmacy dispensed medication data.Experience with the provincial Electronic Health Record.Knowledge of the Digital Health Dr...Show moreLast updated: 30+ days ago
We’re seeking a Program Manager to lead our Salesforce portfolio, driving cross-functional initiatives that enhance customer experience, data integrity, and business agility.You will own end-to-end...Show moreLast updated: 12 days ago
The Program Manager oversees the coordination and administration of all aspects of an ongoing program including planning, organizing, developing, staffing, leading, and controlling program activiti...Show moreLast updated: 19 days ago
The Rotman School of Management is part of the University of Toronto, a global centre of research and academic excellence at the heart of Canada’s commercial and financial capital.Rotman is a catal...Show moreLast updated: 9 days ago
At Rogers, we put our customers first in everything we do! We’re growing our Customer Experience teams and are looking for team members who are committed to showing our customers and Canadians that...Show moreLast updated: 7 days ago
We are seeking an ambitious and high-energy Senior Project Manager to drive and coordinate our numerous modernization initiatives for financial systems, including General Ledger (GL) and Enterprise...Show moreLast updated: 18 days ago
As an Engineering & Data Science Specialist in Applied AI Evaluations, you will design, implement, and optimize evaluation frameworks and pipelines that measure the quality, safety, and performance...Show moreLast updated: 25 days ago
Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.The Program Manager, Program Management, Canadian Banking Transformation Office contributes to ...Show moreLast updated: 5 days ago
Downtown Toronto, Ontario (onsite).Contract (1+ year with high possibility of extension).This is a Technical PM Role so the client is looking for a hands-on Technical PM with excellent communicatio...Show moreLast updated: 30+ days ago
We are seeking a seasoned Program Manager to lead a critical systems integration initiative focused on modernizing and harmonizing digital networks.This role is pivotal in ensuring that stakeholder...Show moreLast updated: 30+ days ago
Overview: TekWissen is a global workforce management provider headquartered in Ann Arbor, Michigan that offers strategic talent solutions to our clients world-wide.The below job opportunity...Show moreLast updated: 6 days ago
Toronto, ON; Brossard, QC; Burlington, ON; Calgary, AB; Edmonton, AB; Fredericton, NB; Halifax, NS; Kitchener, ON; Laval, QC; Moncton, NB; Montreal, QC; Ottawa, ON; Quebec City, QC; Regina, SK; Sai...Show moreLast updated: 5 days ago
Legal Expert - Evaluation Specialist
MercorToronto, Ontario, CanadaRemote
Part-time
Quick Apply
Senior Program Manager – Corporate Treasury Liquidity Program
SiaToronto, Ontario, CanadaFull-time
Program Manager
Artech LLCToronto, ONFull-time
Director, Program Enablement
Royal Bank of Canada>TORONTO, CanadaFull-time
Program Advisor
Toronto Film SchoolToronto, ON, CAFull-time
Quick Apply
Program Manager
BMO Financial GroupToronto, Ontario CanadaTemporary
Client Experience & Program Operations Lead - Longevity Program
Legacy+Toronto, ON, CAFull-time
Quick Apply
Program Manager 6014
FoilconToronto, Ontario, CanadaFull-time
Program Director
Company 1 - The Manufacturers Life Insurance CompanyCAN, Ontario, Toronto, 200 Bloor Street EastFull-time
Program Manager
MSX InternationalToronto, Ontario, CanadaFull-time
Program Assistant
University of TorontoToronto, ON, CAFull-time
Program Lead
Rogers CommunicationsNorth York, ON, CAFull-time +1
Senior Program Manager
0000050007 Royal Bank of CanadaToronto, OntarioFull-time
Applied AI Evaluation Engineer
BMOToronto, ON, CANFull-time +1
Program Manager
ScotiabankToronto, ON, CAFull-time
RQ10420 - Program Manager
Source CodeToronto, ON, CanadaFull-time
Quick Apply
Program Manager
Randstad CanadaToronto, Ontario, CATemporary
Quick Apply
Program Manager
TekWissen LLCToronto, ON, CanadaTemporary
Quick Apply
Technical Program Manager
DeloitteToronto, ON, ON, CAPermanent
- Greater Sudbury, ON (from $ 76,091 to $ 150,000 year)
- Montreal, QC (from $ 65,678 to $ 134,550 year)
- Richmond Hill, ON (from $ 69,693 to $ 124,537 year)
- Toronto, ON (from $ 73,542 to $ 109,244 year)
- Longueuil, QC (from $ 71,704 to $ 107,505 year)
- Quebec City, QC (from $ 69,299 to $ 107,457 year)
- Calgary, AB (from $ 48,912 to $ 106,278 year)
- St. John's, NL (from $ 69,299 to $ 105,814 year)
- Edmonton, AB (from $ 60,527 to $ 105,488 year)
- Vancouver, BC (from $ 75,108 to $ 103,543 year)
Legal Expert - Evaluation Specialist
MercorToronto, Ontario, Canada3 days ago
Job type
- Part-time
- Remote
- Quick Apply
Job description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: AI Model Evaluation Specialist
Type: Contract
Compensation: $50–$75/hour
Commitment: ~20 hours/week
Role Responsibilities
- Write realistic prompts that reflect how professionals and consumers seek domain-specific guidance.
- Evaluate AI-generated responses for factual accuracy, regulatory or clinical correctness, and practical usefulness.
- Identify fabricated claims, incorrect references, or misleading reasoning across model outputs.
- Score and rank multiple model responses using structured rubrics across dimensions.
- Provide written justifications with specific evidence for each evaluation.
Qualifications
Must-Have
- Master’s degree or higher in Legal or a relevant professional field.
- Professional experience applying domain expertise in a practitioner or advisory capacity.
- Familiarity with industry-specific standards, regulations, or clinical guidelines.
- Strong written communication and critical reasoning skills.
Application Process (Takes 20–30 mins to complete)
- Submit your resume to begin.
- Complete the Model Response Evaluation assessment.
Resources & Support
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
- For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.