Talent.com

Program evaluation Jobs in Etobicoke, ON

Create a job alert for this search

Program evaluation • etobicoke on

Last updated: 1 day ago
Legal Expert - Evaluation Specialist

Legal Expert - Evaluation Specialist

MercorToronto, Ontario, Canada
Remote
Part-time
Quick Apply
Headquartered in San Francisco, our investors include.AI Model Evaluation Specialist.Write realistic prompts that reflect how professionals and consumers seek domain-specific guidance.Identify fabr...Show moreLast updated: 2 days ago
Senior Program Manager – Corporate Treasury Liquidity Program

Senior Program Manager – Corporate Treasury Liquidity Program

SiaToronto, Ontario, Canada
Full-time
Please note - this is a contractual position.Banking / FSI experience highly preferred.We are seeking a Senior Program Manager to lead Corporate Treasury’s Liquidity Enhancement Program - a multi-y...Show moreLast updated: 23 days ago
Program Activation Lead

Program Activation Lead

MCD McKesson Canada Corporation / La Corporation McKesson CanadaMississauga, ON, CAN
Full-time
The Program Activation Lead owns the Talent & Performance activation approach—sequencing programs, enforcing standards, and shaping digital experiences that make complex talent and culture strategi...Show moreLast updated: 15 days ago
Director, Program Enablement

Director, Program Enablement

Royal Bank of Canada>TORONTO, Canada
Full-time
Reporting to the Senior Director, Climate in the Chief Data Office, the Director, Program Enablement is accountable for designing, operating, and continuously improving the enterprise enablement la...Show moreLast updated: 18 days ago
Program Advisor

Program Advisor

Toronto Film SchoolToronto, ON, CA
Full-time
Quick Apply
Who we are At Yorkville University and Toronto Film School, we believe education is more than the pursuit of knowledge – it is a catalyst for transformation.Our mission, grounded in democratizing e...Show moreLast updated: 1 day ago
Program Manager

Program Manager

BMO Financial GroupToronto, Ontario Canada
Temporary
BMO is an organization driven by a shared Purpose: Boldly Grow the Good in business and life.It calls on members of its team, to create lasting, positive change for its customers, its communities, ...Show moreLast updated: 30+ days ago
Client Experience & Program Operations Lead - Longevity Program

Client Experience & Program Operations Lead - Longevity Program

Legacy+Toronto, ON, CA
Full-time
Quick Apply
Legacy+ is a purpose‑driven organization that helps founders, public figures, and institutions turn vision into measurable impact.We operate as a trifecta—strategic consultant, brand agency, and im...Show moreLast updated: 19 days ago
Program Manager 6014

Program Manager 6014

FoilconToronto, Ontario, Canada
Full-time
Experience with pharmacy dispensed medication workflows.Experience with pharmacy dispensed medication data.Experience with the provincial Electronic Health Record.Knowledge of the Digital Health Dr...Show moreLast updated: 30+ days ago
Evaluation Warehouse Clerk

Evaluation Warehouse Clerk

ConMedMississauga, Ontario
Full-time
CONMED Corporation is a progressive, global medical device company, operating in.Through thoughtful leadership, innovation and team work, we are changing the future of healthcare.Our 3,500 employee...Show moreLast updated: 30+ days ago
Program Manager

Program Manager

MSX InternationalToronto, Ontario, Canada
Full-time
The Program Manager oversees the coordination and administration of all aspects of an ongoing program including planning, organizing, developing, staffing, leading, and controlling program activiti...Show moreLast updated: 18 days ago
Program Assistant

Program Assistant

University of TorontoToronto, ON, CA
Full-time
The Rotman School of Management is part of the University of Toronto, a global centre of research and academic excellence at the heart of Canada’s commercial and financial capital.Rotman is a catal...Show moreLast updated: 8 days ago
Program Director

Program Director

Company 1 - The Manufacturers Life Insurance CompanyCAN, Ontario, Toronto, 200 Bloor Street East
Full-time
We’re seeking a Program Manager to lead our Salesforce portfolio, driving cross-functional initiatives that enhance customer experience, data integrity, and business agility.You will own end-to-end...Show moreLast updated: 11 days ago
Senior Program Manager

Senior Program Manager

0000050007 Royal Bank of CanadaToronto, Ontario
Full-time
We are seeking an ambitious and high-energy Senior Project Manager to drive and coordinate our numerous modernization initiatives for financial systems, including General Ledger (GL) and Enterprise...Show moreLast updated: 17 days ago
Assistant Program Coordinator

Assistant Program Coordinator

Ontario Camps AssociationToronto, ON, CA
Full-time +1
Preseason) Manager of Recreation; (Camp Season) Program Coordinator.Camp Woodeden (London, ON) and Camp Merrywood (Perth, ON) each require 1 Asst.Employment Dates and Compensation:.Pre-season: Marc...Show moreLast updated: 30+ days ago
Applied AI Evaluation Engineer

Applied AI Evaluation Engineer

BMOToronto, ON, CAN
Full-time +1
As an Engineering & Data Science Specialist in Applied AI Evaluations, you will design, implement, and optimize evaluation frameworks and pipelines that measure the quality, safety, and performance...Show moreLast updated: 24 days ago
Program Manager

Program Manager

ScotiabankToronto, ON, CA
Full-time
Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.The Program Manager, Program Management, Canadian Banking Transformation Office contributes to ...Show moreLast updated: 4 days ago
Program Manager

Program Manager

Randstad CanadaToronto, Ontario, CA
Temporary
Quick Apply
Cella by Randstad Digital is currently recruiting for a dynamic Program / Account Manager to join the creative team of one of our premier clients in the retail and brand space.This is a high-impact...Show moreLast updated: 30+ days ago
Program Manager

Program Manager

TekWissen LLCToronto, ON, Canada
Temporary
Quick Apply
Overview: TekWissen is a global workforce management provider headquartered in Ann Arbor, Michigan that offers strategic talent solutions to our clients world-wide.The below job opportunity...Show moreLast updated: 5 days ago
Sr AI Research Scientist, AI Evaluation and Reliability

Sr AI Research Scientist, AI Evaluation and Reliability

UpworkToronto, Ontario, Canada
Full-time
Nasdaq: UPWK) family of companies connects businesses with global, AI-enabled talent across every contingent work type including freelance, fractional, and payrolled.This portfolio includes the Upw...Show moreLast updated: 30+ days ago
People also ask
Legal Expert - Evaluation Specialist

Legal Expert - Evaluation Specialist

MercorToronto, Ontario, Canada
2 days ago
Job type
  • Part-time
  • Remote
  • Quick Apply
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: AI Model Evaluation Specialist
Type: Contract
Compensation: $50–$75/hour
Commitment: ~20 hours/week

Role Responsibilities

  • Write realistic prompts that reflect how professionals and consumers seek domain-specific guidance.
  • Evaluate AI-generated responses for factual accuracy, regulatory or clinical correctness, and practical usefulness.
  • Identify fabricated claims, incorrect references, or misleading reasoning across model outputs.
  • Score and rank multiple model responses using structured rubrics across dimensions.
  • Provide written justifications with specific evidence for each evaluation.

Qualifications

Must-Have

  • Master’s degree or higher in Legal or a relevant professional field.
  • Professional experience applying domain expertise in a practitioner or advisory capacity.
  • Familiarity with industry-specific standards, regulations, or clinical guidelines.
  • Strong written communication and critical reasoning skills.

Application Process (Takes 20–30 mins to complete)

  • Submit your resume to begin.
  • Complete the Model Response Evaluation assessment.

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.