Talent.com

Program evaluation Jobs in North York, ON

Create a job alert for this search

Program evaluation • north york on

Last updated: 6 days ago

Legal Expert - Evaluation Specialist

MercorToronto, Ontario, Canada
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.AI Model Evaluation Specialist.Write realistic prompts that reflect how professionals and consumers seek domain-specific guidance.Identify fabr...Show more

Implementation Program Manager

Tundra Talent CommunityToronto, ON, Canada (On-site)
Full-time

Implementation Program Manager, Connected Care.As the Implementation Program Manager, you will be responsible for successfully engaging with stakeholders to facilitate the delivery of Connected Car...Show more

Program Manager

Royal Bank of Canada>TORONTO, Canada
Full-time

Own initiatives that involve the Data & Digital Business Intelligence team.Lead and manage complex programs involving varied stakeholders and teams.Focus on initiatives in support of corporate stra...Show more

Program Advisor

Toronto Film SchoolToronto, ON, CA
Full-time
Quick Apply

Who we are At Yorkville University and Toronto Film School, we believe education is more than the pursuit of knowledge – it is a catalyst for transformation.Our mission, grounded in democratizing e...Show more

Client Experience & Program Operations Lead - Longevity Program

Legacy+Toronto, ON, CA
Full-time
Quick Apply

Legacy+ is a purpose‑driven organization that helps founders, public figures, and institutions turn vision into measurable impact.We operate as a trifecta—strategic consultant, brand agency, and im...Show more

SRE Program Manager

Astra North Infoteck Inc.Toronto, ON, ca
Full-time

Define and own the SRE transformation roadmap aligned with business objectives and platform priorities.Strong understanding of SRE principles(SLOSLI| error budgets| toil management| observability)....Show more

Intern Researcher - AI Agent Evaluation

Huawei Technologies Canada Co., Ltd.Markham, Ontario, CA
Full-time

Huawei Canada has an immediate 4-12 month internship opening for an Intern Researcher.Established in 2014, the Distributed Scheduling and Data Engine Lab is Huawei Cloud's technical innovation cent...Show more

Senior Program Manager

0000050007 Royal Bank of CanadaToronto, Ontario
Full-time

We are seeking an ambitious and high-energy Senior Project Manager to drive and coordinate our numerous modernization initiatives for financial systems, including General Ledger (GL) and Enterprise...Show more

Program Manager 5976

FoilconToronto, Ontario, Canada
Temporary

Strategize, implement, and maintain program initiatives that adhere to strategic objectives.Formulate, organize and monitor inter-connected projects, including coordination of cross-project activit...Show more

Sessional Lecturer - KIN8330H: Program Evaluation and Applied Research for Professionals

University of TorontoToronto, ON, CA
Full-time

Faculty of Kinesiology & Physical Education.Faculty of Kinesiology & Physical Education.KIN8330H: Program Evaluation and Applied Research for Professionals .The emphasis of this course is on unders...Show more

Manager, Performance Evaluation

BaycrestToronto, CA
Full-time +1

The Centre for Aging + Brain Health Innovation (CABHI).Manager, Performance Evaluation.Day, no weekends (subject to change).The Centre for Aging + Brain Health Innovation (CABHI), powered by Baycre...Show more

Program Manager

0000055528 RBC Investor Services TrustTORONTO, Ontario, Canada
Full-time

Own initiatives that involve the Data & Digital Business Intelligence team.Lead and manage complex programs involving varied stakeholders and teams.Focus on initiatives in support of corporate stra...Show more

Program Worker - Camp

YWCA TorontoToronto, ON, CA
Full-time +1
Quick Apply

Employment Type: Full Time, Permanent Position Status: New Position Work Hours: 35 hours per week Salary: $61,479 (L7) annually, plus comprehensive benefits Location: Toronto / Parry Sound, Ontario...Show more

Program Manager

BMO Financial GroupScarborough, ON
Temporary

BMO is an organization driven by a shared Purpose: Boldly Grow the Good in business and life.It calls on members of its team, to create lasting, positive change for its customers, its communities, ...Show more

Sessional Lecturer - KIN8330H: Program Evaluation and Applied Research for Professionals

University of TorontoToronto, ON, CA
Full-time

Faculty of Kinesiology & Physical Education.Faculty of Kinesiology & Physical Education.KIN8330H: Program Evaluation and Applied Research for Professionals .The emphasis of this course is on unders...Show more

DSM Evaluation Manager - EM&V

Resource InnovationsToronto, ON, CA
Remote
Full-time
Quick Apply

Impact Evaluation Manager to join our expanding team.In this role, you will provide technical support and project management services within the Advisory Services Group business unit, focusing on e...Show more

Program Manager

NulogyToronto, ON, CA
Full-time
Quick Apply

COMPANY OVERVIEW Nulogy is a manufacturing technology company driven by a vision to make life better for the people who plan, produce, and deliver the products we use every day.Nulogy’s Manufacturi...Show more

Program Manager

Randstad CanadaToronto, Ontario, CA
Temporary
Quick Apply

We are seeking a seasoned Program Manager to lead a critical systems integration initiative focused on modernizing and harmonizing digital networks.This role is pivotal in ensuring that stakeholder...Show more

Program Manager

Advanced Micro Devices, IncMARKHAM, Ontario, Canada
Full-time

WHAT YOU DO AT AMD CHANGES EVERYTHING.At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded syst...Show more

People also ask
Legal Expert - Evaluation Specialist

Legal Expert - Evaluation Specialist

MercorToronto, Ontario, Canada
28 days ago
Job type
  • Part-time
  • Remote
  • Quick Apply
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: AI Model Evaluation Specialist
Type: Contract
Compensation: $50–$75/hour
Commitment: ~20 hours/week

Role Responsibilities

  • Write realistic prompts that reflect how professionals and consumers seek domain-specific guidance.
  • Evaluate AI-generated responses for factual accuracy, regulatory or clinical correctness, and practical usefulness.
  • Identify fabricated claims, incorrect references, or misleading reasoning across model outputs.
  • Score and rank multiple model responses using structured rubrics across dimensions.
  • Provide written justifications with specific evidence for each evaluation.

Qualifications

Must-Have

  • Master’s degree or higher in Legal or a relevant professional field.
  • Professional experience applying domain expertise in a practitioner or advisory capacity.
  • Familiarity with industry-specific standards, regulations, or clinical guidelines.
  • Strong written communication and critical reasoning skills.

Application Process (Takes 20–30 mins to complete)

  • Submit your resume to begin.
  • Complete the Model Response Evaluation assessment.

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.