Talent.com

Program evaluation Jobs in North York, ON

Create a job alert for this search

Program evaluation • north york on

Last updated: 1 day ago

Legal Expert - Evaluation Specialist

MercorToronto, Ontario, Canada
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.AI Model Evaluation Specialist.Write realistic prompts that reflect how professionals and consumers seek domain-specific guidance.Identify fabr...Show more

Vehicle Program Coordinator

Adecco CanadaScarborough, Ontario, Canada
Full-time +1
Quick Apply

Adecco is currently hiring a full-time.This role supports the administration of the Employee Vehicle Discount Purchase Program, coordinating all activities related to employee vehicle purchases, fl...Show more

Technology Program Manager

0000050007 Royal Bank of CanadaTORONTO, Ontario, Canada
Full-time

The position is responsible for the planning and successful delivery of long term and / or complex technology projects or programs in a specific business unit while leading matrixed project team me...Show more

Program Manager

Royal Bank of Canada>TORONTO, Canada
Full-time

Own initiatives that involve the Data & Digital Business Intelligence team.Lead and manage complex programs involving varied stakeholders and teams.Focus on initiatives in support of corporate stra...Show more

Program Manager

BMO Financial GroupNorth York, ON
Temporary

BMO is an organization driven by a shared Purpose: Boldly Grow the Good in business and life.It calls on members of its team, to create lasting, positive change for its customers, its communities, ...Show more

Program Manager

Sun LifeSun Life Toronto One York
Full-time +1

Month Contract Opportunity ***.As a Program Manager, Client Solution Center, you will play a critical role in driving complex, cross-functional initiatives that support the end-to-end member experi...Show more

Program Advisor

Toronto Film SchoolToronto, ON, CA
Full-time
Quick Apply

Who we are At Yorkville University and Toronto Film School, we believe education is more than the pursuit of knowledge – it is a catalyst for transformation.Our mission, grounded in democratizing e...Show more

Client Experience & Program Operations Lead - Longevity Program

Legacy+Toronto, ON, CA
Full-time
Quick Apply

Legacy+ is a purpose‑driven organization that helps founders, public figures, and institutions turn vision into measurable impact.We operate as a trifecta—strategic consultant, brand agency, and im...Show more

Program Manager 6014

FoilconToronto, Ontario, Canada
Full-time

Experience with pharmacy dispensed medication workflows.Experience with pharmacy dispensed medication data.Experience with the provincial Electronic Health Record.Knowledge of the Digital Health Dr...Show more

Intern Researcher - AI Agent Evaluation

Huawei Technologies Canada Co., Ltd.Markham, Ontario, CA
Full-time

Huawei Canada has an immediate 4-12 month internship opening for an Intern Researcher.Established in 2014, the Distributed Scheduling and Data Engine Lab is Huawei Cloud's technical innovation cent...Show more

Manager, Performance Evaluation

BaycrestToronto, CA
Full-time +1

The Centre for Aging + Brain Health Innovation (CABHI).Manager, Performance Evaluation.Day, no weekends (subject to change).The Centre for Aging + Brain Health Innovation (CABHI), powered by Baycre...Show more

Program Manager

0000055528 RBC Investor Services TrustTORONTO, Ontario, Canada
Full-time

Own initiatives that involve the Data & Digital Business Intelligence team.Lead and manage complex programs involving varied stakeholders and teams.Focus on initiatives in support of corporate stra...Show more

Sessional Lecturer - KIN8330H: Program Evaluation and Applied Research for Professionals

University of TorontoToronto, ON, CA
Full-time

Faculty of Kinesiology & Physical Education.Faculty of Kinesiology & Physical Education.KIN8330H: Program Evaluation and Applied Research for Professionals .The emphasis of this course is on unders...Show more

DSM Evaluation Manager - EM&V

Resource InnovationsToronto, ON, CA
Remote
Full-time
Quick Apply

Impact Evaluation Manager to join our expanding team.In this role, you will provide technical support and project management services within the Advisory Services Group business unit, focusing on e...Show more

Program Manager

Advanced Micro Devices, IncMARKHAM, Ontario, Canada
Full-time

WHAT YOU DO AT AMD CHANGES EVERYTHING.At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded syst...Show more

Program Manager

NulogyToronto, ON, CA
Full-time
Quick Apply

COMPANY OVERVIEW Nulogy is a manufacturing technology company driven by a vision to make life better for the people who plan, produce, and deliver the products we use every day.Nulogy’s Manufacturi...Show more

Program Manager

Randstad CanadaToronto, Ontario, CA
Temporary
Quick Apply

We are seeking a seasoned Program Manager to lead a critical systems integration initiative focused on modernizing and harmonizing digital networks.This role is pivotal in ensuring that stakeholder...Show more

Dance Program Specialist

Branksome HallToronto, ON, CA
Part-time

Branksome Hall, a leading independent International Baccalaureate (IB) World School, offers remarkable Day Camps during the summer.Join our dynamic team, on a picturesque 13-acre campus in the hear...Show more

SRE Program Manager

Astra North Infoteck Inc.Toronto, ON, ca
Full-time
Quick Apply

Define and own the SRE transformation roadmap aligned with business objectives and platform priorities.Strong understanding of SRE principles(SLOSLI| error budgets| toil management| observability)....Show more

People also ask
Legal Expert - Evaluation Specialist

Legal Expert - Evaluation Specialist

MercorToronto, Ontario, Canada
27 days ago
Job type
  • Part-time
  • Remote
  • Quick Apply
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: AI Model Evaluation Specialist
Type: Contract
Compensation: $50–$75/hour
Commitment: ~20 hours/week

Role Responsibilities

  • Write realistic prompts that reflect how professionals and consumers seek domain-specific guidance.
  • Evaluate AI-generated responses for factual accuracy, regulatory or clinical correctness, and practical usefulness.
  • Identify fabricated claims, incorrect references, or misleading reasoning across model outputs.
  • Score and rank multiple model responses using structured rubrics across dimensions.
  • Provide written justifications with specific evidence for each evaluation.

Qualifications

Must-Have

  • Master’s degree or higher in Legal or a relevant professional field.
  • Professional experience applying domain expertise in a practitioner or advisory capacity.
  • Familiarity with industry-specific standards, regulations, or clinical guidelines.
  • Strong written communication and critical reasoning skills.

Application Process (Takes 20–30 mins to complete)

  • Submit your resume to begin.
  • Complete the Model Response Evaluation assessment.

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.