Talent.com

Program evaluation Jobs in North York, ON

Create a job alert for this search

Program evaluation • north york on

Last updated: 6 days ago

Gujarati Language Evaluation Specialist

MercorToronto, Ontario, Canada
CA$15.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.Generalist - English & Gujarati.Conduct fact-checking using trusted public sources and external.Generate high-quality human evaluation data... Show more

Research & Evaluation Assistant

YMCA Greater TorontoToronto, ON, CAN
CA$19.51 hourly
Permanent

Location: 90 Eglinton Avenue E.Employment Type: Contract Hourly for 8 weeks .Anticipated Start Date: June 22, 2026.Deadline to Apply: June 15, 2026 At 5PM.Join our passionate team and help us to ac... Show more

Organizational Development Specialist (Monitoring & Evaluation)

Cuso InternationalToronto, Ontario
Permanent

This Volunteer Placement is Located in:.Open to Canadian Citizens and Permanent Residents of Canada only.This placement offers a unique opportunity to collaborate with our partner, the Private Sect... Show more

 • Promoted

Program Manager

Artech LLCToronto, ON
Full-time

Job Title: Program Manager.Location: Toronto, Ontario.As a Senior Technical Delivery Program Manager in the AML (Anti-Money Laundering) and Financial Crime space, you are essentially the ... Show more

Organizational Development Specialist (Monitoring & Evaluation)

Cuso InternationalMarkham, Ontario
Permanent

This Volunteer Placement is Located in:.Open to Canadian Citizens and Permanent Residents of Canada only.This placement offers a unique opportunity to collaborate with our partner, the Private Sect... Show more

 • Promoted

Client Experience & Program Operations Lead - Longevity Program

Legacy+Toronto, ON, CA
Full-time
Quick Apply

Legacy+ is a purpose‑driven organization that helps founders, public figures, and institutions turn vision into measurable impact.We operate as a trifecta—strategic consultant, brand ag... Show more

Intern Researcher - AI Agent Evaluation

Huawei Technologies Canada Co., Ltd.Markham, Ontario, CA
Full-time

Huawei Canada has an immediate 4-12 month internship opening for an Intern Researcher.Established in 2014, the Distributed Scheduling and Data Engine Lab is Huawei Cloud's technical innovation cent... Show more

Organizational Development Specialist (Monitoring & Evaluation)

Cuso InternationalVaughan, Ontario
Permanent

This Volunteer Placement is Located in:.Open to Canadian Citizens and Permanent Residents of Canada only.This placement offers a unique opportunity to collaborate with our partner, the Private Sect... Show more

 • Promoted

Program Manager

Randstad CanadaToronto, Ontario, CA
CA$80.64 hourly
Temporary
Quick Apply

We are seeking a highly skilled and organized Program Manager to lead complex, high-profile I&IT initiatives.In this role, you will be responsible for ensuring project deliverables align with b... Show more

Program Director

Jolera Inc.Toronto, Ontario, Canada
Full-time

Jolera stands as a distinguished multinational Global Systems Integrator (GSI), a vanguard in delivering comprehensive and bespoke IT solutions to a diverse clientele, encompassing both direct cust... Show more

Program Manager

NulogyToronto, ON, CA
Full-time
Quick Apply

COMPANY OVERVIEW Nulogy is a manufacturing technology company driven by a vision to make life better for the people who plan, produce, and deliver the products we use every day.Nulogy’s Manuf... Show more

People also ask
Gujarati Language Evaluation Specialist

Gujarati Language Evaluation Specialist

MercorToronto, Ontario, Canada
8 days ago
Salary
CA$15.00 hourly
Job type
  • Part-time
  • Remote
  • Quick Apply
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Generalist - English & Gujarati
Type: Contract
Compensation: $15–$20/hour
Location: Remote

Role Responsibilities

  • Conduct fact-checking using trusted public sources and external tools.
  • Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies.
  • Assess reasoning quality, clarity, tone, and completeness of responses.
  • Ensure model responses align with expected conversational behavior and system guidelines.

Qualifications

Must-Have

  • Bachelor's degree
  • Native speaker in Gujarati
  • Significant experience using large language models (LLMs)
  • Excellent writing skills in English
  • Strong attention to detail
  • Background or experience in domains requiring structured analytical thinking (e.g., research, policy, analytics, linguistics, engineering)

Preferred

  • Prior experience with RLHF, model evaluation, or data annotation work
  • Experience writing or editing high-quality written content
  • Experience comparing multiple outputs and making fine-grained qualitative judgments

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.