Talent.com
Mercor
Professional Evaluator - Fully RemoteMercor • Ontario, Canada
Professional Evaluator - Fully Remote

Professional Evaluator - Fully Remote

Mercor • Ontario, Canada
5 days ago
Salary
CA$25.00–CA$35.00 hourly
Job type
  • Full-time
  • Remote
Job description

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Model Evaluation Contractor Type: Contract Compensation: $25–$35/hour Commitment: 20 hours/week Role Responsibilities Write realistic prompts reflecting professional and consumer domain-specific guidance. Evaluate AI-generated responses for factual accuracy and practical usefulness. Identify fabricated claims and misleading reasoning in model outputs. Score and rank model responses using structured rubrics. Provide written justifications with specific evidence for each evaluation. Qualifications Must-Have Professional experience applying domain expertise in a practitioner or advisory capacity. Familiarity with industry-specific standards, regulations, or clinical guidelines. Strong written communication and critical reasoning skills. Application Process (Takes 20–30 mins to complete) Submit your resume to begin. Complete the Model Response Evaluation assessment. Resources & Support For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome For any help or support, reach out to: support@mercor.com PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Create a job alert for this search

Professional Evaluator - Fully Remote • Ontario, Canada

Similar jobs

Implementation Engineer

SwiftConnectON, CA
Full-time

SwiftConnect is seeking an Implementation Engineer to guide our customers through their journey in deploying our best-of-breed SaaS integration solutions.The Implementation Engineer will be respons... Show more

 • Promoted

Healthcare Business Development Hunter | Remote

HeadHunting Inc.ON, CA
Remote
Full-time

A leading healthcare recruitment agency is seeking a Chief Healthcare HeadHunter to drive business development.The role is fully remote, requiring extensive travel and interaction with healthcare o... Show more

 • Promoted

On-Site Addiction Counselor — Thamesville Recovery Specialist

Westover Treatment CentreSouthwestern Ontario, ON, CA
Full-time

A leading treatment facility in Southwestern Ontario is seeking a full-time Addiction Counsellor.In this on-site role, you will conduct therapy sessions, create treatment plans, and provide crisis ... Show more

 • Promoted

Snowflake Tech Sales Engineer - Remote Canada

isgSearchON, CA
Remote
Full-time

A leading recruitment firm is seeking a Snowflake Technical Sales Engineer in Canada.This full-time position involves driving pre-sales and post-sales technical efforts, providing product demonstra... Show more

 • Promoted

Remote Construction Project Manager | Procore Expert

Executrade – Your Recruitment SpecialistsON, CA
Remote
Full-time

An established industry player is seeking a proactive Project Manager to lead construction projects with excellence.This role involves managing timelines, budgets, and quality standards while utili... Show more

 • Promoted

SaaS Implementation Engineer — Integration & Onboarding

SwiftConnectON, CA
Full-time

A leading SaaS integration solutions provider is seeking an Implementation Engineer to guide customers in deploying their solutions.You will manage technical aspects of implementations, collaborate... Show more

 • Promoted

Senior Operational Test and Evaluation Engineer

Spectrum Comm IncEastern Ontario
Full-time +1

Senior Operational Test and Evaluation Engineer.Spectrum is seeking highly qualified Engineers and/or Analysts to support Operational Test & Evaluation (OT&E) programs located in Edwards AFB, CA.Ke... Show more

 • Promoted

Employment Lawyer

Vanguard LawON, CA
Full-time

Get AI-powered advice on this job and more exclusive features.Vanguard Law is a remote-first boutique firm offering comprehensive employment, labour, and human rights counsel across Ontario.We repr... Show more

 • Promoted

Claims Evaluator in Accident Benefits

Definity Financial CorporationSouthwestern Ontario, ON, CA
Full-time

Step into a rewarding role with Definity as a Claims Evaluator specializing in Accident Benefits.This hybrid position allows you to work both from the office and remotely while delivering excellent... Show more

 • Promoted

Bilingual - Applications Specialist - Hybrid

Randstad DigitalON, CA
Full-time

Bilingual - Applications Specialist - Hybrid.Bilingual - Applications Specialist - Hybrid.Be among the first 25 applicants.Direct message the job poster from Randstad Digital.Technical Recruiter fo... Show more

 • Promoted

Investment Advisor

RBC Dominion SecuritiesSouthwestern Ontario, ON, CA
Full-time

Grow your business, your way – with RBC.As an Investment Advisor at RBC Dominion Securities, you can help your clients reach their goals, while we help you reach yours.Maybe you’ve dreamed of start... Show more

 • Promoted

Remote Product & Portfolio Analytics Analyst

Sandvine (Now AppLogic Networks)Southwestern Ontario, ON, CA
Remote
Full-time

A leading technology solutions provider is seeking an Associate Data Analyst to support product performance metrics and drive insights for operational strategies.The role requires 2 years of data a... Show more