Talent.com
Mercor
Business Operations Expert - EvaluatorMercor • Toronto, Ontario, Canada
Business Operations Expert - Evaluator

Business Operations Expert - Evaluator

Mercor • Toronto, Ontario, Canada
4 days ago
Job type
  • Part-time
  • Remote
  • Quick Apply
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting)
Type: Contract
Compensation: $70–$100/hour
Location: Remote

Role Responsibilities

  • Solve one realistic, domain-specific task using the provided source files.
  • Review five model-generated outputs for the task. Rank them 1–5 with no ties, score each 0–100, and write evidence-based rationales citing specific parts of the output.
  • Provide structured feedback on the task and study design.
  • Work independently to meet deadlines within a short turnaround window.
  • Use professional judgment as no rubric or golden answer is provided. LLMs or AI assistants are prohibited at every stage.

Qualifications

Must-Have

  • 5+ years of hands-on professional experience in Admin, Marketing, Human Resources, or Accounting.
  • Currently or recently practicing to judge work as a working professional would.
  • Ability to write clear, specific, evidence-grounded rationales for judgments.
  • Reliable within a short turnaround window.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Create a job alert for this search

Business Operations Expert - Evaluator • Toronto, Ontario, Canada

Similar jobs

Sales Operations Implementation Specialist

Forma.aiToronto, ON, CA
Full-time

A forward-thinking tech startup in Toronto is seeking a Customer Operations specialist to manage client relationships and enhance sales performance management processes.The ideal candidate will hav... Show more

 • Promoted

Business Analyst in Technology Operations

ScotiabankToronto, ON, CA
Full-time

Become a Business Analyst in Technology Operations, dedicated to enhancing customer data management.Apply your technical skills and project management experience to drive successful project outcome... Show more

 • Promoted

Operations Analyst

Wall Street OasisToronto, ON, CA
Full-time

Wall Street Oasis (WSO) | Operations (CRM) Analyst.Wall Street Oasis is the largest community focused on careers in finance with 1 million registered members and 20 million visits per year.The plat... Show more

 • Promoted

Implementation Specialist / Business Analyst

Harris ComputerToronto, ON, CA
Full-time +1

Implementation Specialist / Business Analyst.Implementation Specialist / Business Analyst.Implementation Specialist / Business Analyst.Implementation Specialist / Business Analyst.Implementation Sp... Show more

 • Promoted

Operations Specialist

Lysander Funds LimitedToronto, ON, CA
Full-time

Lysander Funds is an independent Investment Fund Manager headquartered in Toronto with regional offices in Montréal and Vancouver.We offer investment products to investment and mutual fund advisors... Show more

 • Promoted

Lead, Strategy & Operations

BreeToronto, ON, CA
Full-time

We're building better, faster, cheaper financial services for the half of Canadians who live paycheck to paycheck.YCombinator S21, $2M seed, profitable, growing double digits month-over-month.What ... Show more

 • Promoted

Strategy & Operations Manager (Business Operations)

Clutchtoronto, on, Canada
Full-time

Strategy & Operations Manager (Business Operations).We’re on a mission to reinvent the way people buy, sell, and own cars.Clutch is Canada’s largest online used car retailer, delivering a seamless,... Show more

 • Promoted

Remote Chemistry Expert (LLM Evaluation) - 34879

TuringToronto, ON, CA
Remote
Full-time

Remote Chemistry Expert (LLM Evaluation) - 34879.Remote Chemistry Expert (LLM Evaluation) - 34879.Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.Turi... Show more

 • Promoted

OPEN: Business Analyst

Cpus Engineering Staffing Solutions Inc.Old Toronto, ON, CA
Full-time

We are currently requesting resumes for the following position.University Avenue, Toronto, ON.Participating in all phases of the project life cycle including Initiation, Planning, Definition, Execu... Show more

 • Promoted

DSM Evaluation Manager - EM&V

BuoyantToronto, ON, CA
Full-time

Impact Evaluation Manager to join our expanding team.In this role, you will provide technical support and project management services within the Advisory Services Group business unit, focusing on e... Show more

 • Promoted

Content Evaluator (Remote)

Work VistaToronto, ON, CA
Remote
Full-time

United States, United Kingdom, Canada, Ireland, Australia & New Zealand.You must be legally authorised to work in the country where you are based).We are hiring on behalf of one of our clients, a l... Show more

 • Promoted

Operations Analyst

KellyToronto, ON, CA
Full-time

Operations Analyst I (Proxy Voting / ESG Focus).Toronto, ON (Hybrid – Tues to Thurs in office).July 7, 2026 – December 31, 2026 (extension possible).ESG (Environmental, Social, Governance) and corp... Show more

 • Promoted

Business Operations Specialist

Coding for VeteransToronto, ON, CA
Full-time

Get AI-powered advice on this job and more exclusive features.This range is provided by Coding for Veterans.Your actual pay will be based on your skills and experience — talk with your recruiter to... Show more

 • Promoted

Economics AI Training & Evaluation Specialist

MindriftToronto, ON, CA
Part-time

A technology firm in Canada is seeking contributors for a flexible, project-based opportunity.Ideal candidates should have a strong academic background in Economics, excellent analytical skills, an... Show more

 • Promoted

Freelance Agent Evaluation Analyst

MindriftToronto, ON, CA
Permanent

Be among the first 25 applicants.This opportunity is only for candidates currently residing in the specified country.Your location may affect eligibility and rates.Please submit your resume in Engl... Show more

 • Promoted

Business Analysis Specialist – Global Fixed Income

TD BankToronto, ON, CA
Full-time

Business Analysis Specialist – Global Fixed IncomePasser au contenu principalNous et certains tiers sélectionnés utilisons des technologies et des outils de suivi (témoins) pour recueillir des rens... Show more

 • Promoted

AI Evaluation Engineer

ZafinToronto
Full-time

Zafin is an AI platform company helping regulated institutions modernize how critical work is designed, governed, and delivered.Our technology enables organizations to move faster while maintaining... Show more

 • Promoted

Strategy & Operations Manager (Business Operations)

Clutch CanadaToronto
Full-time

We’re on a mission to reinvent the way people buy, sell, and own cars.Clutch is Canada’s largest online used car retailer, delivering a seamless, hassle‑free car buying and selling experience to dr... Show more

 • Promoted

Wipro Business Analyst – Agile Environment

WiproToronto, ON, CA
Full-time

Empower digital transformation at Wipro as a Business Analyst in a vibrant Agile environment.Bring your experience in requirements analysis and problem-solving skills to impactful projects.Wipro in... Show more

 • Promoted

Strategy & Operations Analyst

Shake Shack CanadaToronto, ON, CA
Full-time

Direct message the job poster from Shake Shack Canada.We are seeking a detail-oriented, analytical, and highly motivated.The Strategy & Operations Analyst will play a critical role in supporting Sh... Show more