Talent.com
Mercor
User Research Expert - EvaluatorMercor • Toronto, Ontario, Canada
User Research Expert - Evaluator

User Research Expert - Evaluator

Mercor • Toronto, Ontario, Canada
6 hours ago
Salary
CA$80.00 hourly
Job type
  • Part-time
  • Remote
  • Quick Apply
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: User/customer research and feedback synthesis Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
  • Provide clear, structured written feedback to improve AI model outputs.
  • Work independently and asynchronously to meet deadlines and enhance AI model performance.
  • Collaborate with subject matter experts to ensure consistency and quality across datasets.

Qualifications

Must-Have

  • 5+ years of relevant professional experience in User/customer research and feedback synthesis.
  • Native or professional fluency in English.
  • Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Preferred

  • Advanced degree (Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Create a job alert for this search

User Research Expert - Evaluator • Toronto, Ontario, Canada

Similar jobs

Research Engineer

Waabitoronto, on, Canada
Full-time

Waabi, founded by AI pioneer and visionary Raquel Urtasun, is an AI company building the next generation of self-driving technology.With a world class team and an innovative approach that unleashes... Show more

 • Promoted

Remote Chemistry Specialist — AI Content QA & Evaluation

Crossing HurdlesToronto, ON, CA
Remote
Full-time

A recruitment firm is seeking a Chemistry Expert to review and verify AI-generated content and develop chemistry problems.This remote role requires an advanced degree and strong analytical skills.T... Show more

 • Promoted

Remote Market Research Assistant – Earn Up to $50/Task

Occupons QuebecNewmarket, ON, Canada
Remote
Part-time

Compensation: Up to $50 per task.We are seeking individuals to complete small, remote market research tasks from home.Your insights help shape future products, services, and public trends.All tasks... Show more

 • Promoted

Sr. UX Researcher

Insight GlobalToronto, ON, CA
Temporary

Be among the first 25 applicants.This range is provided by Insight Global.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Direct message the job... Show more

 • Promoted

Remote AI Evaluation Scenario Designer

MindriftToronto, ON, CA
Remote
Full-time

A leading AI solutions company is looking for an expert to design and evaluate test scenarios for AI agents.The ideal candidate will have a Bachelor's or Master's degree in a relevant field, experi... Show more

 • Promoted

Product Launch Expert - Evaluator

MercorToronto, Ontario, Canada
CA$80.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.Product launch / experiment readiness Evaluator.Identify factual, aesthetic, and presentation errors in.Provide clear, structured written feedb... Show more

AI Evaluation Engineer

ZafinToronto, ON, CA
Full-time

Zafin is an AI platform company helping regulated institutions modernize how critical work is designed, governed, and delivered.Our technology enables organizations to move faster while maintaining... Show more

 • Promoted

Intern Researcher - AI Agent Evaluation

Huawei CanadaMarkham, York Region, CA
Full-time

Huawei Canada has an immediate 4-12 month internship opening for an Intern Researcher.Established in 2014, the Distributed Scheduling and Data Engine Lab is Huawei Cloud's technical innovation cent... Show more

 • Promoted

Lead Research Engineer

Thomson Reuterstoronto, on, Canada
Full-time

Lead Research Engineer with expertise in AI and ML, building data‑driven capabilities that transform how legal, accounting, and government professionals work across the globe.Provide technical lead... Show more

 • Promoted

Remote Chemistry Expert (LLM Evaluation) - 34879

TuringToronto, ON, CA
Remote
Full-time

Remote Chemistry Expert (LLM Evaluation) - 34879.Remote Chemistry Expert (LLM Evaluation) - 34879.Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.Turi... Show more

 • Promoted

Market Research Expert - Evaluator

MercorToronto, Ontario, Canada
CA$80.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.Market research / competitive intelligence Evaluator.Evaluate AI-generated artifacts against domain-specific quality rubrics to ensure accuracy... Show more

Content Evaluator (Remote)

Work VistaToronto, ON, CA
Remote
Full-time

United States, United Kingdom, Canada, Ireland, Australia & New Zealand.You must be legally authorised to work in the country where you are based).We are hiring on behalf of one of our clients, a l... Show more

 • Promoted

Equity Research Specialist - Fully Remote | Upto $120/hr

ObsidianToronto, ON, CA
Remote
Full-time

Have at least 2 years of experience working at top firms in equity research and hands‑on experience with analyzing and extracting info from public SEC filings.You must be able to commit at least 10... Show more

 • Promoted

Lead Research Engineer

PowerToFlytoronto, on, Canada
Full-time

This posting is for proactive recruitment purposes and may be used to fill current openings or future vacancies within our organization.Do you love creating innovative solutions for customers?.We a... Show more

 • Promoted

Senior Design Researcher - User Insights

AquentToronto, ON, CA
Full-time

Step into a leadership role as a Senior Design Researcher, focusing on enhancing user insights and strategic alignment for product design.Collaborate across functions and mentor peers in robust res... Show more

 • Promoted

Lead Design Researcher

AquentToronto, ON, CA
Full-time

Design Research Strategy (30%).Strategic Advisory: Direct discussions with Design and cross-functional teams regarding overarching research strategies.Provide expert recommendations and contribute ... Show more

 • Promoted

Senior Researcher in HCI and AI Systems

Huawei Technologies Canada Co., Ltd.markham, on, Canada
Full-time

Take on a pivotal role at Huawei Canada as a Senior Researcher in Human-Computer Interaction.Focus on innovative research around agentic AI and multimodal interfaces for enhanced user experiences.T... Show more

 • Promoted

Remote AI Data Quality & Evaluation Engineer

Veeva Systemstoronto, on, Canada
Remote
Full-time

A leading cloud technology company in Toronto is seeking an experienced professional to validate and ensure the reliability of Veeva AI Agents.The ideal candidate should have expertise in data qual... Show more