Talent.com
Mercor
AI Session Reviewer - English ExpertMercor • Toronto, Ontario, Canada
AI Session Reviewer - English Expert

AI Session Reviewer - English Expert

Mercor • Toronto, Ontario, Canada
1 day ago
Salary
CA$24.00–CA$30.00 hourly
Job type
  • Part-time
  • Remote
  • Quick Apply
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: AI Session Annotator (English)
Type: Contract
Compensation: $24–$30/hour
Location: Remote

Role Responsibilities

  • Review recorded sessions where users interact with an AI assistant via voice and camera.
  • Compare the assistant's responses to visible video content. Identify hallucinated or fabricated visual details.
  • Score sessions on visual interpretation, accuracy, relevance, response timing, and spatial language use.
  • Evaluate if the assistant appropriately warned users about health, safety, or financial risks.
  • Write detailed comments supporting scores with concrete session evidence.
  • Capture conversation turns in the intake form.

Qualifications

Must-Have

  • Native or native-level English, spoken and written.
  • Clear, precise written English.
  • An Android phone with a working camera and microphone.
  • Attention to detail and consistent rubric application.

Preferred

  • Experience in data annotation, linguistic QA, content moderation, or AI model evaluation.
  • Training in linguistics, translation, or interpreting.
  • Ability to recognize unnatural or non-native English.

Start Date

  • Immediate; high volume of work expected between 26 to 31 Aug.

Application Process (Takes 20–30 mins to complete)

  • Submit your resume or relevant background.
  • Complete a short calibration task on sample sessions, assessed on scoring consistency and comment usefulness.

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Create a job alert for this search

AI Session Reviewer - English Expert • Toronto, Ontario, Canada

Similar jobs

Sr. Regression Tester with AI Exp

SynechronToronto, ON, CA
Full-time

At Synechron, we believe in the power of digital to transform businesses for the better.Our global consulting firm combines creativity and innovative technology to deliver industry‑leading digital ... Show more

 • Promoted

AI Specialist - Applied ML Research

XanaduToronto, ON, CA
Full-time

Xanadu’s mission is to build quantum computers that are useful and available to people everywhere.At Xanadu, we are learners, innovators, researchers, collaborators and problem solvers.We are creat... Show more

 • Promoted

AI Content Trainer (Remote)

Work VistaToronto, ON, CA
Remote
Part-time

We are hiring on behalf of one of our clients, a leading global player in the AI space.This remote, part-time contract role focuses on teaching and refining AI models through high-quality content c... Show more

 • Promoted

AI Translation Reviewer — Physics (JP→EN)

Cactus CommunicationsToronto, ON, CA
Full-time

A leading translation services provider in Canada is seeking skilled freelance translators to review and enhance AI-generated translations of academic and non-academic content.Candidates must posse... Show more

 • Promoted

AI Researcher in Emerging Risks Team

MSCI Inc.Toronto, ON, CA
Full-time

Become part of MSCI’s Emerging Risks R&D team as an AI Researcher and innovate how investors navigate risks.Utilize advanced AI technologies to quantify evolving market challenges.This role focuses... Show more

 • Promoted

Remote Data Annotation Specialist (English & Text AI)

iMerit ScholarsToronto, ON, CA
Remote
Full-time

A leading tech organization is seeking a meticulous Data Annotation Specialist to join their AI and ML projects team.This remote, full-time position involves generating and validating datasets acro... Show more

 • Promoted

Senior Rust Code Reviewer for AI Training Evaluations

G2i Inc.Toronto, ON, CA
Full-time

A leading AI training company in Canada is seeking a skilled Code Reviewer with deep expertise in Rust.You will review evaluations of AI-generated Rust code to ensure quality and correctness.The id... Show more

 • Promoted

Senior CRO Leader - Remote & AI-Driven Revenue Architect

PuffyToronto, ON, CA
Remote
Full-time

A leading eCommerce brand is looking for a Senior CRO Manager in Toronto to drive on-site conversion optimization.This role requires expertise in analytics and A/B testing, with the goal of enhanci... Show more

 • Promoted

Senior Applied AI Engineer — Product & Revenue Systems

QEA TechMarkham, ON, CA
Full-time

Build and deploy AI systems that directly drive revenue by embedding AI across QEA’s product, sales, and marketing workflows.This role focuses on execution: turning QEA’s building data, imagery, an... Show more

 • Promoted

Senior Staff Engineer in Agentic AI

ODAIAToronto, ON, CA
Full-time

Shape the future of AI at RBC as a Senior Staff Engineer focused on agentic AI solutions in Toronto.Utilize your expertise to develop innovative applications on the Borealis platform.In this role, ... Show more

 • Promoted

EA Research Engineer in Game AI and LLMs

Electronic Arts Inc.Toronto, ON, CA
Full-time

Elevate interactive entertainment as a Research Engineer focusing on Large Language Models at Electronic Arts.This impactful role allows you to pioneer groundbreaking applications for gaming techno... Show more

 • Promoted

Agentic AI Bootcamp Instructor (LLMs, RAG, Agents & AgentOps)

VibehackersToronto, ON, CA
Full-time

Agentic AI Bootcamp Instructor (LLMs, RAG, Agents & AgentOps).Explicitly references "vibe coding" and AI-assisted development as part of the curriculum.WeCloudData seeks an experienced Agentic AI I... Show more

 • Promoted

AI Agent Engineer: LLMs, RAG & Prompt Mastery

Linkus GroupToronto, ON, CA
Full-time

A technology company in Toronto is seeking an experienced software engineer to develop next-gen AI tools that enhance critical thinking.The ideal candidate will fine-tune language models and optimi... Show more

 • Promoted

Senior Equity Research Reviewer — AI-Driven Analysis

Great Value HiringToronto, ON, CA
Full-time

A leading investment research firm in Canada is seeking an Expert Equities Research Reviewer to analyze AI-generated equity reports.The role involves reviewing for accuracy, evaluating investment t... Show more

 • Promoted

Applied AI Engineer (Agentic Workflows & RAG) - Master-Level Internship

Vosyn IncToronto, ON, CA
Internship

At Vosyn, we embrace the exciting, game-changing world of Artificial Intelligence, driving innovation and pioneering impactful projects across various industries.We are a trailblazing Language Synt... Show more

 • Promoted

Media Search Analyst - English Speakers (WFH/Remote)

TELUS Digital AI Data SolutionsToronto, ON, CA
Remote
Full-time

Ready to say goodbye to the boring, traditional 9-5 routine and embrace a dynamic and exciting work environment that puts you in control? This position offers you the flexibility to set your own sc... Show more

 • Promoted

AI Researcher Focused on Emerging Risks

MSCIToronto, ON, CA
Full-time

Become an AI Researcher at MSCI, where you'll tackle the pressing challenge of quantifying portfolio exposures to emerging economic risks.Your work will focus on building models that enhance unders... Show more

 • Promoted

AI Engineer

BioRenderToronto, ON, CA
Full-time

At BioRender, we don’t settle for average, and neither should you.We’re building tools that transform how scientists communicate complex ideas, and we need someone who’s ready to turn ambitious ide... Show more

 • Promoted

Senior AI Engineer

PaytmToronto, ON, CA
Full-time

There’s a wide gap between an agent that works in a demo and one that works across millions of live transactions.You’ll embed with the teams and customers who depend on AI — risk, fraud, collection... Show more

 • Promoted

Intern Researcher - LLMs Agentic AI and RL

Huawei Technologies Canada Co., Ltd.Markham, York Region, CA
Full-time

Huawei Canada has an immediate internship opening for a LLMs Researcher.Founded in 2012, the Noah’s Ark lab has evolved into a prominent research organization with notable achievements in academia ... Show more