Talent.com
Mercor
Video Evaluation Specialist - AnnotatorMercor • Toronto, Ontario, Canada
Video Evaluation Specialist - Annotator

Video Evaluation Specialist - Annotator

Mercor • Toronto, Ontario, Canada
6 hours ago
Salary
CA$15.00–CA$20.00 hourly
Job type
  • Part-time
  • Remote
  • Quick Apply
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Video Evaluation Generalist
Type: Contract
Compensation: $15–$20/hour
Location: Remote
Commitment: 20 hours/week

Role Responsibilities

  • Evaluate paired video outputs by comparing two short video clips against a provided rubric for prompt adherence, motion quality, visual artifacts, and physical plausibility.
  • Score and justify preferences by assigning rubric scores to each clip, selecting an overall preference, and documenting a brief written justification.
  • Maintain scoring consistency across high task volumes, ensuring calibration to the rubric remains steady for reliable judgments.
  • Work independently and meet deadlines in a structured project environment with clear goals and tools.

Qualifications

Must-Have

  • BS or BA from a reputable institution completed or in progress.
  • Strong writing and critical thinking skills.
  • Ability to work independently and meet deadlines.

Preferred

  • 2+ years of experience in teaching or research.

Application Process (Takes 20–30 mins to complete)

  • Complete an AI-led interview, this should take around 15 minutes.
  • If selected, you will be invited to work on the project.

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Create a job alert for this search

Video Evaluation Specialist - Annotator • Toronto, Ontario, Canada

Similar jobs

Remote Data Annotation Specialist (English & Text AI)

iMerit ScholarsToronto, ON, CA
Remote
Full-time

A leading tech organization is seeking a meticulous Data Annotation Specialist to join their AI and ML projects team.This remote, full-time position involves generating and validating datasets acro... Show more

 • Promoted

Notch Video Social Producer Opening

NotchToronto, Ontario, Canada
Full-time

Explore a vibrant career as a Social Producer with Notch Video in Toronto.Combine your innovative spirit with project management skills to transform online video.Notch Video seeks a Social Producer... Show more

 • Promoted

RLHF Evaluation Specialist for AI Training

Rex.zoneToronto, ON, CA
Full-time

A tech company specializing in AI is seeking an AI Trainer based in Canada.The role involves improving large language models through RLHF-style evaluations, prompt evaluation, and data labeling.Can... Show more

 • Promoted

Remote AI Evaluation Scenario Designer

MindriftToronto, ON, CA
Remote
Full-time

A leading AI solutions company is looking for an expert to design and evaluate test scenarios for AI agents.The ideal candidate will have a Bachelor's or Master's degree in a relevant field, experi... Show more

 • Promoted

What If Producer

Underknown CorpToronto, ON, CA
Permanent

This is a creative production role where you will be responsible for adhering to the editorial direction and production requirements for episodes of the What If show.You are responsible for pitchin... Show more

 • Promoted

Intern Researcher - AI Agent Evaluation

Huawei CanadaMarkham, York Region, CA
Full-time

Huawei Canada has an immediate 4-12 month internship opening for an Intern Researcher.Established in 2014, the Distributed Scheduling and Data Engine Lab is Huawei Cloud's technical innovation cent... Show more

 • Promoted

Remote AI Content Evaluator - Part-Time, Flexible Hours

Work VistaToronto, ON, CA
Remote
Part-time

A global AI services provider is seeking a remote Content Evaluator to assess the quality of AI-generated content.This part-time role involves evaluating responses for fluency, coherence, and factu... Show more

 • Promoted

Italian Fluency Needed for AI Evaluators

ProlificToronto, ON, CA
Full-time

Become an AI evaluator with Prolific, focusing on your Italian fluency.Earn $30 per hour while engaging in remote tasks that improve AI systems with flexible hours.We are looking for individuals wh... Show more

 • Promoted

User Research Expert - Evaluator

MercorToronto, Ontario, Canada
CA$80.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.User/customer research and feedback synthesis Evaluator.Identify factual, aesthetic, and presentation errors in.Provide clear, structured writt... Show more

Economics AI Training & Evaluation Specialist

MindriftToronto, ON, CA
Part-time

A technology firm in Canada is seeking contributors for a flexible, project-based opportunity.Ideal candidates should have a strong academic background in Economics, excellent analytical skills, an... Show more

 • Promoted

Remote Audio Annotation Specialist - 33328

TuringToronto, ON, CA
Remote
Full-time

Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.Turing is an AI-powered tech services company with a mission to accelerate AGI advancement and deploym... Show more

 • Promoted

Content Evaluator (Remote)

Work VistaToronto, ON, CA
Remote
Full-time

United States, United Kingdom, Canada, Ireland, Australia & New Zealand.You must be legally authorised to work in the country where you are based).We are hiring on behalf of one of our clients, a l... Show more

 • Promoted

AI Agent Evaluation Intern - Research & Reasoning

Huawei CanadaMarkham, York Region, CA
Full-time

A leading tech company in York Region, Canada, seeks an Intern Researcher for a 4-12 month position focusing on cutting-edge AI research.This role requires candidates enrolled in a Master's or PhD ... Show more

 • Promoted

Hybrid Escalations Engineer, Video Analytics - C$80,000 - C$100,000 A Year

Motorola SolutionsToronto County, Canada
Full-time

Technical Escalations Engineer needed in Vancouver to handle customer support escalations, analyze logs, and troubleshoot application issues.Requires strong communication and problem-solving skills. Show more

 • Promoted

Producer for Engaging YouTube Content

Underknown CorpToronto, ON, CA
Full-time

Transform ideas into captivating YouTube episodes as a Producer for Underknown's What If series.This hybrid role combines storytelling brilliance with data insights.As a creative powerhouse with at... Show more

 • Promoted

Remote Audio Annotation Specialist (AI Training) - 33328

TuringToronto, ON, CA
Remote
Full-time

Be among the first 25 applicants.Turing is an AI-powered tech services company with a mission to accelerate AGI advancement and deployment by bridging the gap between global talent from 100+ countr... Show more

 • Promoted

Video Production Specialist

Apex SystemsToronto, ON, CA
Temporary

Hybrid Downtown Toronto, Ontario.Monday-Friday, 9:00 am - 5:00 pm.This role is ideal for a hands‑on professional who can balance creative storytelling with strong production and editing execution, ... Show more

 • Promoted

Innovative Media Search Analyst - Flexible Schedule!

TELUS Digital AI Data SolutionsToronto, ON, CA
Part-time

Join the exciting world of digital media as a Media Search Analyst.Set your own schedule while conducting engaging evaluations of media content and contributing to cutting-edge projects.This part-t... Show more

 • Promoted

Analytical Evaluator - AI Feedback

MercorToronto, Ontario, Canada
CA$70.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.Provide structured written feedback to improve.Develop clear, precise, and well-evidenced written rationales that go beyond surface-level obser... Show more

AI Specialist - Applied ML Research

Xanadutoronto, on, Canada
Full-time

Xanadu’s mission is to build quantum computers that are useful and available to people everywhere.At Xanadu, we are learners, innovators, researchers, collaborators and problem solvers.We are creat... Show more