Talent.com
Mercor
AI Evaluator Software ExpertMercor • Toronto, Ontario, Canada
AI Evaluator Software Expert

AI Evaluator Software Expert

Mercor • Toronto, Ontario, Canada
30+ days ago
Salary
CA$80.00 hourly
Job type
  • Full-time
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey.

Position: Software / AI / IT / data Evaluator
Type: Contract
Compensation: $80$120/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual aesthetic and presentation errors in documents spreadsheets and slide decks.
  • Provide clear structured written feedback to improve AI model outputs.
  • Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
  • Work independently and asynchronously to meet deadlines.

Qualifications

Must-Have

  • 5 years of relevant professional experience in Software / AI / IT / data.
  • Native or professional fluency in English.
  • Highly proficient in Microsoft Office and Google Workspace especially Slides.

Preferred

  • Advanced degree (Masters or higher) from a reputable institution.

Application Process (Takes 2030 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information please check:
  • For any help or support reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.


Employment Type : Full Time
Experience: years
Vacancy: 1
Create a job alert for this search

AI Evaluator Software Expert • Toronto, Ontario, Canada

Similar jobs

Principal AI Solutions Developer

OpenTextrichmond hill, york region, Canada
Full-time

Become a Principal AI Solutions Developer at OpenText, leading the charge in creating sophisticated agentic AI systems.Use your expertise to enhance IT Operations security and observability.OpenTex... Show more

 • Promoted

Generative AI Implementation Expert

SiaToronto, ON, CA
Full-time

Drive the future of AI solutions as a Generative AI Implementation Expert.Utilize your skills to design and optimize generative AI systems for widespread impact across various industries.You will p... Show more

 • Promoted

AI Platform Engineer: Build & Evaluate AI Systems

Armilla AItoronto, on, Canada
Full-time

A leading AI-focused startup in Toronto is seeking an experienced AI Engineer to shape the future of AI risk management.In this pivotal role, you will be responsible for building core AI tools and ... Show more

 • Promoted

Expert AI Engineer Driving AI Initiatives with Advanced Technologies

GEI Consultantsmarkham, york region, Canada
Full-time

Elevate your career as an AI Engineer responsible for pioneering AI solutions that transform business workflows.Focus on deploying scalable AI initiatives integrating modern technologies to meet st... Show more

 • Promoted

AI Model Evaluator - Legal Expert Needed

Obsidiantoronto, on, Canada
Part-time

Mercor invites you to a part-time role as a Legal Expert focusing on AI training.Your legal acumen will evaluate responses regarding employment law matters.This position, in collaboration with a pr... Show more

 • Promoted

Software Engineer Advancing Evaluation Infrastructure for AI Innovation

Waabitoronto, on, Canada
Full-time

Join a collaborative team as a Software Engineer enhancing the evaluation infrastructure for AI-driven vehicles.Be at the forefront of autonomous technology development in a flexible work environme... Show more

 • Promoted

AI Evaluation Engineer

ZafinToronto, ON, CA
Full-time

Zafin is an AI platform company helping regulated institutions modernize how critical work is designed, governed, and delivered.Our technology enables organizations to move faster while maintaining... Show more

 • Promoted

Senior, Applied AI Engineer

Headstart AItoronto, on, Canada
Full-time

This range is provided by Headstart AI.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.At Headstart our mission is to bring companies into the a... Show more

 • Promoted

Applied AI Implementation Specialist Toronto

Pear VCtoronto, on, Canada
Full-time

Join Paxos Health in Toronto as an Applied AI Implementation Specialist, focusing on transforming healthcare workflows.You'll work hands-on to structure AI outputs, enhancing patient access to medi... Show more

 • Promoted

Agentic AI Developer

Kumaran Systemstoronto, on, Canada
Full-time

AI agents that automate business processes, enhance customer experiences, and drive operational efficiency.The ideal candidate will have strong expertise in Agentic AI systems, AI agent development... Show more

 • Promoted

DevOps Engineer - AI Model Evaluator

MercorToronto, Ontario, Canada
CA$85.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.DevOps / SRE / Cloud Engineer (Coding Agent Experience).Review model-generated implementations involving.Identify bugs, edge cases, reliability... Show more

Staff AI Software Engineer

Qualcommmarkham, york region, Canada
Full-time

Engineering Group, Engineering Group >.As a leading technology innovator, Qualcomm pushes the boundaries of what's possible to enable next-generation experiences and drive digital transformation to... Show more

 • Promoted

AI Evaluator - Software Expert

MercorToronto, Ontario, Canada
CA$80.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.Software / AI / IT / data Evaluator.Identify factual, aesthetic, and presentation errors in.Provide clear, structured written feedback to impro... Show more

AI Systems Engineer – AI Model (Training & Inference)

AMDmarkham, on, Canada
Full-time

At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems.Grounded in a culture of innovatio... Show more

 • Promoted

AI Engineer – Generative AI Expertise

Synechrontoronto, on, Canada
Full-time

Join Synechron as an AI Engineer specializing in Generative AI.Leverage your advanced skills in machine learning to innovate solutions for capital markets.As a vital contributor, you will focus on ... Show more

 • Promoted

AI Developer Senior

Intacttoronto, on, Canada
Full-time

Our employees are at the heart of everything we do.Together, we help people, businesses, and society prosper in good times and be resilient in bad times.Our employee promise represents Intact’s com... Show more

 • Promoted

Research Engineer in AI Software Systems

Huawei Canadamarkham, on, Canada
Full-time

Become a Research Engineer with Huawei Canada, focusing on agentic software systems and the evolution of AI collaboration in software projects.Drive innovative research and development.The Intellig... Show more

 • Promoted

Remote AI Data Quality & Evaluation Engineer

Veeva Systemstoronto, on, Canada
Remote
Full-time

A leading cloud technology company in Toronto is seeking an experienced professional to validate and ensure the reliability of Veeva AI Agents.The ideal candidate should have expertise in data qual... Show more

 • Promoted

AI Specialist - Applied ML Research

Xanadutoronto, on, Canada
Full-time

Xanadu’s mission is to build quantum computers that are useful and available to people everywhere.At Xanadu, we are learners, innovators, researchers, collaborators and problem solvers.We are creat... Show more

 • Promoted

Lead Verification Engineer AI Hardware

Tenstorrenttoronto, on, Canada
Full-time

Drive innovation in AI hardware as Lead Verification Engineer with Tenstorrent, based in Austin, Toronto, or Belgrade.Lead a team focusing on testing advanced AI cores and networks.At Tenstorrent, ... Show more