Talent.com
Mercor
AI Evaluator - Software ExpertMercor • Toronto, Ontario, Canada
AI Evaluator - Software Expert

AI Evaluator - Software Expert

Mercor • Toronto, Ontario, Canada
30+ days ago
Salary
CA$80.00 hourly
Job type
  • Part-time
  • Remote
  • Quick Apply
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Software / AI / IT / data Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
  • Provide clear, structured written feedback to improve AI model outputs.
  • Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
  • Work independently and asynchronously to meet deadlines.

Qualifications

Must-Have

  • 5+ years of relevant professional experience in Software / AI / IT / data.
  • Native or professional fluency in English.
  • Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Preferred

  • Advanced degree (Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Create a job alert for this search

AI Evaluator - Software Expert • Toronto, Ontario, Canada

Similar jobs

Staff AI Software Engineer (C++)

Qualcommmarkham, on, Canada
Full-time

Bachelor's degree in Computer Science, Engineering, Information Systems, or related field and 4+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience... Show more

 • Promoted

Principal AI Solutions Developer

OpenTextrichmond hill, york region, Canada
Full-time

Become a Principal AI Solutions Developer at OpenText, leading the charge in creating sophisticated agentic AI systems.Use your expertise to enhance IT Operations security and observability.OpenTex... Show more

 • Promoted

AI Platform Engineer: Build & Evaluate AI Systems

Armilla AItoronto, on, Canada
Full-time

A leading AI-focused startup in Toronto is seeking an experienced AI Engineer to shape the future of AI risk management.In this pivotal role, you will be responsible for building core AI tools and ... Show more

 • Promoted

Expert AI Engineer Driving AI Initiatives with Advanced Technologies

GEI Consultantsmarkham, york region, Canada
Full-time

Elevate your career as an AI Engineer responsible for pioneering AI solutions that transform business workflows.Focus on deploying scalable AI initiatives integrating modern technologies to meet st... Show more

 • Promoted

Software Engineer Advancing Evaluation Infrastructure for AI Innovation

Waabitoronto, on, Canada
Full-time

Join a collaborative team as a Software Engineer enhancing the evaluation infrastructure for AI-driven vehicles.Be at the forefront of autonomous technology development in a flexible work environme... Show more

 • Promoted

Applied AI Implementation Specialist Toronto

Pear VCtoronto, on, Canada
Full-time

Join Paxos Health in Toronto as an Applied AI Implementation Specialist, focusing on transforming healthcare workflows.You'll work hands-on to structure AI outputs, enhancing patient access to medi... Show more

 • Promoted

Agentic AI Developer

Kumaran Systemstoronto, on, Canada
Full-time

AI agents that automate business processes, enhance customer experiences, and drive operational efficiency.The ideal candidate will have strong expertise in Agentic AI systems, AI agent development... Show more

 • Promoted

DevOps Engineer - AI Model Evaluator

MercorToronto, Ontario, Canada
CA$85.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.DevOps / SRE / Cloud Engineer (Coding Agent Experience).Review model-generated implementations involving.Identify bugs, edge cases, reliability... Show more

Staff AI Software Engineer

Qualcommmarkham, york region, Canada
Full-time

Engineering Group, Engineering Group >.As a leading technology innovator, Qualcomm pushes the boundaries of what's possible to enable next-generation experiences and drive digital transformation to... Show more

 • Promoted

AI Systems Engineer – AI Model (Training & Inference)

AMDmarkham, on, Canada
Full-time

At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems.Grounded in a culture of innovatio... Show more

 • Promoted

Software Engineer, Applied AI/Product (Toronto)

Stealth-Hctoronto, on, Canada
Full-time

We're a small team obsessed with deep thinking, speed, craftsmanship, and a customer-focused approach, committed to building the best care experience in healthcare with a 30-year horizon.Our team h... Show more

 • Promoted

AI Engineer – Generative AI Expertise

Synechrontoronto, on, Canada
Full-time

Join Synechron as an AI Engineer specializing in Generative AI.Leverage your advanced skills in machine learning to innovate solutions for capital markets.As a vital contributor, you will focus on ... Show more

 • Promoted

AI Developer Senior

Intacttoronto, on, Canada
Full-time

Our employees are at the heart of everything we do.Together, we help people, businesses, and society prosper in good times and be resilient in bad times.Our employee promise represents Intact’s com... Show more

 • Promoted

Remote AI Data Quality & Evaluation Engineer

Veeva Systemstoronto, on, Canada
Remote
Full-time

A leading cloud technology company in Toronto is seeking an experienced professional to validate and ensure the reliability of Veeva AI Agents.The ideal candidate should have expertise in data qual... Show more

 • Promoted

Research Engineer in AI Software Systems

Huawei Canadamarkham, on, Canada
Full-time

Become a Research Engineer with Huawei Canada, focusing on agentic software systems and the evolution of AI collaboration in software projects.Drive innovative research and development.The Intellig... Show more

 • Promoted

AI Specialist - Applied ML Research

Xanadutoronto, on, Canada
Full-time

Xanadu’s mission is to build quantum computers that are useful and available to people everywhere.At Xanadu, we are learners, innovators, researchers, collaborators and problem solvers.We are creat... Show more

 • Promoted

Machine Learning Engineer Focused on AI Systems

HR Tech Jobtoronto, on, Canada
Full-time

Step up as a Machine Learning Engineer at Upwork, where you'll develop cutting-edge AI and reinforcement learning systems.Drive transformative changes with advanced technologies across our platform... Show more

 • Promoted

Lead Verification Engineer AI Hardware

Tenstorrenttoronto, on, Canada
Full-time

Drive innovation in AI hardware as Lead Verification Engineer with Tenstorrent, based in Austin, Toronto, or Belgrade.Lead a team focusing on testing advanced AI cores and networks.At Tenstorrent, ... Show more