Talent.com
Mercor
Analytical Evaluator - AI Feedback SpecialistMercor • Ontario, Canada
Analytical Evaluator - AI Feedback Specialist

Analytical Evaluator - AI Feedback Specialist

Mercor • Ontario, Canada
30+ days ago
Salary
CA$60.00 hourly
Job type
  • Full-time
Job description
About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Generalist Expert Type: Contract Compensation: $60–$200/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning and rigor in model outputs . Provide clear, structured feedback to improve training data quality and downstream performance. Develop evaluation rubrics and benchmarks for assessing AI-generated tasks . Work independently and asynchronously to meet deadlines while improving AI model performance . Qualifications Must-Have Bachelor's degree from a top-100 globally ranked university preferred. Strong analytical and written communication skills. Ability to work independently and follow detailed task guidelines. Strong critical reading skills with the ability to identify nuance and gaps in reasoning. Ability to write clear, precise, and well-evidenced written rationales. Consistent and honest judgment with critical assessment skills. Strict attention to detail and accurate application of structured evaluation guidelines. Ability to work entirely without AI writing tools . Native English fluency required. Preferred Candidates based in the United States , United Kingdom , Canada , Australia , or New Zealand . Application Process (Takes 20–30 mins to complete) Upload resume AI interview based on your resume Submit form Resources & Support For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome For any help or support, reach out to: support@mercor.com PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Create a job alert for this search

Analytical Evaluator - AI Feedback Specialist • Ontario, Canada

Similar jobs

AI Solutions Deployment Manager, Cloud Applied AI, Telco

Google Inc.southwestern ontario, on, Canada
Full-time

AI Solutions Deployment Manager, Cloud Applied AI, Telco.Google place Waterloo, ON, Canada ; New York, NY, USA.X Applicants in Canada: This posting is for a new vacancy.Google utilizes AI tools to ... Show more

 • Promoted

AI Vision Engineering Lead Role

Musashi AI North Americasouthwestern ontario, on, Canada
Full-time

Become the AI Vision Engineering Lead at Musashi AI North America in Waterloo, Ontario.Champion the development of groundbreaking AI/ML vision systems in a collaborative environment.In this role, y... Show more

 • Promoted

Staff AI Engineer

Sonatussouthwestern ontario, on, Canada
Full-time

At Sonatus, we're driving the transformation to AI-enabled software-defined vehicles.Traditional automotive software methods can't keep pace with consumer expectations shaped by the mobile industry... Show more

 • Promoted

Senior AI Productivity - Data Analyst

NearSourceOntario, Canada
CA$60.00 hourly
Full-time
Quick Apply

Senior AI Productivity - Data Analyst.Bachelor's degree in Data Science, Statistics, Mathematics, Computer Science, Economics, Engineering, or a related quantitative discipline.NearSource is seekin... Show more

Senior AI Platform Engineer

Alpacasouthwestern ontario, on, Canada
Full-time

Alpaca is building an AI Enablement function to move the company from scattered AI experimentation to durable, company-wide productivity gains.As Senior AI Platform Engineer, you will own the techn... Show more

 • Promoted

Lead Data Modelling Engineer

OpenTextsouthwestern ontario, on, Canada
Full-time

Lead Data Modelling Engineer – OpenText.Join OpenText as a Lead Data Modelling Engineer, where AI powers innovation and you will lead data architecture and software development.A Development role a... Show more

 • Promoted

Senior AI Productivity Analyst

NearSourceOntario, Canada
CA$60.00 hourly
Full-time
Quick Apply

Senior AI Productivity Analyst.Bachelor's degree in Data Science, Statistics, Mathematics, Computer Science, Economics, Engineering, or a related quantitative discipline.NearSource is seeking a Sen... Show more

Lead AI Vision Engineer

Musashi AI North Americasouthwestern ontario, on, Canada
Full-time

Based in Waterloo, Ontario, Musashi AI North America employs a talented and dynamic team of R&D and Applications Engineers who lead design, prototyping, and testing efforts to drive new technology ... Show more

 • Promoted

Lead AI Platform Engineer at Alpaca

Alpacasouthwestern ontario, on, Canada
Full-time

Excel at Alpaca as a Senior AI Platform Engineer, where you'll revolutionize AI capabilities by building essential infrastructure.This role involves shaping AI experimentation into effective, reusa... Show more

 • Promoted

Lead Machine Learning Engineer for AI Products

MasterClasssouthwestern ontario, on, Canada
Full-time

Pioneer AI-driven learning solutions as a Lead Machine Learning Engineer.Focus on delivering impactful consumer-facing products utilizing the latest AI advancements and engineering practices.This r... Show more

 • Promoted

Lead Firmware Engineer for AI Integration

onsemisouthwestern ontario, on, Canada
Full-time

Join onsemi as a Lead Firmware Engineer, focusing on AI hardware integration.Your expertise will power next-gen accelerators through innovative firmware solutions.In this Principal Firmware Develop... Show more

 • Promoted

Analyst, Platform & Enablement

McAfee GmbHsouthwestern ontario, on, Canada
Full-time

Job Description Summary We are seeking a Data Analyst to join the Analytics Architecture team within McAfee’s Analytics Platform & Enablement organization.In this role you will build, validate, and... Show more

 • Promoted

Production-Ready Vision AI/ML Lead

Musashi AI North Americasouthwestern ontario, on, Canada
Full-time

A technology firm in Ontario seeks a Staff AI Engineer to lead the deployment and integration of AI/ML solutions.The ideal candidate has a Bachelor's degree and over 8 years of experience in AI/ML,... Show more

 • Promoted

Senior Business Engagement Specialist in AI

Borealis AISouthwestern Ontario, ON, CA
Full-time

Join Borealis AI at RBC as a Senior Business Engagement Lead, focused on connecting AI research with strategic goals in the banking sector.Your expertise in machine learning will drive significant ... Show more

 • Promoted

Senior Data & AI Productivity Analyst

NearSourceOntario, Canada
CA$67.00 hourly
Remote
Full-time
Quick Apply

Remote - Toronto, Ontario, Canada.Bachelor's degree in Data Science, Statistics, Mathematics, Computer Science, Economics, Engineering, or a related quantitative discipline.NearSource is seeking a ... Show more

Machine Learning Research Engineer

Omazesouthwestern ontario, on, Canada
Full-time

The Product Operations machine learning team is seeking a machine learning research engineer to conduct research in anomaly detection and automated machine learning to address domain-specific chall... Show more

 • Promoted

AI Innovation Architect – Knowledge Graphs & Ontology

Kinaxissouthwestern ontario, on, Canada
Full-time

Are you looking to join an innovative, market-leading company where you can truly elevate your career? At Kinaxis we are serious about culture, we are serious about technology, we are serious about... Show more

 • Promoted

Lead Data Modeling Engineer — AI & SaaS

OpenTextsouthwestern ontario, on, Canada
Full-time

A leading technology company in Canada seeks a Lead Data Modelling Engineer to lead the design of SaaS products and implement scalable data systems.The role requires 8+ years of software developmen... Show more

 • Promoted

Manager, Technical Solutions, Cloud Applied AI

Google Inc.southwestern ontario, on, Canada
Full-time

Manager, Technical Solutions, Cloud Applied AI.Google Waterloo, ON, Canada ; Kirkland, WA, USA ; +1 more.X This posting is for a new vacancy.Google utilizes AI tools to assist in assessing candidat... Show more

 • Promoted

Senior Technical Support Analyst

Verily Healthsouthwestern ontario, on, Canada
Full-time

Verily Health is a data platform and technology company purpose-built to power AI‑enabled precision health solutions that accelerate research and improve care for individuals and communities.Unique... Show more