Talent.com
Mercor
Analytical Evaluator AI Feedback SpecialistMercor • Toronto, Ontario, Canada
Les candidatures ne sont plus acceptées
Analytical Evaluator AI Feedback Specialist

Analytical Evaluator AI Feedback Specialist

Mercor • Toronto, Ontario, Canada
Il y a plus de 30 jours
Salaire
60,00 $CA par heure
Type de contrat
  • Temps plein
Description de poste

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey.

Position: Generalist Expert
Type: Contract
Compensation: $60$200/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated responses to strengthen reasoning and rigor in model outputs.
  • Provide clear structured feedback to improve training data quality and downstream performance.
  • Develop evaluation rubrics and benchmarks for assessing AI-generated tasks.
  • Work independently and asynchronously to meet deadlines while improving AI model performance.

Qualifications

Must-Have

  • Bachelors degree from a top-100 globally ranked university preferred.
  • Strong analytical and written communication skills.
  • Ability to work independently and follow detailed task guidelines.
  • Strong critical reading skills with the ability to identify nuance and gaps in reasoning.
  • Ability to write clear precise and well-evidenced written rationales.
  • Consistent and honest judgment with critical assessment skills.
  • Strict attention to detail and accurate application of structured evaluation guidelines.
  • Ability to work entirely without AI writing tools.
  • Native English fluency required.

Preferred

  • Candidates based in the United States United Kingdom Canada Australia or New Zealand.

Application Process (Takes 2030 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information please check:
  • For any help or support reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.


Employment Type : Full Time
Experience: years
Vacancy: 1

Créer une alerte emploi pour cette recherche

Analytical Evaluator AI Feedback Specialist • Toronto, Ontario, Canada

Offres similaires

Advanced Analytics Specialist

Green Shield Canada (GSC)Toronto, ON, CA
Temps plein

When it comes to health, we’re always looking for ways to push for better.It’s why we were founded in the first place.In 1957, our founder, pharmacist William Wilkinson, witnessed a mother sacrific... Voir plus

 • Offre sponsorisée

Analytical Scientist: Lab Insights & Impact

Syneos Health, Inc.Toronto, ON, CA
Temps plein

A leading biopharmaceutical solutions organization is seeking an Analytical Scientist to support routine sample analysis and become familiar with established procedures.Candidates should have a deg... Voir plus

 • Offre sponsorisée

Senior Researcher in HCI and AI Systems

Huawei Technologies Canada Co., Ltd.Markham, Ontario, Canada
Temps plein

Take on a pivotal role at Huawei Canada as a Senior Researcher in Human-Computer Interaction.Focus on innovative research around agentic AI and multimodal interfaces for enhanced user experiences.T... Voir plus

 • Offre sponsorisée

Remote Chemistry Specialist — AI Content QA & Evaluation

Crossing HurdlesToronto, ON, CA
Télétravail
Temps plein

A recruitment firm is seeking a Chemistry Expert to review and verify AI-generated content and develop chemistry problems.This remote role requires an advanced degree and strong analytical skills.T... Voir plus

 • Offre sponsorisée

Applied AI Research Scientist — Multimodal Evaluation

MillionLogicsToronto, ON, CA
Temps plein

A global IT solutions provider is searching for skilled Applied AI Research Scientists to contribute to AI system evaluations.Candidates should hold an MS or Ph.The role involves designing rigorous... Voir plus

 • Offre sponsorisée

AI-Enabled HubSpot Automation Specialist

Unyte HealthToronto, ON, CA
Temps plein

AI-Enabled HubSpot Automation Specialist.AI-Enthusiast HubSpot Automation Specialist.You’ll own how HubSpot works across the company: uncovering acquisition opportunities, optimizing lifecycle auto... Voir plus

 • Offre sponsorisée

Senior Business Engagement Specialist in AI

Borealis AIToronto, ON, CA
Temps plein

Join Borealis AI at RBC as a Senior Business Engagement Lead, focused on connecting AI research with strategic goals in the banking sector.Your expertise in machine learning will drive significant ... Voir plus

 • Offre sponsorisée

Senior Applied AI Engineer — Product & Revenue Systems

QEA TechMarkham, Ontario, Canada
Temps plein

Build and deploy AI systems that directly drive revenue by embedding AI across QEA’s product, sales, and marketing workflows.This role focuses on execution: turning QEA’s building data, imagery, an... Voir plus

 • Offre sponsorisée

Applied AI Engineer

WELL Health Technologies CorpToronto, Ontario, Canada
Temps plein

WELL Health Technologies is an innovative technology-enabled healthcare company whose overarching objective is to positively impact health outcomes by leveraging technology to empower and support h... Voir plus

 • Offre sponsorisée

RLHF Evaluation Specialist for AI Training

Rex.zoneToronto, ON, CA
Temps plein

A tech company specializing in AI is seeking an AI Trainer based in Canada.The role involves improving large language models through RLHF-style evaluations, prompt evaluation, and data labeling.Can... Voir plus

 • Offre sponsorisée

Applied AI Scientist (Hybrid)

HomebaseToronto, ON, CA
Temps plein

Leverage, fine‑tune, and deploy models—owning the lifecycle from experimentation to.Develop and track metrics that measure real customer impact, ensuring alignment with business outcomes.Partner cr... Voir plus

 • Offre sponsorisée

AI Engagement Lead at EliseAI

EliseAIToronto, ON, CA
Temps plein

Embrace the challenge as an Engagement Lead at EliseAI, where you will help innovate housing and healthcare through AI.Your leadership will guide the successful deployment of future platform produc... Voir plus

 • Offre sponsorisée

Future Secure AI Engagement Lead Position

Future Secure AI PtyToronto, ON, CA
Temps plein

Become an Engagement Lead at Future Secure AI and help develop transformative AI solutions for global enterprises.Guide projects from concept to execution, prioritizing client needs.In this influen... Voir plus

 • Offre sponsorisée

AI Team Lead: Strategy, Mentorship & Impact

M-FilesToronto, ON, CA
Temps plein

A global technology enterprise in Fredericton is seeking an experienced AI Team Manager to lead and grow a team focused on delivering scalable AI capabilities.This role combines technical leadershi... Voir plus

 • Offre sponsorisée

AI Specialist - Applied ML Research

XanaduToronto, Ontario, Canada
Temps plein

Xanadu’s mission is to build quantum computers that are useful and available to people everywhere.At Xanadu, we are learners, innovators, researchers, collaborators and problem solvers.We are creat... Voir plus

 • Offre sponsorisée

Remote AI Data Quality & Evaluation Engineer

Veeva SystemsToronto, ON, CA
Télétravail
Temps plein

A leading cloud technology company in Toronto is seeking an experienced professional to validate and ensure the reliability of Veeva AI Agents.The ideal candidate should have expertise in data qual... Voir plus

 • Offre sponsorisée

Content Evaluator (Remote)

Work VistaToronto, ON, CA
Télétravail
Temps plein

United States, United Kingdom, Canada, Ireland, Australia & New Zealand.You must be legally authorised to work in the country where you are based).We are hiring on behalf of one of our clients, a l... Voir plus

 • Offre sponsorisée

Business Analysis Specialist

SE HealthMarkham, ON, CA
Temps plein

At SE Health, our people are everything—and our Home Office is an important part of that culture.When you choose to join SE Health, you become part of a caring, purpose-driven team that’s making a ... Voir plus

 • Offre sponsorisée

Mercor Equity Research Engagement

ObsidianToronto, Ontario, Canada
Temps plein

Mercor is looking for Equity Research Specialists for an intriguing project with a prominent AI lab.Harness your analytical skills and SEC filing expertise in this engaging role.Canada with at leas... Voir plus

 • Offre sponsorisée

Analytical Evaluator - AI Feedback

MercorToronto, Ontario, Canada
70,00 $CA par heure
Télétravail
Temps partiel
Quick Apply

Headquartered in San Francisco, our investors include.Provide structured written feedback to improve.Develop clear, precise, and well-evidenced written rationales that go beyond surface-level obser... Voir plus