Talent.com
Mercor
AI Assessment Specialist - PhDMercor • Toronto, Ontario, Canada
AI Assessment Specialist - PhD

AI Assessment Specialist - PhD

Mercor • Toronto, Ontario, Canada
2 days ago
Salary
CA$66.00 hourly
Job type
  • Part-time
  • Remote
  • Quick Apply
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Applied Computer Science Benchmark Specialist
Type: Contract
Compensation: $66–$84/hour
Location: Remote
Commitment: 10+ hours/week

Role Responsibilities

  • Author original computer science questions that test deep conceptual understanding.
  • Ensure questions are unambiguous, self-contained, and precisely defined.
  • Rate each question's difficulty as Medium, Hard, or Expert.
  • Provide 1 correct answer and 9 plausible but subtly incorrect alternatives.
  • Write step-by-step Chain-of-Thought solutions in markdown format.
  • Supply 1–5 academic references per question from reputable sources.
  • For verification tasks: flag issues with clarity, completeness, precision, or solvability.

Qualifications

Must-Have

  • PhD or doctoral candidate in Computer Science, Electrical Engineering, or a closely related field.
  • Master's degree considered for candidates with exceptional depth in a specific subdomain.
  • Strong command of graduate-level CS theory, algorithms, systems design, and/or machine learning.
  • Excellent written English and ability to express complex ideas clearly and concisely.

Preferred

  • Research publications, industry experience at top tech companies, or competitive programming background.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Create a job alert for this search

AI Assessment Specialist - PhD • Toronto, Ontario, Canada

Similar jobs

Betstamp AI Engineering Specialist

BetstampToronto, ON, CA
Full-time

Become a key player at Betstamp as an AI Engineering Specialist.Drive automation and innovative data solutions that enhance the sports betting user experience with cutting-edge technology.In this r... Show more

 • Promoted

AI Specialist - AI For Research

Xanadutoronto, on, Canada
Full-time

Software and Algorithms - Toronto, ON, Canada - Full Time.Xanadu’s mission is to build quantum computers that are useful and available to people everywhere.At Xanadu, we are learners, innovators, r... Show more

 • Promoted

Expert AI Engineer Driving AI Initiatives with Advanced Technologies

GEI Consultantsmarkham, york region, Canada
Full-time

Elevate your career as an AI Engineer responsible for pioneering AI solutions that transform business workflows.Focus on deploying scalable AI initiatives integrating modern technologies to meet st... Show more

 • Promoted

Senior Researcher for Multimodal AI Systems

Huawei CanadaMarkham, ON, CA
Full-time

Join Huawei Canada as a Senior Principal Researcher, focusing on cutting-edge multimodal AI systems.Drive the design of next-gen human-AI interaction technologies.As part of Huawei's Human-Machine ... Show more

 • Promoted

AI Enablement Specialist

JAM CRMToronto, ON, CA
Full-time

We are JAM CRM, an award-winning, game-changing, forward-thinking, CRM agency tucked away in trendy Liberty Village.We have a current opening for an AI Optimization Specialist to join our team of o... Show more

 • Promoted

AI Engineering Expert Position Richmond Hill

OpenTextrichmond hill, york region, Canada
Full-time

Contribute to AI innovation at OpenText as a Sr.Principal AI Developer in Richmond Hill, ON.Design and implement scalable AI solutions that meet enterprise demands using your extensive skill set.In... Show more

 • Promoted

RLHF Evaluation Specialist for AI Training

Rex.zoneToronto, ON, CA
Full-time

A tech company specializing in AI is seeking an AI Trainer based in Canada.The role involves improving large language models through RLHF-style evaluations, prompt evaluation, and data labeling.Can... Show more

 • Promoted

Artificial Intelligence Specialist - Physics PhD

ObsidianToronto, ON, CA
Full-time

Make your mark at Mercor as a Physics PhD specializing in String Theory, contributing to pioneering AI development.Engage in solving sophisticated problems and enhancing large language models with ... Show more

 • Promoted

Applied AI Implementation Specialist Toronto

Pear VCtoronto, on, Canada
Full-time

Join Paxos Health in Toronto as an Applied AI Implementation Specialist, focusing on transforming healthcare workflows.You'll work hands-on to structure AI outputs, enhancing patient access to medi... Show more

 • Promoted

Remote Math Researcher for AI Benchmarks (PhD)

TuringToronto, ON, CA
Remote
Full-time

A leading AI research accelerator is seeking PhD candidates in Mathematics or related fields for a remote role.You will design advanced math problems, develop rigorous solutions, and evaluate AI pe... Show more

 • Promoted

Head of Applied AI & Research

PowerToFlytoronto, on, Canada
Full-time

A leading technology research firm in Toronto is seeking a Manager for AI and Applied Research.This role involves managing a high-performing team, translating AI research into scalable products, an... Show more

 • Promoted

Remote Chemistry PhD Researcher for AI Reasoning

TuringToronto, ON, CA
Remote
Full-time

A leading AI company is seeking a Remote Chemistry Specialist with a PhD in Chemistry to create and analyze Chemistry problems for large language models.This role offers flexible remote work, requi... Show more

 • Promoted

Shape the Future of AI/ML with High-Impact Research Queries

Great Value HiringToronto, ON, CA
Full-time

Engage as a pivotal AI/ML Research Expert by identifying game-changing questions in your field.Your work could lead to groundbreaking breakthroughs we need to tackle today.This role is crafted for ... Show more

 • Promoted

Innovative AI Engineering Lead

Definity Financial Corporationtoronto, on, Canada
Full-time

Drive groundbreaking AI innovations as an Engineering Lead specializing in Fraud and Risk Intelligence.Develop robust systems that combat fraud across the insurance sector in a hybrid work model.Yo... Show more

 • Promoted

Remote Clinical Researcher for AI-Driven Health Research

HelixRecruitToronto, ON, CA
Remote
Part-time

A leading recruiting firm is seeking a Clinical Researcher with a PhD for a part-time remote role.You will contribute expertise to AI projects, including designing legal workflows and evaluating AI... Show more

 • Promoted

Strategic AI Enablement Director Position

Ontario Teachers’ Pension PlanToronto, ON, CA
Full-time

Elevate your career as the Director of AI Centre of Enablement with Ontario Teachers’.Influence AI adoption and innovation across the organization.In this senior position, you'll leverage your exte... Show more

 • Promoted

AI Multimodal Interaction Senior Principal Researcher

Huawei Technologies Canada Co., Ltd.Markham, ON, CA
Full-time

Transform AI interactions as a Senior Principal Researcher at Huawei Canada.Focus on creating state-of-the-art multimodal systems that integrate voice, touch, and visual experiences in innovative w... Show more

 • Promoted

Senior AI Technology Strategy Expert

Huawei CanadaMarkham, York Region, CA
Permanent

Huawei Canada has an immediate permanent opening for a Senior AI Technology Strategy Expert.The Technology Planning and Cooperation Department promotes strategic innovation across all of Huawei Can... Show more

 • Promoted

Historical AI Prompt Architect — PhD Expert

Crossing HurdlesToronto, ON, CA
Part-time

A leading research organization is seeking a Social Sciences PhD Expert for a remote, part-time project-based role.Responsibilities include creating accurate prompts across historical contexts, eva... Show more

 • Promoted

Senior Researcher in HCI and AI Systems

Huawei Technologies Canada Co., Ltd.markham, on, Canada
Full-time

Take on a pivotal role at Huawei Canada as a Senior Researcher in Human-Computer Interaction.Focus on innovative research around agentic AI and multimodal interfaces for enhanced user experiences.T... Show more