Talent.com
Mercor
Engineering PhD - AI Evaluation ScientistMercor • Ontario, Canada
Engineering PhD - AI Evaluation Scientist

Engineering PhD - AI Evaluation Scientist

Mercor • Ontario, Canada
30+ days ago
Salary
CA$73.00 hourly
Job type
  • Full-time
Job description
About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Engineering AI Evaluator Type: Contract Compensation: $73/hour Location: Remote Role Responsibilities Write and refine prompts to guide model behavior in engineering scenarios. Evaluate LLM-generated responses for technical accuracy, applied reasoning, and completeness. Conduct fact-checking and verify technical claims using authoritative sources and domain knowledge. Annotate model responses by identifying strengths, areas for improvement, and inaccuracies. Assess clarity, structure, and appropriateness of explanations for different audiences. Ensure model responses align with expected conversational behavior and system guidelines. Qualifications Must-Have PhD in Engineering or a closely related field . Deep expertise in Mechanical & Physical Systems Engineering , Electrical, Electronic & Computer Engineering , Chemical, Materials & Process Engineering , or Civil, Environmental & Infrastructure Engineering . Significant experience using large language models (LLMs). Excellent writing skills and ability to explain complex engineering concepts. Strong attention to detail and experience reviewing or editing technical or academic writing. Preferred Experience with applied research, industry engineering workflows, or systems design. Prior experience with RLHF , model evaluation, or data annotation work. Experience teaching or mentoring engineering concepts to non-expert audiences. Familiarity with evaluation rubrics, benchmarks, or structured review frameworks. Application Process (Takes 20–30 mins to complete) Upload resume AI interview based on your resume Submit form Resources & Support For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome For any help or support, reach out to: support@mercor.com PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Create a job alert for this search

Engineering PhD - AI Evaluation Scientist • Ontario, Canada

Similar jobs

AI Vision Engineering Lead Role

Musashi AI North Americasouthwestern ontario, on, Canada
Full-time

Become the AI Vision Engineering Lead at Musashi AI North America in Waterloo, Ontario.Champion the development of groundbreaking AI/ML vision systems in a collaborative environment.In this role, y... Show more

 • Promoted

Senior Director, AI Software Engineering at MCAP

MCAP Group of Companiessouthwestern ontario, on, Canada
Full-time

Advance your career at MCAP as the Senior Director of AI Software Engineering in Waterloo, Ontario.Help shape the future of software delivery with AI-driven methodologies.You will play a pivotal ro... Show more

 • Promoted

AI Solutions Deployment Manager, Cloud Applied AI, Telco

Google Inc.southwestern ontario, on, Canada
Full-time

AI Solutions Deployment Manager, Cloud Applied AI, Telco.Google place Waterloo, ON, Canada ; New York, NY, USA.X Applicants in Canada: This posting is for a new vacancy.Google utilizes AI tools to ... Show more

 • Promoted

Staff AI Engineer

Sonatussouthwestern ontario, on, Canada
Full-time

At Sonatus, we're driving the transformation to AI-enabled software-defined vehicles.Traditional automotive software methods can't keep pace with consumer expectations shaped by the mobile industry... Show more

 • Promoted

Advanced Data Scientist at Alsinova

AlsinovaSouthwestern Ontario, ON, CA
Full-time

Experience the challenge of a Data Scientist at Alsinova, where you’ll manage innovative analytical projects in Belgium's healthcare space.Bring your machine learning and data analysis skills to di... Show more

 • Promoted

Generative AI Data Scientist Opportunity

Manulife Financial CorporationSouthwestern Ontario, ON, CA
Full-time

Advance your career at Manulife as a Data Scientist specializing in Generative AI.Collaborate on projects that shape the future of financial services with innovative AI solutions.This position with... Show more

 • Promoted

Senior AI Full‐Stack Engineer

Manulife Financialsouthwestern ontario, on, Canada
Full-time

Step into a role where AI isn’t an add‑‑on it’s the foundation.We’re looking for a Senior Full‑Stack AI Engineer who wants to shape how modern AI‑driven software is built, deployed, and scaled.You’... Show more

 • Promoted

Remote Math Expert (PhD)

Micro1northwestern ontario, on, Canada
Remote
Full-time

Physics Expert (PhD / Postdoc).Written Technical Communication.Technical Problem-Solving Depth.Mathematical & Computational Fluency.AI data lab for training frontier models and evaluating AI ag.Ins... Show more

 • Promoted

Lead AI Vision Engineer

Musashi AI North Americasouthwestern ontario, on, Canada
Full-time

Based in Waterloo, Ontario, Musashi AI North America employs a talented and dynamic team of R&D and Applications Engineers who lead design, prototyping, and testing efforts to drive new technology ... Show more

 • Promoted

Engineering Innovator for Groundbreaking AI Recruiting Platform

CleraSouthwestern Ontario, ON, CA
Full-time

Join a founding team as an innovative engineer focused on AI-powered recruiting solutions.Shape product strategies and automate workflows to revolutionize talent acquisition processes.As the fourth... Show more

 • Promoted

Staff AI Data Scientist

Verily Healthsouthwestern ontario, on, Canada
Full-time

Verily Health is a data platform and technology company purpose-built to power AI-enabled precision health solutions that accelerate research and improve care for individuals and communities.Unique... Show more

 • Promoted

Sr./ Staff AI/ML Engineer - Vision Systems

Musashi AI North Americasouthwestern ontario, on, Canada
Full-time

Based in Waterloo, Ontario, Musashi AI North America employs a talented and dynamic team of R&D and Applications Engineers who lead design, prototyping, and testing efforts to drive new technology ... Show more

 • Promoted

Staff AI Engineer - Agentic Systems Lead

MasterClasssouthwestern ontario, on, Canada
Full-time

A leading online learning platform is seeking a Staff ML Engineer to join their AI engineering team.In this role, you will design and build innovative AI systems that enhance consumer learning prod... Show more

 • Promoted

AI Hardware Lead

Musashi AmericasSouthwestern Ontario, ON, CA
Full-time

Based in Waterloo, Ontario, we employ a talented and dynamic team of R&D and Applications Engineers driving new technology development, building innovative products, and supporting deployed solutio... Show more

 • Promoted

Lead Firmware Engineer for AI Integration

onsemisouthwestern ontario, on, Canada
Full-time

Join onsemi as a Lead Firmware Engineer, focusing on AI hardware integration.Your expertise will power next-gen accelerators through innovative firmware solutions.In this Principal Firmware Develop... Show more

 • Promoted

Principal AI Developer

OpenTextsouthwestern ontario, on, Canada
Full-time

OpenText - The Information Company.OpenText is a global leader in information management, where innovation, creativity, and collaboration are the key components of our corporate culture.As a member... Show more

 • Promoted

Student Researcher, PhD, Fall 2026

GoogleSouthwestern Ontario, ON, CA
Full-time

Student Researcher, PhD, Fall 2026.Applications will be reviewed on a rolling basis and it’s in the applicant's best interest to apply early.The anticipated application window is open until Novembe... Show more

 • Promoted

AI Innovation Architect – Knowledge Graphs & Ontology

Kinaxissouthwestern ontario, on, Canada
Full-time

Are you looking to join an innovative, market-leading company where you can truly elevate your career? At Kinaxis we are serious about culture, we are serious about technology, we are serious about... Show more

 • Promoted

Senior Data Scientist Gen AI

Manulife Financial CorporationSouthwestern Ontario, ON, CA
Full-time

Our Canadian Advanced Analytics (AA) team is seeking a highly skilled and motivated Data Scientist with a strong emphasis on Generative AI and Large Language Models (LLM).This role requires a uniqu... Show more

 • Promoted

Machine Learning Engineer, Edge AI

onsemisouthwestern ontario, on, Canada
Full-time

We are looking for a Principal Firmware Engineer to lead the integration and control of our next‑generation AI accelerators.As our products evolve to include dedicated neural network hardware, the ... Show more