Talent.com
Mercor
PhD Engineer – AI Assessment SpecialistMercor • Ontario, Canada
PhD Engineer – AI Assessment Specialist

PhD Engineer – AI Assessment Specialist

Mercor • Ontario, Canada
30+ days ago
Salary
CA$73.00 hourly
Job type
  • Full-time
Job description
About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Engineering AI Evaluator Type: Contract Compensation: $73/hour Location: Remote Role Responsibilities Write and refine prompts to guide model behavior in engineering scenarios . Evaluate LLM-generated responses for technical accuracy and applied reasoning. Conduct fact-checking and verify technical claims using authoritative sources. Annotate model responses, identifying strengths and areas for improvement. Assess clarity and appropriateness of explanations for different audiences. Ensure model responses align with expected conversational behavior and guidelines. Qualifications Must-Have PhD in Engineering or a closely related field Expertise in Mechanical & Physical Systems Engineering , Electrical, Electronic & Computer Engineering , Chemical, Materials & Process Engineering , or Civil, Environmental & Infrastructure Engineering Significant experience using large language models (LLMs) Excellent writing skills Strong attention to detail Experience reviewing or editing technical or academic writing Preferred Experience with applied research, industry engineering workflows, or systems design Prior experience with RLHF , model evaluation, or data annotation work Experience teaching or explaining engineering concepts to non-expert audiences Familiarity with evaluation rubrics or structured review frameworks Application Process (Takes 20–30 mins to complete) Upload resume AI interview based on your resume Submit form Resources & Support For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome For any help or support, reach out to: support@mercor.com PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Create a job alert for this search

PhD Engineer – AI Assessment Specialist • Ontario, Canada

Similar jobs

AI Vision Engineering Lead Role

Musashi AI North Americasouthwestern ontario, on, Canada
Full-time

Become the AI Vision Engineering Lead at Musashi AI North America in Waterloo, Ontario.Champion the development of groundbreaking AI/ML vision systems in a collaborative environment.In this role, y... Show more

 • Promoted

Senior Director, AI Software Engineering at MCAP

MCAP Group of Companiessouthwestern ontario, on, Canada
Full-time

Advance your career at MCAP as the Senior Director of AI Software Engineering in Waterloo, Ontario.Help shape the future of software delivery with AI-driven methodologies.You will play a pivotal ro... Show more

 • Promoted

Borealis AI Machine Learning Specialist

Borealis AISouthwestern Ontario, ON, CA
Full-time

Become a Machine Learning Specialist at Borealis AI and shape the future of AI through innovative research.Channel your skills in Python and deep learning to develop groundbreaking models.As a valu... Show more

 • Promoted

AI Solutions Deployment Manager, Cloud Applied AI, Telco

Google Inc.southwestern ontario, on, Canada
Full-time

AI Solutions Deployment Manager, Cloud Applied AI, Telco.Google place Waterloo, ON, Canada ; New York, NY, USA.X Applicants in Canada: This posting is for a new vacancy.Google utilizes AI tools to ... Show more

 • Promoted

Staff AI Engineer

Sonatussouthwestern ontario, on, Canada
Full-time

At Sonatus, we're driving the transformation to AI-enabled software-defined vehicles.Traditional automotive software methods can't keep pace with consumer expectations shaped by the mobile industry... Show more

 • Promoted

Senior AI Full‐Stack Engineer

Manulife Financialsouthwestern ontario, on, Canada
Full-time

Step into a role where AI isn’t an add‑‑on it’s the foundation.We’re looking for a Senior Full‑Stack AI Engineer who wants to shape how modern AI‑driven software is built, deployed, and scaled.You’... Show more

 • Promoted

Remote Math Expert (PhD)

Micro1northwestern ontario, on, Canada
Remote
Full-time

Physics Expert (PhD / Postdoc).Written Technical Communication.Technical Problem-Solving Depth.Mathematical & Computational Fluency.AI data lab for training frontier models and evaluating AI ag.Ins... Show more

 • Promoted

Lead AI Vision Engineer

Musashi AI North Americasouthwestern ontario, on, Canada
Full-time

Based in Waterloo, Ontario, Musashi AI North America employs a talented and dynamic team of R&D and Applications Engineers who lead design, prototyping, and testing efforts to drive new technology ... Show more

 • Promoted

Engineering Innovator for Groundbreaking AI Recruiting Platform

CleraSouthwestern Ontario, ON, CA
Full-time

Join a founding team as an innovative engineer focused on AI-powered recruiting solutions.Shape product strategies and automate workflows to revolutionize talent acquisition processes.As the fourth... Show more

 • Promoted

Lead AI Platform Engineer at Alpaca

Alpacasouthwestern ontario, on, Canada
Full-time

Excel at Alpaca as a Senior AI Platform Engineer, where you'll revolutionize AI capabilities by building essential infrastructure.This role involves shaping AI experimentation into effective, reusa... Show more

 • Promoted

Sr./ Staff AI/ML Engineer - Vision Systems

Musashi AI North Americasouthwestern ontario, on, Canada
Full-time

Based in Waterloo, Ontario, Musashi AI North America employs a talented and dynamic team of R&D and Applications Engineers who lead design, prototyping, and testing efforts to drive new technology ... Show more

 • Promoted

Staff AI Engineer - Agentic Systems Lead

MasterClasssouthwestern ontario, on, Canada
Full-time

A leading online learning platform is seeking a Staff ML Engineer to join their AI engineering team.In this role, you will design and build innovative AI systems that enhance consumer learning prod... Show more

 • Promoted

Lead Firmware Engineer for AI Integration

onsemisouthwestern ontario, on, Canada
Full-time

Join onsemi as a Lead Firmware Engineer, focusing on AI hardware integration.Your expertise will power next-gen accelerators through innovative firmware solutions.In this Principal Firmware Develop... Show more

 • Promoted

AI Hardware Lead

Musashi AmericasSouthwestern Ontario, ON, CA
Full-time

Based in Waterloo, Ontario, we employ a talented and dynamic team of R&D and Applications Engineers driving new technology development, building innovative products, and supporting deployed solutio... Show more

 • Promoted

Staff Software Engineer: Platform & AI Systems

Cartasouthwestern ontario, on, Canada
Full-time

A tech-driven private market infrastructure company is seeking a Staff Engineer to enhance the technical framework of its platform.This role demands expertise in building distributed systems primar... Show more

 • Promoted

Senior Research Engineer — AI Data Security

Huawei CanadaSouthwestern Ontario, ON, CA
Permanent

Huawei Canada has an immediate permanent opening for a Senior Researcher.The Digital Trust Lab is dedicated to ensuring user data flows while maintaining privacy.Researchers focus on key areas such... Show more

 • Promoted

Manager, Technical Solutions, Cloud Applied AI

Google Inc.southwestern ontario, on, Canada
Full-time

Manager, Technical Solutions, Cloud Applied AI.Google Waterloo, ON, Canada ; Kirkland, WA, USA ; +1 more.X This posting is for a new vacancy.Google utilizes AI tools to assist in assessing candidat... Show more

 • Promoted

AI Innovation Architect – Knowledge Graphs & Ontology

Kinaxissouthwestern ontario, on, Canada
Full-time

Are you looking to join an innovative, market-leading company where you can truly elevate your career? At Kinaxis we are serious about culture, we are serious about technology, we are serious about... Show more

 • Promoted

Google Cloud Generative AI Specialist

GoogleSouthwestern Ontario, ON, CA
Full-time

Transform client solutions as a Generative AI Specialist at Google Cloud.Engage directly with customers to design prototypes and reveal the capabilities of Generative AI.As a Field Solutions Develo... Show more

 • Promoted

Senior AI Platform Engineer

AlpacaSouthwestern Ontario, ON, CA
Full-time

Alpaca is building an AI Enablement function to move the company from scattered AI experimentation to durable, company-wide productivity gains.As Senior AI Platform Engineer, you will own the techn... Show more