Talent.com
Mercor
PhD Engineer – AI Evaluation SpecialistMercor • Ontario, Canada
PhD Engineer – AI Evaluation Specialist

PhD Engineer – AI Evaluation Specialist

Mercor • Ontario, Canada
30+ days ago
Salary
CA$73.00 hourly
Job type
  • Full-time
Job description
About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Engineering AI Evaluator Type: Contract Compensation: $73/hour Location: Remote Role Responsibilities Write and refine prompts to guide model behavior in engineering scenarios . Evaluate LLM-generated responses for technical accuracy and applied reasoning. Conduct fact-checking and verify technical claims using authoritative sources. Annotate model responses, identifying strengths and areas for improvement. Assess clarity and appropriateness of explanations for different audiences. Ensure model responses align with expected conversational behavior and guidelines. Qualifications Must-Have PhD in Engineering or a closely related field Expertise in Mechanical & Physical Systems Engineering , Electrical, Electronic & Computer Engineering , Chemical, Materials & Process Engineering , or Civil, Environmental & Infrastructure Engineering Significant experience using large language models (LLMs) Excellent writing skills Strong attention to detail Experience reviewing or editing technical or academic writing Preferred Experience with applied research, industry engineering workflows, or systems design Prior experience with RLHF , model evaluation, or data annotation work Experience teaching or explaining engineering concepts to non-expert audiences Familiarity with evaluation rubrics or structured review frameworks Application Process (Takes 20–30 mins to complete) Upload resume AI interview based on your resume Submit form Resources & Support For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome For any help or support, reach out to: support@mercor.com PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Create a job alert for this search

PhD Engineer – AI Evaluation Specialist • Ontario, Canada

Similar jobs

AI Vision Engineering Lead Role

Musashi AI North Americasouthwestern ontario, on, Canada
Full-time

Become the AI Vision Engineering Lead at Musashi AI North America in Waterloo, Ontario.Champion the development of groundbreaking AI/ML vision systems in a collaborative environment.In this role, y... Show more

 • Promoted

Borealis AI Machine Learning Specialist

Borealis AISouthwestern Ontario, ON, CA
Full-time

Become a Machine Learning Specialist at Borealis AI and shape the future of AI through innovative research.Channel your skills in Python and deep learning to develop groundbreaking models.As a valu... Show more

 • Promoted

Sr. Engineer, SoC Design Verification

Tenstorrent, on, canada, on, Canada
Full-time +1

Staff Engineer, SoC - DFD Design Verification.Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency.With AI r... Show more

 • Promoted

Senior AI Platform Engineer

Alpacasouthwestern ontario, on, Canada
Full-time

Alpaca is building an AI Enablement function to move the company from scattered AI experimentation to durable, company-wide productivity gains.As Senior AI Platform Engineer, you will own the techn... Show more

 • Promoted

Lead Data Modelling Engineer

OpenTextsouthwestern ontario, on, Canada
Full-time

Lead Data Modelling Engineer – OpenText.Join OpenText as a Lead Data Modelling Engineer, where AI powers innovation and you will lead data architecture and software development.A Development role a... Show more

 • Promoted

Lead AI Vision Engineer

Musashi AI North Americasouthwestern ontario, on, Canada
Full-time

Based in Waterloo, Ontario, Musashi AI North America employs a talented and dynamic team of R&D and Applications Engineers who lead design, prototyping, and testing efforts to drive new technology ... Show more

 • Promoted

Engineering Innovator for Groundbreaking AI Recruiting Platform

CleraSouthwestern Ontario, ON, CA
Full-time

Join a founding team as an innovative engineer focused on AI-powered recruiting solutions.Shape product strategies and automate workflows to revolutionize talent acquisition processes.As the fourth... Show more

 • Promoted

Lead AI Platform Engineer at Alpaca

Alpacasouthwestern ontario, on, Canada
Full-time

Excel at Alpaca as a Senior AI Platform Engineer, where you'll revolutionize AI capabilities by building essential infrastructure.This role involves shaping AI experimentation into effective, reusa... Show more

 • Promoted

Sr./ Staff AI/ML Engineer - Vision Systems

Musashi AI North Americasouthwestern ontario, on, Canada
Full-time

Based in Waterloo, Ontario, Musashi AI North America employs a talented and dynamic team of R&D and Applications Engineers who lead design, prototyping, and testing efforts to drive new technology ... Show more

 • Promoted

Staff AI Engineer - Agentic Systems Lead

MasterClasssouthwestern ontario, on, Canada
Full-time

A leading online learning platform is seeking a Staff ML Engineer to join their AI engineering team.In this role, you will design and build innovative AI systems that enhance consumer learning prod... Show more

 • Promoted

Machine Learning Architect Driving Next-Gen AI Capabilities

Kinaxissouthwestern ontario, on, Canada
Full-time

Become a Machine Learning Architect and lead AI innovation efforts in supply chain management.Work in a flexible hybrid role focused on practical solutions for real customer challenges.This role re... Show more

 • Promoted

Lead Firmware Engineer for AI Integration

onsemisouthwestern ontario, on, Canada
Full-time

Join onsemi as a Lead Firmware Engineer, focusing on AI hardware integration.Your expertise will power next-gen accelerators through innovative firmware solutions.In this Principal Firmware Develop... Show more

 • Promoted

AI Hardware Lead

Musashi AmericasSouthwestern Ontario, ON, CA
Full-time

Based in Waterloo, Ontario, we employ a talented and dynamic team of R&D and Applications Engineers driving new technology development, building innovative products, and supporting deployed solutio... Show more

 • Promoted

Kinaxis Machine Learning & Operations Research Engineer

Kinaxissouthwestern ontario, on, Canada
Full-time

Drive innovation with Kinaxis as a Machine Learning & Operations Research Engineer.This role involves enhancing supply chain solutions through mathematical modeling and robust software development ... Show more

 • Promoted

Staff Software Engineer: Platform & AI Systems

Cartasouthwestern ontario, on, Canada
Full-time

A tech-driven private market infrastructure company is seeking a Staff Engineer to enhance the technical framework of its platform.This role demands expertise in building distributed systems primar... Show more

 • Promoted

Machine Learning/Operations Research Platform Engineer

Kinaxissouthwestern ontario, on, Canada
Full-time

Are you looking to join an innovative, market‑leading company where you can truly elevate your career? At Kinaxis we are serious about culture, technology, customers, and not taking ourselves too s... Show more

 • Promoted

Senior Research Engineer — AI Data Security

Huawei CanadaSouthwestern Ontario, ON, CA
Permanent

Huawei Canada has an immediate permanent opening for a Senior Researcher.The Digital Trust Lab is dedicated to ensuring user data flows while maintaining privacy.Researchers focus on key areas such... Show more

 • Promoted

Lead Data Modeling Engineer — AI & SaaS

OpenTextsouthwestern ontario, on, Canada
Full-time

A leading technology company in Canada seeks a Lead Data Modelling Engineer to lead the design of SaaS products and implement scalable data systems.The role requires 8+ years of software developmen... Show more

 • Promoted

Google Cloud Generative AI Specialist

GoogleSouthwestern Ontario, ON, CA
Full-time

Transform client solutions as a Generative AI Specialist at Google Cloud.Engage directly with customers to design prototypes and reveal the capabilities of Generative AI.As a Field Solutions Develo... Show more

 • Promoted

Machine Learning Engineer, Edge AI

onsemisouthwestern ontario, on, Canada
Full-time

We are looking for a Principal Firmware Engineer to lead the integration and control of our next‑generation AI accelerators.As our products evolve to include dedicated neural network hardware, the ... Show more