Talent.com
Mercor
Chemistry PhD LLM Evaluation SpecialistMercor • Ontario, Canada
Chemistry PhD LLM Evaluation Specialist

Chemistry PhD LLM Evaluation Specialist

Mercor • Ontario, Canada
30+ days ago
Salary
CA$73.00 hourly
Job type
  • Full-time
Job description
About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Chemistry AI Evaluator Type: Contract Compensation: $73/hour Location: Remote Role Responsibilities Write and refine prompts to guide model behavior in chemistry contexts. Evaluate LLM-generated responses to chemistry-related queries for scientific accuracy and mechanistic correctness. Conduct fact-checking using authoritative public sources and domain knowledge. Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies. Assess clarity, structure, and appropriateness of explanations for different audiences. Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines. Qualifications Must-Have PhD in Chemistry or a closely related field Deep expertise in Organic & Biological Chemistry , Inorganic & Materials Chemistry , Physical & Theoretical Chemistry , or Analytical & Instrumental Chemistry Significant experience using large language models (LLMs) Excellent writing skills and ability to clearly explain complex chemistry concepts Strong attention to detail Experience reviewing or editing technical or academic writing Preferred Prior experience with RLHF , model evaluation, or data annotation work Experience teaching, mentoring, or explaining chemistry concepts to non-expert audiences Familiarity with evaluation rubrics, benchmarks, or structured review frameworks Application Process (Takes 20–30 mins to complete) Upload resume AI interview based on your resume Submit form Resources & Support For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome For any help or support, reach out to: support@mercor.com PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Create a job alert for this search

Chemistry PhD LLM Evaluation Specialist • Ontario, Canada

Similar jobs

Gift Implementation & Compliance Specialist

University of TorontoON, CA
Full-time

A leading educational institution in Ontario seeks a Gift Implementation & Compliance Officer to manage donor gifts and financial awards.The role requires strong analytical skills and a commitment ... Show more

 • Promoted

Electrical Engineering Laboratory Specialist Role

University-of-WaterloSouthwestern Ontario, ON, CA
Full-time

Become a part of the University of Waterloo’s Faculty of Engineering as an Electrical Engineering Laboratory Specialist.This full-time position combines teaching and hardware management to foster s... Show more

 • Promoted

Medical Subject Matter Expert Role

Cactus CommunicationsSouthwestern Ontario, ON, CA
Full-time

Utilize your medical expertise in a rewarding Medical Subject Matter Expert role focused on evaluating educational content.Engage with AI-generated materials to ensure relevance and educational eff... Show more

 • Promoted

Borealis AI Machine Learning Specialist

Borealis AISouthwestern Ontario, ON, CA
Full-time

Become a Machine Learning Specialist at Borealis AI and shape the future of AI through innovative research.Channel your skills in Python and deep learning to develop groundbreaking models.As a valu... Show more

 • Promoted

Remote Math Expert (PhD)

Micro1northwestern ontario, on, Canada
Remote
Full-time

Physics Expert (PhD / Postdoc).Written Technical Communication.Technical Problem-Solving Depth.Mathematical & Computational Fluency.AI data lab for training frontier models and evaluating AI ag.Ins... Show more

 • Promoted

Freelance Medical Subject Matter Expert - LLM Validation

Cactus CommunicationsSouthwestern Ontario, ON, CA
Full-time

We are seeking qualified medical educators currently teaching medical students to join our subject matter expert (SME) team.Evaluate and assess AI-generated medical content to ensure it meets the p... Show more

 • Promoted

Lead Data Modelling Engineer

OpenTextsouthwestern ontario, on, Canada
Full-time

Lead Data Modelling Engineer – OpenText.Join OpenText as a Lead Data Modelling Engineer, where AI powers innovation and you will lead data architecture and software development.A Development role a... Show more

 • Promoted

Lab Instructor

University-of-WaterloSouthwestern Ontario, ON, CA
Full-time +1

At the University of Waterloo, we create and promote a culture where everyone can reach their full potential.As an employee, you get support & opportunities that empower you to advance your career.... Show more

 • Promoted

Laboratory Instructor, Hardware Specialist

University-of-WaterloSouthwestern Ontario, ON, CA
Full-time

At the University of Waterloo, we create and promote a culture where everyone can reach their full potential.As an employee, you get support & opportunities that empower you to advance your career.... Show more

 • Promoted

Sr./ Staff AI/ML Engineer - Vision Systems

Musashi AI North Americasouthwestern ontario, on, Canada
Full-time

Based in Waterloo, Ontario, Musashi AI North America employs a talented and dynamic team of R&D and Applications Engineers who lead design, prototyping, and testing efforts to drive new technology ... Show more

 • Promoted

Statistical Programmer in Pharma Consulting

AlsinovaSouthwestern Ontario, ON, CA
Full-time

Become a Statistical Programmer Consultant with Alsinova in Belgium, tackling complex statistical challenges within the pharmaceutical industry.Enhance your skills in automation, analysis, and clie... Show more

 • Promoted

Learning Systems Analyst

Compunnel Inc.Southwestern Ontario, ON, CA
Full-time

Waterloo, ON (Hybrid – 3 days onsite, open to Toronto).Potential for extension or conversion.Digital Business Analyst & Test Lead.HR technology initiatives across a global workforce.This role combi... Show more

 • Promoted

Senior Operational Test and Evaluation Engineer

Spectrum Comm IncEastern Ontario
Full-time +1

Senior Operational Test and Evaluation Engineer.Spectrum is seeking highly qualified Engineers and/or Analysts to support Operational Test & Evaluation (OT&E) programs located in Edwards AFB, CA.Ke... Show more

 • Promoted

Training Specialist - LMS

Compunnel Inc.ON, CA
Full-time

Looking for a Training Specialist to join our Sales Effectiveness & Advisor Experience team on a contract basis, covering a maternity leave.On our team you will report to the Director, Sales Traini... Show more

 • Promoted

Remote AI/ML Engineer - NLP & LLM Deployment (3+ yrs)

Veracity Software IncON, CA
Remote
Full-time

A technology consulting company is seeking an AI / ML Engineer or Data Scientist with over 3 years of experience in AI/ML development.The successful candidate will have a solid educational backgrou... Show more

 • Promoted

Geosyntec Risk Assessment Specialist

Geosyntec ConsultantsSouthwestern Ontario, ON, CA
Full-time

Drive environmental progress as a Risk Assessment Specialist at Geosyntec, with a focus on ecological and human health assessments in Ontario, including key cities like Kingston and Guelph.This rol... Show more

 • Promoted

Medical Affairs Expert for Alsinova

AlsinovaSouthwestern Ontario, ON, CA
Full-time

Elevate your career in Belgium as a Medical Affairs Expert with Alsinova.Contribute to high-profile pharmaceutical projects while honing your scientific knowledge.Join Alsinova in this exciting Con... Show more

 • Promoted

Lab Instructor for Astronomy Programs

University-of-WaterloSouthwestern Ontario, ON, CA
Full-time

The University of Waterloo seeks a motivated Lab Instructor specializing in Astronomy to enhance laboratory education.This full-time position involves direct teaching and administrative responsibil... Show more

 • Promoted

Senior Contract Specialist, Clinical Research

Probity Medical Research Inc.Southwestern Ontario, ON, CA
Full-time

Senior Contract Specialist, Clinical Research.Full Time Associate – Waterloo, ON, CA.Probity Medical Research (PMR) is an administrative support company that partners with clinical research sites a... Show more

 • Promoted

Senior Budget Specialist, Clinical Research

Probity Medical Research Inc.Southwestern Ontario, ON, CA
Full-time

Senior Budget Specialist, Clinical Research.Full-time position based in Waterloo, ON, Canada.Probity Medical Research (PMR) is an administrative support company that partners with clinical research... Show more