Talent.com
Legal Expert - Evaluation Specialist
Legal Expert - Evaluation SpecialistMercor • Toronto, Ontario, Canada
Legal Expert - Evaluation Specialist

Legal Expert - Evaluation Specialist

Mercor • Toronto, Ontario, Canada
28 days ago
Job type
  • Part-time
  • Remote
  • Quick Apply
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: AI Model Evaluation Specialist
Type: Contract
Compensation: $50–$75/hour
Commitment: ~20 hours/week

Role Responsibilities

  • Write realistic prompts that reflect how professionals and consumers seek domain-specific guidance.
  • Evaluate AI-generated responses for factual accuracy, regulatory or clinical correctness, and practical usefulness.
  • Identify fabricated claims, incorrect references, or misleading reasoning across model outputs.
  • Score and rank multiple model responses using structured rubrics across dimensions.
  • Provide written justifications with specific evidence for each evaluation.

Qualifications

Must-Have

  • Master’s degree or higher in Legal or a relevant professional field.
  • Professional experience applying domain expertise in a practitioner or advisory capacity.
  • Familiarity with industry-specific standards, regulations, or clinical guidelines.
  • Strong written communication and critical reasoning skills.

Application Process (Takes 20–30 mins to complete)

  • Submit your resume to begin.
  • Complete the Model Response Evaluation assessment.

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Create a job alert for this search

Legal Expert - Evaluation Specialist • Toronto, Ontario, Canada

Similar jobs

Legal Counsel

BJRC RecruitingGreater Toronto Area, Canada, Canada
Full-time

Legal Counsel, Labour, Employment and Human Rights.Our client is a prominent, publicly traded Canadian business operating a diverse portfolio of retail and consumer-facing operations nationwide.The...Show more

 • Promoted

Articling Student - Criminal Law/Employment Law/Litigation

Nadi LawGreater Toronto Area, Canada, Canada
Full-time

Our office is a small boutique litigation law firm specializing in criminal, quasi-criminal and employment law.We are rapidly growing and are seeking a keen articling student to join our practice.T...Show more

 • Promoted

Legal Expert - Evaluation Specialist

MercorToronto, ON, CA
Full-time

Mercor connects elite creative and technical talent with leading AI research labs.Headquartered in San Francisco, our investors include.AI Model Evaluation Specialist.Write realistic prompts that r...Show more

 • Promoted

Legal and Executive Assistant

Professional StaffingGreater Toronto Area, Canada, Canada
Full-time

We are seeking a High Energy ,highly organized and dependable.Executive Assistant & Legal Coordinator.This role is ideal for someone who is detail-oriented, discreet, and comfortable managing a mix...Show more

 • Promoted

Future Opportunities: Lawyers & Legal Counsel - 2026

The Mirillion GroupGreater Toronto Area, Canada, Canada
Full-time

As hiring needs continue into 2026 - our clients have expressed an interest in continuing hiring processes for various roles.Our clients range from private practice firms and organizations of vario...Show more

 • Promoted

Legal Professional (Litigation Specialist)

RemoteVAToronto, ON, CA
Full-time

We are seeking a highly skilled.The ideal candidate will be responsible for managing complex legal disputes, drafting precise legal documents, and representing clients with professionalism and conf...Show more

 • Promoted

Legal Research Specialist With Expertise In Contract Review

Crossing HurdlesToronto, Canada
Full-time

Elevate legal strategies as an experienced Research Specialist.Leverage your skills in drafting, evaluating contracts, and providing insights into litigation and regulatory issues in a flexible, re...Show more

 • Promoted

Member Support Specialist (Bilingual) - Legal Karma

Legal Karmamarkham, on, ca
Full-time

Legal Karma is on a mission to democratize access to law by helping financial institutions become the natural providers of legal products.If you're looking to get in early on a company that feels l...Show more

 • Promoted

Legal Assistant - TopHat HR

TopHat HRmarkham, on, ca
Full-time

Tophat HR is a boutique consulting firm- We are an expert in tailored and comprehensive human resources consulting & management services.About our client and the role :.TopHat HR is partnering with...Show more

 • Promoted

Regulatory Data Governance

Freyr Solutionsrichmond hill, on, ca
Full-time

Freyr is a leading Regulatory Solutions and Services company supporting global Life Sciences organizations across Regulatory Affairs, Pharmacovigilance, Quality, and Compliance.Job Title: RA Data G...Show more

 • Promoted

Legal Research Specialist with Expertise in Contract Review

Crossing HurdlesToronto, Ontario, Canada
Full-time

Elevate legal strategies as an experienced Research Specialist.Leverage your skills in drafting, evaluating contracts, and providing insights into litigation and regulatory issues in a flexible, re...Show more

 • Promoted

Product Trainer/Real Estate Law Clerk

Closer ConveyancingGreater Toronto Area, Canada, Canada
Full-time

London, Ontario, comprised of law and tech professionals dedicated to enhancing the property closing experience.Our mission is to streamline the property conveyancing process for lawyers and clerks...Show more

 • Promoted

Legal Assistant

JING WANG LAW Professional Corporationmarkham, on, ca
Full-time +1

Jing Wang Law Professional Corporation is a dynamic, multi-practice law firm located at Woodbine Avenue and Steeles Avenue in Markham.As our practice continues to grow, we are currently seeking a m...Show more

 • Promoted

Remote and Hybrid Independent Contractor Technology Lawyers (Canada) - markham

MT>Align, a division of McCarthy Tétrault LLPmarkham, on, ca
Remote
Full-time

Work for yourself, but with us!.Align, a division of McCarthy Tétrault LLP, pairs high caliber independent contract lawyers with our clients who need legal support.Align, successful applicants will...Show more

 • Promoted

Remote and Hybrid Independent Contractor Technology Lawyers (Canada) - newmarket

MT>Align, a division of McCarthy Tétrault LLPnewmarket, on, ca
Remote
Full-time

Work for yourself, but with us!.Align, a division of McCarthy Tétrault LLP, pairs high caliber independent contract lawyers with our clients who need legal support.Align, successful applicants will...Show more

 • Promoted

Advisor Support Associate - Worldsource Wealth Management

Worldsource Wealth Managementmarkham, on, ca
Full-time

This role may be based in either Markham, ON or Vancouver, BC.Reporting to the Director, Partnerships and working in a fast-paced MFDA/IIROC regulatory environment, the Advisor Support Associate wi...Show more

 • Promoted

Legal Policy Engagement Specialist for Law and Justice Advocacy

Canadian Bar Association, BC BranchToronto, ON, CA
Part-time

Become a key player in advancing justice through policy as a part-time Engagement Specialist.Use your critical research and writing skills to influence law reforms and facilitate meaningful discuss...Show more

 • Promoted

Legal Intake and Conversion Expert

Auger Hollingsworth Professional Corporation (Ottawa and Toronto)Toronto, ON, CA
Full-time

Enhance client satisfaction as a dynamic Legal Intake Expert.Leverage sales psychology to convert inquiries into signed agreements while providing empathetic support to new clients.This position co...Show more