Talent.com
Mercor
Bilingual Evaluator LLM SpecialistMercor • Toronto, Ontario, Canada
No longer accepting applications
Bilingual Evaluator LLM Specialist

Bilingual Evaluator LLM Specialist

Mercor • Toronto, Ontario, Canada
22 days ago
Salary
CA$15.00 hourly
Job type
  • Full-time
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey.

Position: Generalist - English & Assamese
Type: Contract
Compensation: $15$20/hour
Location: Remote

Role Responsibilities

  • Conduct fact-checking using trusted public sources and external tools.
  • Generate high-quality human evaluation data by identifying response strengths areas for improvement and factual inaccuracies.
  • Assess reasoning quality clarity tone and completeness of responses.
  • Ensure model responses align with expected conversational behavior and system guidelines.
  • Work independently and asynchronously to meet deadlines while improving AI model performance.

Qualifications

Must-Have

  • Bachelors degree
  • Native speaker in Assamese
  • Significant experience using large language models (LLMs)
  • Excellent writing skills in English
  • Strong attention to detail
  • Background or experience in domains requiring structured analytical thinking

Preferred

  • Prior experience with RLHF model evaluation or data annotation work
  • Experience writing or editing high-quality written content
  • Experience comparing multiple outputs and making fine-grained qualitative judgments

Application Process (Takes 2030 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information please check:
  • For any help or support reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.


Employment Type : Full Time
Experience: years
Vacancy: 1
Create a job alert for this search

Bilingual Evaluator LLM Specialist • Toronto, Ontario, Canada

Similar jobs

(EN/FR) Bilingual Integration Developer

FlexspringToronto, ON, CA
Full-time

Flexspring is the leading expert in data integration for HR applications.We work with various clients to build customized integrations that will solve their specific HR business needs.The Opportuni... Show more

 • Promoted

Bilingual Job Developer – Integrated Employment Services

TNG Community ServicesToronto, ON, CA
Full-time

A community service organization in Toronto seeks a Job Developer to connect job seekers, especially those facing barriers to employment, with meaningful opportunities.You will build partnerships w... Show more

 • Promoted

Senior Employee Relations Specialist (Bilingual)

Lindt & Sprüngli (Canada), IncToronto, ON, CA
Full-time

Reporting to the HR Manager, the Senior Employee Relations Specialist will play a key role in identifying, developing, and implementing employee relations programs.This role provides expert guidanc... Show more

 • Promoted

AI Model Evaluator - Legal Expert Needed

Obsidiantoronto, on, Canada
Part-time

Mercor invites you to a part-time role as a Legal Expert focusing on AI training.Your legal acumen will evaluate responses regarding employment law matters.This position, in collaboration with a pr... Show more

 • Promoted

Bilingual Loyalty Specialist

HomeEquity BankToronto, ON, CA
Full-time

Retaining customers is the primary responsibility of this position.This role implements client retention strategies across multiple channels to retain business, maximize revenue opportunities, and ... Show more

 • Promoted

RLHF Evaluation Specialist for AI Training

Rex.zoneToronto, ON, CA
Full-time

A tech company specializing in AI is seeking an AI Trainer based in Canada.The role involves improving large language models through RLHF-style evaluations, prompt evaluation, and data labeling.Can... Show more

 • Promoted

Global Industrial Bilingual Specialist

Global Industrial CompanyRichmond Hill, York Region, CA
Full-time

Become part of the Global Industrial team in Richmond Hill, ON, as a Bilingual Specialist committed to transforming customer experiences.You will interact with customers via telephone, email, and c... Show more

 • Promoted

Bilingual Customer Support Specialist, EV

ChargeLabToronto, ON, CA
Full-time

Enhance user experiences at ChargeLab as a Bilingual Customer Support Specialist focused on EV Charging.This role revolves around assisting end users in both English and French.As a specialist, you... Show more

 • Promoted

Remote Chemistry Expert (LLM Evaluation) - 34879

TuringToronto, ON, CA
Remote
Full-time

Remote Chemistry Expert (LLM Evaluation) - 34879.Remote Chemistry Expert (LLM Evaluation) - 34879.Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.Turi... Show more

 • Promoted

Senior LLM Integration Engineer

CerebrasToronto, ON, CA
Full-time

Drive model integration projects as a Senior Engineer focused on AI LLMs.Engage in end-to-end processes from architecture translation to runtime optimizations and performance debugging.Be a vital m... Show more

 • Promoted

PICTON Investments Bilingual Associate Specialist

PICTON InvestmentsToronto, ON, CA
Full-time

Become a Bilingual Associate Specialist at PICTON Investments, offering key support in Dealer and Investor Services while thriving in a collaborative, entrepreneurial culture.PICTON Investments is ... Show more

 • Promoted

Bilingual Support Role in EV Charging

ChargeLab Inc.Toronto, ON, CA
Full-time

Enhance your career as a Bilingual Support Specialist at ChargeLab, focusing on EV Charging.Provide assistance to users in both English and French through various support channels.This role require... Show more

 • Promoted

Bilingual Program Advisor

EFToronto, ON, CA
Full-time

At EF Language Abroad, we believe that the world is better when people try to understand one another.Since 1965, we've helped millions of students discover new places, embrace diverse cultures, and... Show more

 • Promoted

Bilingual Client Support & Analytics Specialist

AutoTrader.caToronto, ON, CA
Temporary

A leading automotive marketplace in Toronto is looking for a Bilingual Client Support Specialist for a one-year temporary position.You'll provide essential customer support, acting as a primary con... Show more

 • Promoted

Content Evaluator (Remote)

Work VistaToronto, ON, CA
Remote
Full-time

United States, United Kingdom, Canada, Ireland, Australia & New Zealand.You must be legally authorised to work in the country where you are based).We are hiring on behalf of one of our clients, a l... Show more

 • Promoted

Bilingual Clinical Implementation Specialist - C$60,000 - C$80,000 A Year

Healthcare Technology CompanyToronto, Canada
Full-time

A healthcare technology company in Toronto is seeking a Clinical Implementation Specialist (RN/LPN) to educate healthcare teams on using innovative patient transfer technology.The role requires cli... Show more

 • Promoted

Bilingual Triage Specialist - C$55,000 - C$60,000 A Year

Europ Assistance CanadaToronto County, Canada
Full-time

Bilingual Triage Specialist to handle travel insurance claims and service requests, ensuring accurate and timely processing, client communication, and collaboration with internal teams. Show more

 • Promoted

Bilingual Grants & Research Specialist (Canada)

Breakthrough T1D Canada | Percée DT1Toronto, ON, CA
Full-time

A leading non-profit organization in Canada is seeking a National Specialist for Research & Mental Health Programs.This bilingual role involves managing grants, analyzing data, and being a liaison ... Show more

 • Promoted

Freelance Agent Evaluation Analyst

MindriftToronto, ON, CA
Permanent

Be among the first 25 applicants.This opportunity is only for candidates currently residing in the specified country.Your location may affect eligibility and rates.Please submit your resume in Engl... Show more

 • Promoted

Bilingual Technical Support Specialist Level I

Olympus CorporationRichmond Hill, York Region, CA
Full-time

As a key member of the Operations Team, the Technical Advisor provides technical product support for complaint handling, service, and repair activities.The role is responsible for supporting custom... Show more