Mercor connects elite creative and technical talent with leading AI research labs.Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larr...Show moreLast updated: 15 days ago
Sales Development Representative
PlannedMontreal (administrative region), QC, CA
Full-time
Planned is an event management platform that helps companies streamline their meetings & events booking process.We make it easy for anyone to plan successful events while giving finance teams the v...Show moreLast updated: 15 days ago
Senior Director, Development
Thor CompaniesMontreal, QC, Canada
Full-time
My client is looking to hire Senior Director, Development.This role will see you execute the comprehensive development lifecycle for large-scale data center infrastructure campuses.This executive r...Show moreLast updated: 21 days ago
Business Development Manager
Amaris ConsultingMontreal, QC, Canada
Full-time
Montréal, vous jouerez un rôle clé dans la construction et le développement de l’avenir d’Amaris Consulting en créant et en faisant évoluer votre propre Business Unit au sein du domaine IS & Digita...Show moreLast updated: 1 day ago
Director, Business development
Avatek Technologies Inc.Montreal (administrative region), QC, CA
Full-time
French version bellow English version).Point-Of-Use automation service in healthcare, combining smart hardware, intuitive software, and expert support.
Hospitals are busy, high-stakes environments w...Show moreLast updated: 8 days ago
Business Development Representative
Evolving WebMontreal, QC, CA
Remote
Full-time +1
Quick Apply
We’re a digital agency of 100+ strategists, designers, and developers creating impactful websites, platforms, and design systems.
Committed to open source, we blend innovative tech with user-centere...Show moreLast updated: 30+ days ago
Business Development Representative
GRAITEC GmbHMontreal, Montreal (administrative region), CA
Full-time
Fondée en 1986, Graitec est un leader mondial dans le domaine du Building Information Modeling (BIM), aidant ses clients dans les secteurs de l'architecture, de l'ingénierie, de la construction et ...Show moreLast updated: 30+ days ago
Business Development Representative
DiliTrustMontreal, Montreal (administrative region), CA
Full-time
Business Development Representative.ReadytobepartoftheLegalTechrevolution?.As a leading software-as-a-service (SaaS) provider, Dilitrust is a global company dedicated to offering an integrated suit...Show moreLast updated: 30+ days ago
Business Development Representative
DiagramMontreal, Montreal (administrative region), CA
Full-time
Business Development Representative.This is a salaried, quota-carrying role with a tiered commission structure.Reporting to the Manager of Business Development, the SDR will be responsible for exec...Show moreLast updated: 30+ days ago
Promoted
IT Development Lead
Belron Canada Inc.Montreal, Canada
Full-time
Automotive glass technology is helping transform how we experience the road.Speedy Glass, Lebeau vitres d’auto.We welcome applications from everyone, and are firmly committed to diversity, equity a...Show moreLast updated: 4 days ago
Business Development Associate
Marcus Evans GroupMontreal, Montreal (administrative region), CA
Full-time
Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.Marcus Evans, founded in 1983, is a global business intelligence and event marketing company with 49 o...Show moreLast updated: 30+ days ago
Development Coordinator
CineflixMontreal, Montreal (administrative region), CA
Full-time
C3 Media s’est forgé une réputation en collaborant avec des partenaires créatifs talentueux du monde entier pour raconter des histoires percutantes.
Alliant une solide expérience créative à un état ...Show moreLast updated: 30+ days ago
Business Development Associate
PICTON InvestmentsMontreal, Montreal (administrative region), CA
Full-time
Picton Mahoney Asset Management (PICTON Investments).Founded by industry pioneer David Picton, we’ve spent 20 years challenging conventional wisdom and redefining the investing landscape.As one of ...Show moreLast updated: 30+ days ago
Sales Development Representative
BilldrMontreal (administrative region), QC, CA
Full-time
Build the future of construction with us.Billdr is built for one of the largest and least digitized industries on Earth : construction.
Our software powers small-to-mid-sized general contractors (GCs...Show moreLast updated: 13 days ago
Promoted
Director, Business Development
ThalesAhuntsic North, ca
Full-time
Director, Business Development at Thales Canada – a hybrid role based in Ottawa.The Director will lead growth in naval, maritime and digital defense domains, positioning Thales as the partner of ch...Show moreLast updated: 18 days ago
Product Development Engineer
MAAX BATHMontreal (administrative region), QC, CA
Full-time
MAAX, a division of the American Bath Group, is a leading manufacturer in the bathware industry.Our team is dedicated to excellence and embraces cutting-edge technologies to provide our clients wit...Show moreLast updated: 9 days ago
Representative, Business development
VoskerMontreal, QC, Canada
Full-time
North American leader in remote area surveillance.Every day, we’re proud to help our customers keep an eye on what truly matters to them by developing solar-powered, cellular-connected camera...Show moreLast updated: 24 days ago
Manager, Capacity Development
First Nations Financial Management BoardMontreal, Quebec, Canada
Full-time
Who We AreJoin us at the First Nations Financial Management Board (FMB) where we support First Nations to strengthen their governance and financial practices.
Since our establishment in 2006 under t...Show moreLast updated: 1 day ago
New!
Sales Development Representative
IvaluaMontreal (administrative region), QC, CA
Full-time
Chez Ivalua, nous sommes une communauté mondiale d'experts convaincus que la transformation numérique rend les chaînes d'approvisionnement plus durables et résilientes, tout en améliorant la collab...Show moreLast updated: 8 hours ago
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position
Conversational AI Evaluator
Type
Full-time or Part-time Contract Work
Compensation
$45–$80 / hour
Location
Remote
Commitment
20+ hours / week
Role Responsibilities
Evaluate LLM-generated responses to coding and software engineering queries for accuracy, reasoning, clarity, and completeness.
Conduct fact‑checking using trusted public sources and authoritative references.
Execute code and validate outputs using appropriate tools to ensure accuracy.
Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies.
Assess code quality, readability, algorithmic soundness, and explanation quality.
Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines.
Qualifications
Must‑Have
BS, MS, or PhD in Computer Science or a closely related field.
Significant real‑world experience in software engineering or related technical roles.
Expertise in at least one relevant programming language (e.g., Python, Java, C++, JavaScript, Go, Rust).
Ability to solve HackerRank or LeetCode Medium and Hard‑level problems independently.
Experience contributing to well‑known open‑source projects, including merged pull requests.
Significant experience using LLMs while coding and understanding their strengths and failure modes.
Strong attention to detail and comfort with evaluating complex technical reasoning, identifying subtle bugs or logical flaws.
Preferred
Prior experience with RLHF, model evaluation, or data annotation work.
Track record in competitive programming.
Experience reviewing code in production environments.
Familiarity with multiple programming paradigms or ecosystems.
Experience explaining complex technical concepts to non‑expert audiences.
Application Process (Takes 20–30 mins to complete)
Upload resume
AI interview based on your resume
Submit form
Resources & Support
For details about the interview process and platform information, please check : https : / / talent.docs.mercor.com / welcome / welcome
For any help or support, reach out to : support@mercor.com
PS : Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.