Mercor connects elite creative and technical talent with leading AI research labs.Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larr...Show moreLast updated: 19 days ago
JAVA Software Developer Montreal, Canada
AppDirect, IncMontreal (administrative region), QC, CA
Full-time
Pour la version française de cette description de poste, veuillez consulter le lien suivant / For the French version of this job description, please refer to the following link : .JAVA Développeur / Dé...Show moreLast updated: 18 days ago
Java Developer
SynechronMontreal, Montreal (administrative region), CA
Full-time
This range is provided by Synechron.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
Direct message the job poster from Synechron.Synechron is a ...Show moreLast updated: 30+ days ago
Java Developer
Axiom Global TechnologiesMontreal, QC, Canada
Temporary
We are seeking a highly experienced.This role is ideal for a hands-on technologist with deep expertise across the Java ecosystem and proven experience building.
Experience in the banking or financia...Show moreLast updated: 8 days ago
Java Developer
GenpactMontreal, Montreal (administrative region), CA
Full-time
Genpact is seeking a Senior Talent Acquisition Specialist specializing in IT recruitment.Design and implement the messaging middleware and tooling.
Identify and implement optimizations / efficiencies ...Show moreLast updated: 30+ days ago
OPAL-RT TECHNOLOGIES Inc.Montreal (administrative region), QC, CA
Full-time
OPAL-RT Technologies recherche un Développeur Logiciel Java / MATLAB (Mode de travail hybride).À propos d’OPAL-RT Technologies : .
Imaginez travailler pour une entreprise qui compte parmi ses clients...Show moreLast updated: 2 days ago
Java Developer
CapgeminiMontreal, QC, CA
Full-time
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues...Show moreLast updated: 6 days ago
Java Developer
MDA EdgeMontreal, Montreal (administrative region), CA
Full-time
Be among the first 25 applicants.This range is provided by MDA Edge.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
We are looking for a Core Ja...Show moreLast updated: 30+ days ago
Java Developer – Software Engineering (Hybrid)
PowerToFlyMontreal (administrative region), QC, CA
Full-time
We're seeking someone to join our Risk and Information Management team as a Java Developer in Non-Financial Risk Technology to Lead the design and implementation of complex Java systems, mentor jun...Show moreLast updated: 30+ days ago
OPAL-RT Technologies recherche un Dveloppeur Logiciel Java / MATLAB (Mode de travail hybride).Imaginez travailler pour une entreprise qui compte parmi ses clients la NASA, Bombardier, ABB, EMBRAER,...Show moreLast updated: 3 days ago
New!
Software Developer (Java / Vue.js)
RBCMontreal (administrative region), QC, CA
Full-time
We are looking for a top-notch, driven, Associate Fullstack Developer who is a great team player and passionate about the quality of their code.
As an Associate Fullstack Developer, you will be cont...Show moreLast updated: 10 hours ago
New!
Software Developer (Java / MATLAB) - Hybrid
OPAL-RT TECHNOLOGIESMontreal (administrative region), QC, CA
Full-time
Une société de simulation avancée à Montréal recherche un Développeur Logiciel Java / MATLAB.Le candidat travaillera dans un environnement Agile sur des projets innovants pour des clients prestigie...Show moreLast updated: 10 hours ago
Java Developer – Software Engineering (Hybrid)
Morgan StanleyMontreal, Montreal (administrative region), CA
Full-time
Java Developer – Software Engineering (Hybrid).Java Developer – Software Engineering (Hybrid).We’re seeking someone to join our Risk and Information Management team as a Java Developer in Non‑Finan...Show moreLast updated: 30+ days ago
Software Developer (Java)
Noramtec ConsultantsMontreal, Quebec
Full-time
Experience with Java, J2EE, JSF, Hibernate, Oracle DB and MySQL.Oracle SQL Developer and optimizing query performance.Eclipse, RAD, RUP, UML, and ER Diagrams.
Years experience in developing applicat...Show moreLast updated: 30+ days ago
Lead Software Developer (Python / Java)
ToparoMontreal, Montreal (administrative region), CA
Full-time
One of our clients is looking for a Senior Software Engineer who will help transform the logistics industry.This isn’t just a job – it’s a lifestyle.
They want you to be passionate about your work a...Show moreLast updated: 30+ days ago
JAVA Software Developer
AppDirectMontreal, Quebec, Canada
Full-time
Pour la version française de cette description de poste veuillez consulter le lien suivant / For the French version of this job description please refer to the following link : .JAVA Développeur / Déve...Show moreLast updated: 26 days ago
Java Developer
AkkodisMontreal (administrative region), QC, CA
Full-time
Mission contractuelle de 12 mois.Engagement de services professionnels – B2B (entités incorporées uniquement).Notre client recherche un Développeur Java expérimenté pour soutenir les initiatives te...Show moreLast updated: 5 days ago
JAVA Software Developer
FirstbaseMontreal (administrative region), QC, CA
Full-time
Pour la version française de cette description de poste, veuillez consulter le lien suivant / For the French version of this job description, please refer to the following link : .JAVA Développeur / Dé...Show moreLast updated: 26 days ago
Java Developer
Cynet systems IncMontreal (administrative region), QC, CA
Full-time
Strong hands-on experience with Core Java (Java 8 preferred).Experience with Spring and Spring Boot.Experience building RESTful microservices.
Experience with Kafka integration and message streaming...Show moreLast updated: 2 days ago
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position
Conversational AI Evaluator
Type
Full-time or Part-time Contract Work
Compensation
$45–$80 / hour
Location
Remote
Commitment
20+ hours / week
Role Responsibilities
Evaluate LLM-generated responses to coding and software engineering queries for accuracy, reasoning, clarity, and completeness.
Conduct fact‑checking using trusted public sources and authoritative references.
Execute code and validate outputs using appropriate tools to ensure accuracy.
Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies.
Assess code quality, readability, algorithmic soundness, and explanation quality.
Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines.
Qualifications
Must‑Have
BS, MS, or PhD in Computer Science or a closely related field.
Significant real‑world experience in software engineering or related technical roles.
Expertise in at least one relevant programming language (e.g., Python, Java, C++, JavaScript, Go, Rust).
Ability to solve HackerRank or LeetCode Medium and Hard‑level problems independently.
Experience contributing to well‑known open‑source projects, including merged pull requests.
Significant experience using LLMs while coding and understanding their strengths and failure modes.
Strong attention to detail and comfort with evaluating complex technical reasoning, identifying subtle bugs or logical flaws.
Preferred
Prior experience with RLHF, model evaluation, or data annotation work.
Track record in competitive programming.
Experience reviewing code in production environments.
Familiarity with multiple programming paradigms or ecosystems.
Experience explaining complex technical concepts to non‑expert audiences.
Application Process (Takes 20–30 mins to complete)
Upload resume
AI interview based on your resume
Submit form
Resources & Support
For details about the interview process and platform information, please check : https : / / talent.docs.mercor.com / welcome / welcome
For any help or support, reach out to : support@mercor.com
PS : Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.