Java Software DeveloperMercor • Montreal (administrative region), QC, CA

Java Software Developer

Mercor • Montreal (administrative region), QC, CA

2 days ago

Job type

Full-time

Part-time

Job description

About The Job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position

Conversational AI Evaluator

Type

Full-time or Part-time Contract Work

Compensation

$45–$80 / hour

Location

Remote

Commitment

20+ hours / week

Role Responsibilities

Evaluate LLM-generated responses to coding and software engineering queries for accuracy, reasoning, clarity, and completeness.
Conduct fact‑checking using trusted public sources and authoritative references.
Execute code and validate outputs using appropriate tools to ensure accuracy.
Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies.
Assess code quality, readability, algorithmic soundness, and explanation quality.
Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines.

Qualifications

Must‑Have

BS, MS, or PhD in Computer Science or a closely related field.

Significant real‑world experience in software engineering or related technical roles.

Expertise in at least one relevant programming language (e.g., Python, Java, C++, JavaScript, Go, Rust).

Ability to solve HackerRank or LeetCode Medium and Hard‑level problems independently.

Experience contributing to well‑known open‑source projects, including merged pull requests.

Significant experience using LLMs while coding and understanding their strengths and failure modes.

Strong attention to detail and comfort with evaluating complex technical reasoning, identifying subtle bugs or logical flaws.

Preferred

Prior experience with RLHF, model evaluation, or data annotation work.

Track record in competitive programming.

Experience reviewing code in production environments.

Familiarity with multiple programming paradigms or ecosystems.

Experience explaining complex technical concepts to non‑expert audiences.

Application Process (Takes 20–30 mins to complete)

Upload resume

AI interview based on your resume

Submit form

Resources & Support

For details about the interview process and platform information, please check : https : / / talent.docs.mercor.com / welcome / welcome

For any help or support, reach out to : support@mercor.com

PS : Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

#J-18808-Ljbffr

Create a job alert for this search

Java Developer • Montreal (administrative region), QC, CA

Similar jobs

Java Software Engineer

BeaconFire Inc. • saint-esprit, qc, ca

Full-time

Develop applications using Java 8 / JEE (and higher), Angular 2+, React.SQL, Spring, HTML5, CSS, JavaScript and TypeScript among other tools. Write scalable, secure, maintainable code that powers our ...Show more

Last updated: 5 days ago • Promoted

Senior Java Software Engineer

Orion Innovation • Ahuntsic North, ca

Full-time

Requires Eligibility for Secret Security Clearance.Role Overview A primary focus of this role is the definition, development, and deployment of security-focused solutions that exceed customer expec...Show more

Last updated: 1 day ago • Promoted

Java Developer - ASIC, Ottawa - On-Site

Ciena • Ahuntsic North, ca

Full-time

As the global leader in high-speed connectivity, Ciena is committed to a people-first approach.Our teams enjoy a culture focused on prioritizing a flexible work environment that empowers individual...Show more

Last updated: 1 day ago • Promoted

Senior Software Developer — Platform & API Integrations

Global Talent Alliance, Canada • Ahuntsic North, ca

Full-time

A technology consultancy is looking for a Specialist Software Developer to enhance its application solutions in Ottawa.The ideal candidate will have significant experience in IT service management ...Show more

Last updated: 1 day ago • Promoted

Sr. Software Developer

Warner Media, LLC. • Ahuntsic North, ca

Full-time

Job Summary Warner Brothers Discovery’s digital arm, Global Customer Experience organization is a high-performing global team working at the dynamic intersection of Technology and Entertainment.In ...Show more

Last updated: 1 day ago • Promoted

Senior / Lead Java Software Developer

Averian Inc. • Ahuntsic North, ca

Full-time

Averian is an AI and custom solutions company building real-world systems deployed in mission-critical, production environments. We design and deliver advanced platforms and solutions that help ente...Show more

Last updated: 1 day ago • Promoted

Software Developer

Trend Micro • Ahuntsic North, ca

Full-time

Trend Micro, a global cybersecurity leader, helps make the world safe for exchanging digital information across enterprises, governments, and consumers. Fueled by decades of security expertise, glob...Show more

Last updated: 1 day ago • Promoted

Senior Full Stack Software Developer- GOLANG / REACT

LARGIER CONSEILS • Montréal, QC, ca

Full-time +1

Quick Apply

Our client is currently seeking a.Senior Full Stack Software Engineer (Go / React).This position offers the possibility of. Our client is a pioneer in technical consulting and bespoke programming fo...Show more

Last updated: 7 days ago

Sr Software Engineer

CENTRIC SOFTWARE INC • Montréal, QC, CA

Full-time

Quick Apply

Job Title : Senior Software Engineer Location : ...Show more

Last updated: 30+ days ago

Senior Backend Software Developer

knak. • Ahuntsic North, ca

Full-time

Knak is a mission-driven company.Why? Because our time is limited, our competition is fierce, and our margin for error is small. For us to have the greatest impact on the world, we need to be laser ...Show more

Last updated: 1 day ago • Promoted

Senior Software Developer

Epiphan Video • Ahuntsic North, ca

Full-time

You will develop and maintain firmware for Epiphan Pearl professional video capture and streaming devices, including Pearl-2, Pearl Mini, Pearl Nexus, Pearl Nano, Pearl Flex, and virtualized soluti...Show more

Last updated: 1 day ago • Promoted

Intermediate Golang and Java Developer

Rollbar, Inc. • Ahuntsic North, ca

Full-time

Company Description At Sectigo, we align around our mission and pride ourselves in helping thousands of customers sleep better at night. Sectigo is a leading provider of digital identity and cyberse...Show more

Last updated: 1 day ago • Promoted

Software Developer (Backend SaaS)

Canonical • Ahuntsic North, ca

Full-time

Software Developer (Backend SaaS).Canonical is a leading provider of open source software and operating systems to the global enterprise and technology markets. Our platform, Ubuntu, is very widely ...Show more

Last updated: 1 day ago • Promoted

Java Software Engineer

iTeckSoft Inc. • saint-esprit, QC, ca

Full-time

JD : Design, implement, and maintain scalable Java applications, including RESTful APIs, batch processing jobs, and event-driven services.Collaborate with deve...Show more

Last updated: less than 1 hour ago • Promoted • New!

Senior Developer (Java, GenAI) - Iris Software Inc.

Iris Software Inc. • laval, qc, ca

Full-time

Iris Software is looking to hire a Sr.Developer (Java, GenAI) for one of our direct banking clients in downtown Toronto.Kindly let me know if you are interested and send me your resume.Location : To...Show more

Last updated: 6 hours ago • Promoted • New!

Software Developer Backend - Application

Dialogue • Montréal, Quebec, Canada, H3A 3G3

Full-time

Dialogue is the #1 virtual care provider in Canada.Integrated Health Platform🅫, we provide exceptional online health and wellness programs (primary care, mental health, iCBT, EAP, and wellness) to...Show more

Last updated: 5 days ago

Hiring Java and.Net Developers to work in USA

Cygnus Professionals Inc • Ahuntsic North, ca

Full-time

Cygnus’s vision is to become global leader in Information technology and consulting by delivering excellence to its customers. We understand that we cannot achieve it without our people.Hence, they ...Show more

Last updated: 1 day ago • Promoted

Java ASIC Developer - On-Site Ottawa | Flexible & Impactful

Ciena Corporation • Ahuntsic North, ca

Full-time

A leading technology firm in Ottawa is seeking an experienced Java Developer to create and maintain automation software for networking systems. The ideal candidate will have over 10 years of experie...Show more

Last updated: 1 day ago • Promoted