Java Software EngineerMercor • Montreal (administrative region), QC, CA

Java Software Engineer

Mercor • Montreal (administrative region), QC, CA

Il y a 6 jours

Type de contrat

Temps plein

Temps partiel

Description de poste

About The Job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position

Conversational AI Evaluator

Type

Full-time or Part-time Contract Work

Compensation

$45–$80 / hour

Location

Remote

Commitment

20+ hours / week

Role Responsibilities

Evaluate LLM-generated responses to coding and software engineering queries for accuracy, reasoning, clarity, and completeness.
Conduct fact‑checking using trusted public sources and authoritative references.
Execute code and validate outputs using appropriate tools to ensure accuracy.
Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies.
Assess code quality, readability, algorithmic soundness, and explanation quality.
Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines.

Qualifications

Must‑Have

BS, MS, or PhD in Computer Science or a closely related field.

Significant real‑world experience in software engineering or related technical roles.

Expertise in at least one relevant programming language (e.g., Python, Java, C++, JavaScript, Go, Rust).

Ability to solve HackerRank or LeetCode Medium and Hard‑level problems independently.

Experience contributing to well‑known open‑source projects, including merged pull requests.

Significant experience using LLMs while coding and understanding their strengths and failure modes.

Strong attention to detail and comfort with evaluating complex technical reasoning, identifying subtle bugs or logical flaws.

Preferred

Prior experience with RLHF, model evaluation, or data annotation work.

Track record in competitive programming.

Experience reviewing code in production environments.

Familiarity with multiple programming paradigms or ecosystems.

Experience explaining complex technical concepts to non‑expert audiences.

Application Process (Takes 20–30 mins to complete)

Upload resume

AI interview based on your resume

Submit form

Resources & Support

For details about the interview process and platform information, please check : https : / / talent.docs.mercor.com / welcome / welcome

For any help or support, reach out to : support@mercor.com

PS : Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

#J-18808-Ljbffr

Créer une alerte emploi pour cette recherche

Java Software Engineer • Montreal (administrative region), QC, CA

Offres similaires

Software Quality Assurance Engineer

Securitas Technology Canada • Ahuntsic North, ca

Temps plein

Overview Securitas Technology Canada is a division of Securitas AB, the largest protective services provider in the world with over 370,000+ Securitas Heroes across the world.Securitas Technology C...Voir plus

Dernière mise à jour : il y a 2 heures • Offre sponsorisée • Nouvelle offre

Senior Backend Engineer / Développeur Logiciel Backend

Reliant AI • Montreal, QC, CA

Temps plein

Quick Apply

We are looking for two exceptionally talented backend engineers to join our team in Montreal and Berlin.You will play a pivotal role in driving the development and delivery of our technology by mul...Voir plus

Dernière mise à jour : il y a plus de 30 jours

Développeur(euse) de logiciel | Software Developer

Delmar International Inc. • Lachine, QC, Canada

Temps plein

Relevant du Gestionnaire du développement logiciel, le / la Développeur(euse) Logiciel joue un rôle clé dans la création des plateformes et des outils qui soutiennen...Voir plus

Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée

Optical Engineer (On site - Montreal, Canada)

Astronics • Dorval, QC, Canada

Temps plein

Astronics - Luminescent Systems Canada Inc.Reporting to the Director of Engineering, the incumbent will be responsible for optical design, inspection test design, automation software tools.He will ...Voir plus

Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée

Ingénieur logiciel Java / Ingénieure logiciel Java

freelance.ca • Montreal, Canada

Temps plein

Notre processus de recrutement est entièrement transparent.Si le rôle qu’on a aujourd’hui n'est pas le bon pour toi, trouvons-en un qui le soit! Travaillons ensemble pour s’assurer que tu rejoignes...Voir plus

Dernière mise à jour : il y a 8 jours • Offre sponsorisée

Java Developer

Targeted Talent • Montreal, QC, Canada

Permanent

We are looking for an experienced.Our client is a global enterprise company with a product that you've likely used.Unfortunately we are only able to consider candidates who either live in Canad...Voir plus

Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée

Senior Java Developer (AI applications) [#4898]

Alteo • Montreal, QC, Canada

Permanent

Alteo is looking for a Senior Java Developer (AI Applications) for a permanent position based in Montreal.Maintain and implement new features in a search engine. Development and maintenance of the u...Voir plus

Dernière mise à jour : il y a 15 jours • Offre sponsorisée

Sr Software Engineer

CENTRIC SOFTWARE INC • Montréal, QC, CA

Temps plein

Quick Apply

Job Title : Senior Software Engineer Location : ...Voir plus

Dernière mise à jour : il y a plus de 30 jours

Solution Engineer

Botpress Technologies Inc. • Montreal, QC, Canada

Temps plein

Help bring AI agents to companies worldwide.Over the next decade, autonomous agents will redefine how we work.Botpress allows companies to build and deploy advanced AI agents that move beyond conve...Voir plus

Dernière mise à jour : il y a 8 jours • Offre sponsorisée

Algebra Private Tutoring Jobs Lanaudi

Superprof • Lanaudi, Canada

Temps plein +1

Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi...Voir plus

Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée

Ingénieur logiciel senior - Plateforme central / Senior Software Engineer - Core Platform

Tait • Montreal, QC, Canada

Temps plein

Créer des moments qui touchent les gens.Vous conceverez et mettrez en œuvre des fonctionnalités complexes, façonnerez des normes de codage et guiderez les décisions tech...Voir plus

Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée

Staff Software Engineer

Valsoft Corporation • Montreal, QC, CA

Temps plein

Quick Apply

Sadie is transforming how restaurants engage with their customers using AI-powered voice technology.Our intelligent voice agent, Sadie, answers phone calls 24 / 7 to take bookings, manage reservation...Voir plus

Dernière mise à jour : il y a 4 jours

Shop, Deliver, Earn Cash - Instacart

Instacart Shoppers • Rawdon, QC, CA

Temps partiel +1

Start earning money fast and be your own boss.Instacart is a leading retail enablement platform that works with grocers and retailers to transform how people shop. Instacart’s platform helps people ...Voir plus

Dernière mise à jour : il y a 12 jours • Offre sponsorisée

Wrapper

IGA extra Les Marchés Candiac • Candiac, QC, Canada

Temps plein

Number of hours per week : between 40 and 40.We offer employees competitive total compensation packages that vary by position and location. Some websites that display our job openings may provide sa...Voir plus

Dernière mise à jour : il y a 1 jour • Offre sponsorisée

Senior Software Engineer - Robotics

Vention • Montreal, QC, Canada

Temps plein

Headquartered in Montreal and Berlin, Vention helps manufacturers automate their operations in record time with the only hardware and software AI-powered platform built for the factory floor.Our te...Voir plus

Dernière mise à jour : il y a 7 jours • Offre sponsorisée

Senior Backend Engineer

Meroka Inc. • Montréal, Quebec, Canada, H4A 2H4

Temps plein

Meroka is building the future of independent medicine in the United States.We provide operations, finance, tech, and strategic support to physician-owned practices-helping them grow sustainably and...Voir plus

Dernière mise à jour : il y a 6 heures • Nouvelle offre

Bilingual Customer Service Position-$21 / hr (Trucking company)

Protrans • Dorval, QC, Canada

Temps plein

Protrans Personnel Services is hiring for a Bilingual Customer Service Representative for a leading Transportation Company in Montreal (Quebec). Location : Dorval (Near Montreal Airport).Pay Rate : $2...Voir plus

Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée

Lead Software Engineer – Fleet Management

SafelyYou • Montreal, CA

Télétravail

Temps plein

Quick Apply

SafelyYou is working to ensure the highest-quality care for seniors in any care setting, anywhere in the world, driven by proven AI, unmatched clinical expertise, and an immeasurable passion for ca...Voir plus

Dernière mise à jour : il y a 1 jour