Software EngineerMercor • Montreal (administrative region), QC, CA

Software Engineer

Mercor • Montreal (administrative region), QC, CA

Il y a 2 jours

Type de contrat

Temps plein

Temps partiel

Description de poste

About The Job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position

Conversational AI Evaluator

Type

Full-time or Part-time Contract Work

Compensation

$45–$80 / hour

Location

Remote

Commitment

20+ hours / week

Role Responsibilities

Evaluate LLM-generated responses to coding and software engineering queries for accuracy, reasoning, clarity, and completeness.
Conduct fact‑checking using trusted public sources and authoritative references.
Execute code and validate outputs using appropriate tools to ensure accuracy.
Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies.
Assess code quality, readability, algorithmic soundness, and explanation quality.
Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines.

Qualifications

Must‑Have

BS, MS, or PhD in Computer Science or a closely related field.

Significant real‑world experience in software engineering or related technical roles.

Expertise in at least one relevant programming language (e.g., Python, Java, C++, JavaScript, Go, Rust).

Ability to solve HackerRank or LeetCode Medium and Hard‑level problems independently.

Experience contributing to well‑known open‑source projects, including merged pull requests.

Significant experience using LLMs while coding and understanding their strengths and failure modes.

Strong attention to detail and comfort with evaluating complex technical reasoning, identifying subtle bugs or logical flaws.

Preferred

Prior experience with RLHF, model evaluation, or data annotation work.

Track record in competitive programming.

Experience reviewing code in production environments.

Familiarity with multiple programming paradigms or ecosystems.

Experience explaining complex technical concepts to non‑expert audiences.

Application Process (Takes 20–30 mins to complete)

Upload resume

AI interview based on your resume

Submit form

Resources & Support

For details about the interview process and platform information, please check : https : / / talent.docs.mercor.com / welcome / welcome

For any help or support, reach out to : support@mercor.com

PS : Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

#J-18808-Ljbffr

Créer une alerte emploi pour cette recherche

Software Engineer • Montreal (administrative region), QC, CA

Offres similaires

Software Quality Assurance Engineer

Securitas Technology Canada • Ahuntsic North, ca

Temps plein

Overview Securitas Technology Canada is a division of Securitas AB, the largest protective services provider in the world with over 370,000+ Securitas Heroes across the world.Securitas Technology C...Voir plus

Dernière mise à jour : il y a 1 heure • Offre sponsorisée • Nouvelle offre

Software Architect - Fully Remote

Sowelo Consulting sp. z o.o. • Montreal, QC, CA

Télétravail

Permanent

Quick Apply

Do you have Architecture experience with a Microsoft tech stack?.Are you able to work autonomously and have strong communication skills? Great!. Please read on as we have a role for you.We ar...Voir plus

Dernière mise à jour : il y a plus de 30 jours

Algebra Private Tutoring Jobs L'epiphanie

Superprof • L'epiphanie, Canada

Temps plein +1

Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi...Voir plus

Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée

Sr Software Engineer

CENTRIC SOFTWARE INC • Montréal, QC, CA

Temps plein

Quick Apply

Job Title : Senior Software Engineer Location : ...Voir plus

Dernière mise à jour : il y a plus de 30 jours

Ingénieur logiciel senior - Plateforme central / Senior Software Engineer - Core Platform

Tait • Montreal, QC, Canada

Temps plein

Créer des moments qui touchent les gens.Vous conceverez et mettrez en œuvre des fonctionnalités complexes, façonnerez des normes de codage et guiderez les décisions tech...Voir plus

Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée

Remote C# Software Engineer - AI Trainer

SuperAnnotate • Saint-Lin-Laurentides, Quebec, CA

Télétravail

Temps plein

This is an hourly-paid, fully remote contractor role where you will review AI-generated responses and / or generate C# / . NET engineering content, evaluating reasoning quality and step-by-step problem-...Voir plus

Dernière mise à jour : il y a 8 jours

Hybrid Cloud & Embedded Apps Engineer

IBM • Ahuntsic North, ca

Permanent

A leading technology company in Ottawa is seeking an Intermediate Application Developer to provide technical support for applications and lead small teams. The ideal candidate will have at least 5 y...Voir plus

Dernière mise à jour : il y a 1 heure • Offre sponsorisée • Nouvelle offre

Staff Software Engineer

Valsoft Corporation • Montreal, QC, CA

Temps plein

Quick Apply

Sadie is transforming how restaurants engage with their customers using AI-powered voice technology.Our intelligent voice agent, Sadie, answers phone calls 24 / 7 to take bookings, manage reservation...Voir plus

Dernière mise à jour : il y a 4 jours

Senior Software Engineer & Project Lead

University of Ottawa • Ahuntsic North, ca

Temps plein

A leading educational institution in Ontario is seeking a skilled IT Application Developer to analyze user requirements and develop software applications. The ideal candidate should have a degree in...Voir plus

Dernière mise à jour : il y a 1 heure • Offre sponsorisée • Nouvelle offre

Senior Software Engineer - Robotics

Vention • Montreal, QC, Canada

Temps plein

Headquartered in Montreal and Berlin, Vention helps manufacturers automate their operations in record time with the only hardware and software AI-powered platform built for the factory floor.Our te...Voir plus

Dernière mise à jour : il y a 7 jours • Offre sponsorisée

Staff / Principal Engineer

SourceIn • Montreal, QC, Canada

Temps plein

Staff / Principal Software Engineer (Fully Remote – Canada, EST Hours).Are you a seasoned engineer ready to design and lead technical excellence across teams? We're hiring a.Staff / Princ...Voir plus

Dernière mise à jour : il y a 24 jours • Offre sponsorisée

Software Developer – API

Amilia • Greater Montreal Area, QC, CA

Temps plein

Amilia is transforming the recreation and activities market with its innovative, purpose-built SaaS platform.Designed for municipalities, community centers, nonprofits, businesses, and recreation o...Voir plus

Dernière mise à jour : il y a plus de 30 jours

Software Developer

Forensics Source • Ahuntsic North, ca

Temps plein

Job Description Posted Monday, January 19, 2026 at 5 : 00 AM.Job Purpose As a member of the ICOR R&D team, you will play a pivotal role in designing, developing, and maintaining internal tools and ro...Voir plus

Dernière mise à jour : il y a 1 heure • Offre sponsorisée • Nouvelle offre

Senior Software Testing Engineer

Bartech Staffing • Ahuntsic North, ca

Temps plein

Bartech Staffing is a leading engineering, technical and professional staffing firm, and our clients include some of the nation's biggest companies. We are powered by Impellam Group, a connected gro...Voir plus

Dernière mise à jour : il y a 1 heure • Offre sponsorisée • Nouvelle offre

Senior Embedded Systems Engineer

Citylogix Inc • Montréal, Quebec, Canada, H2W 1B6

Temps plein

Citylogix builds mobile mapping and infrastructure intelligence systems for cities and public agencies.Our platforms combine vehicle-mounted sensor systems, embedded software, and AI-driven analyti...Voir plus

Dernière mise à jour : il y a 10 jours

Senior Backend Engineer

Meroka Inc. • Montréal, Quebec, Canada, H4A 2H4

Temps plein

Meroka is building the future of independent medicine in the United States.We provide operations, finance, tech, and strategic support to physician-owned practices-helping them grow sustainably and...Voir plus

Dernière mise à jour : il y a 5 heures • Nouvelle offre