Software Development EngineerMercor • Montreal (administrative region), QC, CA

Software Development Engineer

Mercor • Montreal (administrative region), QC, CA

Il y a 2 jours

Type de contrat

Temps plein

Temps partiel

Description de poste

About The Job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position

Conversational AI Evaluator

Type

Full-time or Part-time Contract Work

Compensation

$45–$80 / hour

Location

Remote

Commitment

20+ hours / week

Role Responsibilities

Evaluate LLM-generated responses to coding and software engineering queries for accuracy, reasoning, clarity, and completeness.
Conduct fact‑checking using trusted public sources and authoritative references.
Execute code and validate outputs using appropriate tools to ensure accuracy.
Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies.
Assess code quality, readability, algorithmic soundness, and explanation quality.
Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines.

Qualifications

Must‑Have

BS, MS, or PhD in Computer Science or a closely related field.

Significant real‑world experience in software engineering or related technical roles.

Expertise in at least one relevant programming language (e.g., Python, Java, C++, JavaScript, Go, Rust).

Ability to solve HackerRank or LeetCode Medium and Hard‑level problems independently.

Experience contributing to well‑known open‑source projects, including merged pull requests.

Significant experience using LLMs while coding and understanding their strengths and failure modes.

Strong attention to detail and comfort with evaluating complex technical reasoning, identifying subtle bugs or logical flaws.

Preferred

Prior experience with RLHF, model evaluation, or data annotation work.

Track record in competitive programming.

Experience reviewing code in production environments.

Familiarity with multiple programming paradigms or ecosystems.

Experience explaining complex technical concepts to non‑expert audiences.

Application Process (Takes 20–30 mins to complete)

Upload resume

AI interview based on your resume

Submit form

Resources & Support

For details about the interview process and platform information, please check : https : / / talent.docs.mercor.com / welcome / welcome

For any help or support, reach out to : support@mercor.com

PS : Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

#J-18808-Ljbffr

Créer une alerte emploi pour cette recherche

Software Development Engineer • Montreal (administrative region), QC, CA

Offres similaires

Associate Software Developer

Acumatica • Montreal, QC, Canada

Temps plein

Acumatica is a company on a mission.We are a leading innovator in cloud ERP (Enterprise Resource Planning) solutions with growing businesses worldwide. But don’t take our word for it—rea...Voir plus

Dernière mise à jour : il y a 3 jours • Offre sponsorisée

Senior Backend Engineer / Développeur Logiciel Backend

Reliant AI • Montreal, QC, CA

Temps plein

Quick Apply

We are looking for two exceptionally talented backend engineers to join our team in Montreal and Berlin.You will play a pivotal role in driving the development and delivery of our technology by mul...Voir plus

Dernière mise à jour : il y a plus de 30 jours

Team Leader, Software Development

Croesus • Laval, Canada

Temps plein

Quick Apply

Croesus provides innovative, high-performance, and secure wealth management solutions that include portfolio management systems, portfolio rebalancing tools, and application programming interfaces ...Voir plus

Dernière mise à jour : il y a plus de 30 jours

Développeur(euse) de logiciel | Software Developer

Delmar International Inc. • Lachine, QC, Canada

Temps plein

Relevant du Gestionnaire du développement logiciel, le / la Développeur(euse) Logiciel joue un rôle clé dans la création des plateformes et des outils qui soutiennen...Voir plus

Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée

Optical Engineer (On site - Montreal, Canada)

Astronics • Dorval, QC, Canada

Temps plein

Astronics - Luminescent Systems Canada Inc.Reporting to the Director of Engineering, the incumbent will be responsible for optical design, inspection test design, automation software tools.He will ...Voir plus

Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée

Ingénieur qualité

Industries Mailhot • Saint-Jacques, CA

Temps plein

Joignez-vous à une entreprise manufacturière solidement établie, intégrée à une division mondiale en pleine croissance.Industries Mailhot, chef de file dans la fabrication de vérins hydrauliques, f...Voir plus

Dernière mise à jour : il y a 4 jours • Offre sponsorisée

Sr Software Engineer

CENTRIC SOFTWARE INC • Montréal, QC, CA

Temps plein

Quick Apply

Job Title : Senior Software Engineer Location : ...Voir plus

Dernière mise à jour : il y a plus de 30 jours

Ingénieur logiciel senior - Plateforme central / Senior Software Engineer - Core Platform

Tait • Montreal, QC, CA

Temps plein

Créer des moments qui touchent les gens.Vous conceverez et mettrez en œuvre des fonctionnalités complexes, façonnerez des normes de codage et guiderez les décisions techniques au sein de votre équi...Voir plus

Dernière mise à jour : il y a plus de 30 jours

Algebra Private Tutoring Jobs Lanaudi

Superprof • Lanaudi, Canada

Temps plein +1

Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi...Voir plus

Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée

Staff Software Engineer

Valsoft Corporation • Montreal, QC, CA

Temps plein

Quick Apply

Sadie is transforming how restaurants engage with their customers using AI-powered voice technology.Our intelligent voice agent, Sadie, answers phone calls 24 / 7 to take bookings, manage reservation...Voir plus

Dernière mise à jour : il y a 6 jours

Senior Software Engineer - Robotics

Vention • Montreal, QC, Canada

Temps plein

Headquartered in Montreal and Berlin, Vention helps manufacturers automate their operations in record time with the only hardware and software AI-powered platform built for the factory floor.Our te...Voir plus

Dernière mise à jour : il y a 9 jours • Offre sponsorisée

Staff / Principal Engineer

SourceIn • Montreal, QC, Canada

Temps plein

Staff / Principal Software Engineer (Fully Remote – Canada, EST Hours).Are you a seasoned engineer ready to design and lead technical excellence across teams? We're hiring a.Staff / Princ...Voir plus

Dernière mise à jour : il y a 25 jours • Offre sponsorisée

Software Developer – API

Amilia • Greater Montreal Area, QC, CA

Temps plein

Amilia is transforming the recreation and activities market with its innovative, purpose-built SaaS platform.Designed for municipalities, community centers, nonprofits, businesses, and recreation o...Voir plus

Dernière mise à jour : il y a plus de 30 jours

Aircraft Maintenance Engineer M2

GAL AeroStaff • Pointe-Claire, QC, Canada

Temps plein

Canadian aerospace company specializing in delivering high-quality technical and operational services to the aviation industry. Our expertise includes aircraft interior, structural, manufacturing, a...Voir plus

Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée

Method Agent

Anodizing & Paint TNM inc. • Pointe-Claire, Canada

Temps plein

We are looking for a motivated professional to join our team.The successful candidate will actively participate in production planning, coordination, and methods follow-up, ensuring compliance with...Voir plus

Dernière mise à jour : il y a 3 jours • Offre sponsorisée

Fullstack Software Engineer (TypeScript, React, Node.js) -

Inner Circle Agency Inc. • Montreal, QC, Canada

Temps plein

Fullstack Software Engineer (TypeScript, React, Node.Web3 / Crypto ProductsAbout the OpportunityInner Circle Agency is working with very well-known, established companies in the Solana ecosystem th...Voir plus

Dernière mise à jour : il y a 1 jour • Offre sponsorisée

Software Engineer - Integration

Targeted Talent • Montreal, QC, Canada

Permanent

We are looking for an intermediate software engineer for our client to work on the integration of their product with other products. This is a permanent position that is remote to start (during Covi...Voir plus

Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée

???? Senior Software Engineer, AI Game Creation Platform

Ironbelly Studios • Montreal, QC, Canada

Temps plein

At Ironbelly, we are fundamentally changing how video games are made.Our AI team, led by industry luminaries and veterans, is building. We are the creators of a battle-tested gameplay framework that...Voir plus

Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée