Software DeveloperMercor • Montreal (administrative region), QC, CA
Software Developer
Mercor • Montreal (administrative region), QC, CA
1 day ago
Job type
- Full-time
Job descriptionBS, MS, or PhD in Computer Science or a closely related field 5+ years of real‑world experience in software engineering or related technical roles Expertise in at least two relevant programming languages (e.g., Python, Java, C++, C, JavaScript, Go, Rust, Ruby, SQL, Powershell, Bash, Swift, Kotlin, R, TypeScript, HTML / CSS) Ability to solve HackerRank or LeetCode Medium and Hard‑level problems independently Experience contributing to well‑known open‑source projects, including merged pull requests Significant experience using LLMs while coding and understanding their strengths and failure modes Strong attention to detail and comfort evaluating complex technical reasoning, identifying subtle bugs or logical flaws Prior experience with RLHF, model evaluation, or data annotation work Track record in competitive programming Experience reviewing code in production environments Familiarity with multiple programming paradigms or ecosystems Experience explaining complex technical concepts to non‑expert audiences Upload resume AI interview based on your resume Submit form For details about the interview process and platform information, please check : https : / / talent.docs.mercor.com / welcome / welcome For any help or support, reach out to : support@mercor.com
About The Job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position : AI Model Evaluator
Type : Full‑time or Part‑time Contract Work
Compensation : $60–$100 / hour
Location : Remote
Role Responsibilities
- Evaluate LLM-generated responses to coding and software engineering queries for accuracy, reasoning, clarity, and completeness.
- Conduct fact‑checking using trusted public sources and authoritative references.
- Execute code and validate outputs using appropriate tools to conduct accuracy testing.
- Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies.
- Assess code quality, readability, algorithmic soundness, and explanation quality.
- Ensure model responses align with expected conversational behavior and system guidelines.
- Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines.
Qualifications
Must‑Have
Preferred
Application Process (Takes 20–30 mins to complete)
Resources & Support
PS : Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#J-18808-Ljbffr
Create a job alert for this search
Software Developer • Montreal (administrative region), QC, CA
Similar jobs
Staff Software Developer page is loaded## Staff Software Developerlocations : Canada, Quebec, Montrealtime type : Temps completposted on : Publié aujourd'huijob requisition id : JR108990Company...Show more
Iconic Art AI is transforming the $65B global art market through AI-powered valuation technology.We’re building the platform that turns a 21-day, $800 appraisal into a data-driven, instant experien...Show more
Aviron is building the next generation of applied AI for finance operations.Mid-market companies today run on “Frankenstein” stacks of ERPs, spreadsheets, and disconnected tools that don’t talk to ...Show more
Vous définirez l’architecture technique, garantirez la scalabilité et la performance des applications, et agirez comme référent technique auprès des équipes de développement.Vos responsabilités inc...Show more
The Applied AI Software Engineer will be responsible for the rapid technical design and delivery of AI agents and frameworks built on top of SIMPRO FSMs.
Working closely with the AI Platform Product...Show more
Your role is hands-on and impactful : you will automate API delivery, strengthen API governance, and build the tooling that allows teams to publish secure, well-designed APIs at scale.This role is i...Show more
This is an hourly-paid, fully remote contractor role where you will review AI-generated responses and / or generate C# / .
NET engineering content, evaluating reasoning quality and step-by-step problem-...Show more
Sadie is transforming how restaurants engage with their customers using AI-powered voice technology.Our intelligent voice agent, Sadie, answers phone calls 24 / 7 to take bookings, manage reservation...Show more%20Ltd.)
This is a full-time, remote opportunity.Must be located in Montreal, Quebec.TSD Mobility Solutions, an affiliate of Reynolds and Reynolds is looking a Software Developer for our subsidiary Fleetlan...Show more
A technology consulting firm is seeking a professional to develop distributed applications using Spark, preferably with Scala.
Candidates should have 4 to 8 years of experience and strong problem-so...Show more
A leading consultancy in technology is seeking a Java Developer to enhance Market Risk applications in Montreal.The role involves collaboration within an Agile squad and emphasizes strong expertise...Show more
Provide development and technical support for JD Edwards World in a legacy environment.Develop and maintain JDE World applications.
Support and enhance existing custom programs.Debug and resolve pro...Show more
Design, develop, and maintain applications using.Collaborate with UI / UX, QA, and backend teams to deliver end-to-end solutions.
Write clean, maintainable, and well-documented code.Perform code revie...Show more
Développeur(e) logiciel principal / Sr Software Engineer.Equifax est à la recherche d’un développeur(e) de logiciels créatifs, dynamique et motivé(e) qui possède des compétences pratiques en dévelo...Show more%20Limited)
A manufacturing company in Essex County, Canada, is seeking a Software Developer to join their team.This entry-level, on-site role focuses on developing and maintaining customer-facing systems and ...Show more
Sr Software Dev C++ page is loaded## Sr Software Dev C++locations : Montreal (Mansfield)time type : Full timeposted on : Posted Todayjob requisition id : R8487The driving force behind our succe...Show more
Junior Software Developer (3 positions).NAV CANADA is seeking a self-motivated and detail-oriented Junior Software Developer to join our software development team.
This entry-level position is ideal...Show more
A leading SaaS company is seeking a Software Developer to join their dynamic team in Montreal.The role involves collaborating with cross-functional teams to develop scalable software solutions and ...Show more
Développeur(se) logiciel Staff
Intelcom Express Inc. • Montreal
Full-time
Last updated: 7 days ago • Promoted
Software Lead
Iconic Art • Montreal
Full-time
Last updated: 5 days ago • Promoted
Staff Software Engineer Montreal, Canada
Aviron • Montreal
Full-time
Last updated: 8 days ago • Promoted
Software Architect C#
AMARIS GROUP SA • Montreal
Full-time
Last updated: 8 days ago • Promoted
Applied AI Software Engineer - Simpro Software
Simpro Software • montréal, qc, ca
Full-time
Last updated: 10 days ago • Promoted
Middleware & API Developer
Highspring • Montreal
Full-time
Last updated: 8 days ago • Promoted
Remote C# Software Engineer - AI Trainer
SuperAnnotate • Saint-Lin-Laurentides, Quebec, CA
Remote
Full-time
Last updated: 21 days ago
Staff Software Engineer
Valsoft Corporation • Montreal, QC, CA
Full-time
Quick Apply
Last updated: 17 days ago
Entry Level Software Developer | Reynolds and Reynolds
Reynolds and Reynolds (Canada) Ltd. • Montreal
Full-time
Last updated: 4 days ago • Promoted
Montreal Scala / Spark Developer — Onsite 12-Month Contract
SRA Group • Montreal
Full-time +1
Last updated: 8 days ago • Promoted
Java Developer (Montreal) – Market Risk & Spark
mthree • Montreal
Full-time
Last updated: 7 days ago • Promoted
JDE World developer
PIXIE • saint-esprit, qc, ca
Full-time
Last updated: 13 hours ago • Promoted • New!
.Net Fullstack developer with c# (Security Clearance)
Confidential • saint-esprit, qc, ca
Full-time
Last updated: 1 day ago • Promoted
Sr Software Engineer
Equifax • Montreal
Full-time
Last updated: 3 days ago • Promoted
Junior Full-Stack Developer — Build & Automate On-Site
CenterLine (Windsor) Limited • Lasalle
Full-time
Last updated: 8 days ago • Promoted
Sr Software Dev C++
Aspen Technology, Inc. • Montreal
Full-time
Last updated: 4 days ago • Promoted
C++ Junior Software Developer (3 positions)
NAV CANADA • Ahuntsic North, ca
Full-time
Last updated: less than 1 hour ago • Promoted • New!
Software Engineer — Build Scalable SaaS in Montreal
Everflow - Partner Marketing Platform • Montreal
Full-time
Last updated: 8 days ago • Promoted