Talent.com
Java Software Engineer
Java Software EngineerMercor • Montreal (administrative region), QC, CA
Java Software Engineer

Java Software Engineer

Mercor • Montreal (administrative region), QC, CA
Il y a 5 jours
Type de contrat
  • Temps plein
Description de poste

About The Job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position : AI Model Evaluator

Type : Full‑time or Part‑time Contract Work

Compensation : $60–$100 / hour

Location : Remote

Role Responsibilities

  • Evaluate LLM-generated responses to coding and software engineering queries for accuracy, reasoning, clarity, and completeness.
  • Conduct fact‑checking using trusted public sources and authoritative references.
  • Execute code and validate outputs using appropriate tools to conduct accuracy testing.
  • Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies.
  • Assess code quality, readability, algorithmic soundness, and explanation quality.
  • Ensure model responses align with expected conversational behavior and system guidelines.
  • Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines.

Qualifications

Must‑Have

  • BS, MS, or PhD in Computer Science or a closely related field
  • 5+ years of real‑world experience in software engineering or related technical roles
  • Expertise in at least two relevant programming languages (e.g., Python, Java, C++, C, JavaScript, Go, Rust, Ruby, SQL, Powershell, Bash, Swift, Kotlin, R, TypeScript, HTML / CSS)
  • Ability to solve HackerRank or LeetCode Medium and Hard‑level problems independently
  • Experience contributing to well‑known open‑source projects, including merged pull requests
  • Significant experience using LLMs while coding and understanding their strengths and failure modes
  • Strong attention to detail and comfort evaluating complex technical reasoning, identifying subtle bugs or logical flaws
  • Preferred

  • Prior experience with RLHF, model evaluation, or data annotation work
  • Track record in competitive programming
  • Experience reviewing code in production environments
  • Familiarity with multiple programming paradigms or ecosystems
  • Experience explaining complex technical concepts to non‑expert audiences
  • Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form
  • Resources & Support

  • For details about the interview process and platform information, please check : https : / / talent.docs.mercor.com / welcome / welcome
  • For any help or support, reach out to : support@mercor.com
  • PS : Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

    #J-18808-Ljbffr

    Créer une alerte emploi pour cette recherche

    Java Software Engineer • Montreal (administrative region), QC, CA

    Offres similaires
    Senior Java Developer (Trading Systems)

    Senior Java Developer (Trading Systems)

    Luxoft • montréal, qc, ca
    Temps plein
    Building a risk applications and tools for innovative international top-tier hedge fund from the ground up, comprising the systems for traders, pre-trade checks and analysis, risks and limits manag...Voir plus
    Dernière mise à jour : il y a 7 jours • Offre sponsorisée
    Java Developer

    Java Developer

    Targeted Talent • Montreal, QC, Canada
    Permanent
    We are looking for an experienced.Our client is developing a buy and sell platform for agriculture using blockchain technology. Software Developer, developing applications with Java.Experience devel...Voir plus
    Dernière mise à jour : il y a plus de 30 jours • Offre sponsorisée
    Ingénieur logiciel Java / Ingénieure logiciel Java

    Ingénieur logiciel Java / Ingénieure logiciel Java

    freelance.ca • Montreal, Canada
    Temps plein
    Notre processus de recrutement est entièrement transparent.Si le rôle qu’on a aujourd’hui n'est pas le bon pour toi, trouvons-en un qui le soit! Travaillons ensemble pour s’assurer que tu rejoignes...Voir plus
    Dernière mise à jour : il y a 22 jours • Offre sponsorisée
    Senior Java Developer (AI applications) [#4898]

    Senior Java Developer (AI applications) [#4898]

    Alteo • Montreal, QC, Canada
    Permanent
    Alteo is looking for a Senior Java Developer (AI Applications) for a permanent position based in Montreal.Maintain and implement new features in a search engine. Development and maintenance of the u...Voir plus
    Dernière mise à jour : il y a 29 jours • Offre sponsorisée
    Senior Java Full-Stack Engineer : Cloud, Microservices, CI / CD

    Senior Java Full-Stack Engineer : Cloud, Microservices, CI / CD

    Compunnel, Inc. • Montreal
    Temps plein
    A leading software development firm is seeking a Senior Full Stack Java Developer in Montreal to help build a secure and scalable cloud-based settlement platform. You'll work in an agile team, contr...Voir plus
    Dernière mise à jour : il y a 5 jours • Offre sponsorisée
    Applied AI Software Engineer - Simpro Software

    Applied AI Software Engineer - Simpro Software

    Simpro Software • montréal, qc, ca
    Temps plein
    The Applied AI Software Engineer will be responsible for the rapid technical design and delivery of AI agents and frameworks built on top of SIMPRO FSMs. Working closely with the AI Platform Product...Voir plus
    Dernière mise à jour : il y a 11 jours • Offre sponsorisée
    Software Engineer

    Software Engineer

    Centiro • Montreal
    Temps plein
    Centiro is a Swedish software company with more than 650+ employees.Our solutions empower marquee brands and finer supply chains in 175+ countries. We believe in enabling and empowering commerce for...Voir plus
    Dernière mise à jour : il y a 10 jours • Offre sponsorisée
    Software Engineer

    Software Engineer

    Microsoft Canada • Montréal, Quebec, Canada
    Temps plein
    Healthcare and Life Sciences (HLS).Microsoft, nous développons des solutions pour le secteur de la santé qui aident les organisations à atteindre leurs objectifs à travers l’industrie, avec un enga...Voir plus
    Dernière mise à jour : il y a 5 jours • Offre sponsorisée
    Java Software Engineer – Microservices, GraphQL & Kafka

    Java Software Engineer – Microservices, GraphQL & Kafka

    AppDirect, Inc • Montreal
    Temps plein
    Une entreprise technologique innovante à Montréal recherche un Développeur Java pour rejoindre son équipe de Gestion de Produit et d'Exécution. Votre rôle consiste à développer et maintenir des micr...Voir plus
    Dernière mise à jour : il y a 10 jours • Offre sponsorisée
    Senior Backend Java Engineer & Lead - IoT / API (Montreal)

    Senior Backend Java Engineer & Lead - IoT / API (Montreal)

    Talener • Montreal
    Temps plein +1
    A prominent technology company is seeking a Senior Software Engineer in Montreal.The role focuses on full stack development with a strong emphasis on backend technologies, particularly Java, SQL, a...Voir plus
    Dernière mise à jour : il y a 10 jours • Offre sponsorisée
    Java Developer (Montreal QC) - laval

    Java Developer (Montreal QC) - laval

    Hays • laval, qc, ca
    Temps plein
    Job Description : Full Stack Developer (angular).Hybrid (2–3 days onsite each week).Must be willing to attend an in‑person, face‑to‑face interview. We are looking for a highly skilled.Java, Angular, ...Voir plus
    Dernière mise à jour : il y a 2 jours • Offre sponsorisée
    Software Engineer

    Software Engineer

    LanceSoft, Inc. • Montreal
    Temps plein
    The position requires an experienced Power Platform engineer to develop solutions for customers and to create self-service tools. The role demands expertise in both development and infrastructure, a...Voir plus
    Dernière mise à jour : il y a 10 jours • Offre sponsorisée
    Senior Java Backend Engineer - Hybrid (Montreal)

    Senior Java Backend Engineer - Hybrid (Montreal)

    NTT DATA, Inc. • Montreal
    Temps plein
    A leading technology services company seeks a Senior Java Developer to design and implement scalable backend solutions in Montreal, QC. The role requires extensive experience in Java and Spring Boot...Voir plus
    Dernière mise à jour : il y a 1 jour • Offre sponsorisée
    Senior Java Developer

    Senior Java Developer

    Prolifics • Montreal
    Temps plein
    Prolifics is seeking a highly experienced.This is a long-term contract opportunity working on enterprise-grade systems in a dynamic and fast-paced environment. Montreal, QC (Hybrid – 3 days onsite r...Voir plus
    Dernière mise à jour : il y a 4 jours • Offre sponsorisée
    Senior Java Cloud-Native Engineer

    Senior Java Cloud-Native Engineer

    Behavox Limited. • Montreal
    Temps plein
    A data solutions company in Montreal is seeking a Software Engineer to develop scalable services using Java and cloud-native technologies. The ideal candidate will possess over 5 years of experience...Voir plus
    Dernière mise à jour : il y a 10 jours • Offre sponsorisée
    Senior Java Engineer – Spring Microservices (Hybrid Montréal)

    Senior Java Engineer – Spring Microservices (Hybrid Montréal)

    Akkodis • Montreal
    Temps plein
    Une entreprise technologique internationale recherche un Développeur Java expérimenté pour soutenir ses initiatives à Montréal. Le candidat idéal a plus de 7 ans d'expérience, maîtrise Java Core, Sp...Voir plus
    Dernière mise à jour : il y a 4 jours • Offre sponsorisée
    Senior Java Microservices Engineer – Azure, FinTech

    Senior Java Microservices Engineer – Azure, FinTech

    eHub Global Inc • Montreal
    Temps plein
    A technology company in Montreal seeks a talented developer with over 8 years of experience in Java and Spring Boot.This role involves writing scalable code and building automated tests while guidi...Voir plus
    Dernière mise à jour : il y a 7 jours • Offre sponsorisée
    Senior Full-Stack Engineer (Java / Angular) – Hybrid Montreal

    Senior Full-Stack Engineer (Java / Angular) – Hybrid Montreal

    Bourne Search Ltd • Montreal
    Temps plein
    A global financial services organisation is seeking a Senior Full Stack Java Developer to join a high-impact technology team. This role involves hands-on contributions across the stack, focusing on ...Voir plus
    Dernière mise à jour : il y a 2 jours • Offre sponsorisée