Talent.com
Mercor
DevOps Engineer AI Model EvaluatorMercor • Toronto, Ontario, Canada
DevOps Engineer AI Model Evaluator

DevOps Engineer AI Model Evaluator

Mercor • Toronto, Ontario, Canada
Il y a plus de 30 jours
Salaire
85,00 $CA par heure
Type de contrat
  • Temps plein
Description de poste

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey.

Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote

Role Responsibilities

  • Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
  • Review model-generated implementations involving cloud platforms Kubernetes CI/CD systems and infrastructure automation.
  • Identify bugs edge cases reliability issues and failure modes in model outputs.
  • Compare outputs from multiple frontier models to assess strengths and weaknesses.
  • Apply professional engineering judgment to realistic infrastructure engineering scenarios.

Qualifications

Must-Have

  • 2 years of professional DevOps SRE or Cloud Engineering experience.
  • Experience with AWS Azure GCP Kubernetes Terraform CI/CD pipelines or observability tooling.
  • Regular use of AI coding agents like Cursor Claude Code Codex Windsurf Gemini CLI or similar tools.
  • Ability to evaluate model-generated infrastructure and reliability engineering solutions.

Preferred

  • Experience supporting production-scale systems.

Compensation & Legal

  • $400 per accepted task.
  • Compensation is tied to accepted work.

Application Process (Takes 2030 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information please check:
  • For any help or support reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.


Employment Type : Full Time
Experience: years
Vacancy: 1
Créer une alerte emploi pour cette recherche

DevOps Engineer AI Model Evaluator • Toronto, Ontario, Canada

Offres similaires

Senior Software Engineer, Evaluation Infrastructure

ProducePaytoronto, on, Canada
Temps plein

Waabi, founded by AI visionary Raquel Urtasun, is the leader in Physical AI.With a world‑class team, we’re unlocking the next era of autonomous transportation with technology that’s powering commer... Voir plus

 • Offre sponsorisée

Generative AI Engineer — Azure & LLM Solutions

GEI Consultantsmarkham, york region, Canada
Temps plein

A leading engineering and consulting firm in Ontario seeks an AI Engineer to develop and deploy AI solutions.The ideal candidate will have extensive software engineering experience and skills in Ge... Voir plus

 • Offre sponsorisée

Principal AI Solutions Developer

OpenTextrichmond hill, york region, Canada
Temps plein

Become a Principal AI Solutions Developer at OpenText, leading the charge in creating sophisticated agentic AI systems.Use your expertise to enhance IT Operations security and observability.OpenTex... Voir plus

 • Offre sponsorisée

Senior DevOps Engineer - Cloud-Native, Azure & AI/ML

Publicis Groupe CanadaToronto, ON, CA
Temps plein

A leading communications group in Toronto is seeking a Senior DevOps Engineer to design and operate cloud-native platforms.You will support AI/ML workloads and ensure scalable solutions.This role r... Voir plus

 • Offre sponsorisée

Lead DevOps Engineer for AI Projects

Oncousticstoronto, on, Canada
Temps plein

Join Oncoustics as a Lead DevOps Engineer and revolutionize AI/ML pipelines for liver healthcare solutions.This role involves collaborating with R&D teams and streamlining model deployment processe... Voir plus

 • Offre sponsorisée

AI Platform Engineer: Build & Evaluate AI Systems

Armilla AItoronto, on, Canada
Temps plein

A leading AI-focused startup in Toronto is seeking an experienced AI Engineer to shape the future of AI risk management.In this pivotal role, you will be responsible for building core AI tools and ... Voir plus

 • Offre sponsorisée

Senior DevOps Engineer, AI Infrastructure

Jobtailortoronto, on, Canada
Temps plein

Who we are: Financeit is a point-of-sale financing provider serving some of the largest home improvement and retail organizations in Canada.Our platform helps businesses close more sales by offerin... Voir plus

 • Offre sponsorisée

Experienced Data Engineer - Hybrid Model

searchlabsmarkham, on, Canada
Temps plein

Take on a one-year contract as a Data Engineer with a hybrid work model in the Greater Toronto Area, focusing on data integration and pipeline management.Your advanced technical skills are crucial.... Voir plus

 • Offre sponsorisée

Remote AI Engineer - Build Next-Gen ML Solutions

Yeah! GlobalToronto, ON, CA
Télétravail
Temps plein

A global technology firm is seeking highly skilled AI Engineers to join their team.This remote position requires proficiency in programming languages like Python and experience in developing AI mod... Voir plus

 • Offre sponsorisée

Remote Forward-Deployed Engineer: AI-Driven Modernization

Banyan Softwaretoronto, on, Canada
Télétravail
Temps plein

A leading software company is seeking a Forward Deployed Engineer to drive the modernization of applications with a focus on AI-assisted software development practices.This hybrid role requires ove... Voir plus

 • Offre sponsorisée

Azure DevOps Engineer

Swoonmarkham, york region, Canada
Temps plein

This range is provided by Swoon.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Direct message the job poster from Swoon.Technical Recruiter @ S... Voir plus

 • Offre sponsorisée

AI Evaluation Engineer

ZafinToronto, ON, CA
Temps plein

Zafin is an AI platform company helping regulated institutions modernize how critical work is designed, governed, and delivered.Our technology enables organizations to move faster while maintaining... Voir plus

 • Offre sponsorisée

DevOps Engineer - AI Model Evaluator

MercorToronto, Ontario, Canada
85,00 $CA par heure
Télétravail
Temps partiel
Quick Apply

Headquartered in San Francisco, our investors include.DevOps / SRE / Cloud Engineer (Coding Agent Experience).Review model-generated implementations involving.Identify bugs, edge cases, reliability... Voir plus

Senior Researcher - Generative Modeling Expert

Huawei Technologies Canada Co., Ltd.markham, on, Canada
Temps plein

Become a Senior Researcher at Huawei Canada, specializing in generative modeling and 3D computer vision.Contribute to transformative AI research within a leading lab environment.At Huawei Canada's ... Voir plus

 • Offre sponsorisée

Demo Engineer - AI [32469]

Stealth AI Startuptoronto, on, Canada
Temps plein

Get AI-powered advice on this job and more exclusive features.This range is provided by Stealth AI Startup.Your actual pay will be based on your skills and experience — talk with your recruiter to ... Voir plus

 • Offre sponsorisée

Remote AI Data Quality & Evaluation Engineer

Veeva SystemsToronto, ON, CA
Télétravail
Temps plein

A leading cloud technology company in Toronto is seeking an experienced professional to validate and ensure the reliability of Veeva AI Agents.The ideal candidate should have expertise in data qual... Voir plus

 • Offre sponsorisée

AI Engineer

BioRenderToronto, ON, CA
Temps plein

At BioRender, we don’t settle for average, and neither should you.We’re building tools that transform how scientists communicate complex ideas, and we need someone who’s ready to turn ambitious ide... Voir plus

 • Offre sponsorisée

AI Engineer for Reliability Solutions

Mosaic.techtoronto, on, Canada
Temps plein

Join Rootly as an AI Engineer specializing in developing reliable AI-driven solutions for incident management.Use your LLM experience to shape the future of business reliability.As a Senior AI Engi... Voir plus

 • Offre sponsorisée

Lead Verification Engineer AI Hardware

Tenstorrenttoronto, on, Canada
Temps plein

Drive innovation in AI hardware as Lead Verification Engineer with Tenstorrent, based in Austin, Toronto, or Belgrade.Lead a team focusing on testing advanced AI cores and networks.At Tenstorrent, ... Voir plus

 • Offre sponsorisée

AI Specialist - Applied ML Research

Xanadutoronto, on, Canada
Temps plein

Xanadu’s mission is to build quantum computers that are useful and available to people everywhere.At Xanadu, we are learners, innovators, researchers, collaborators and problem solvers.We are creat... Voir plus