Talent.com
Mercor
Data Engineer - AI Model EvaluatorMercor • Toronto, Ontario, Canada
Data Engineer - AI Model Evaluator

Data Engineer - AI Model Evaluator

Mercor • Toronto, Ontario, Canada
1 day ago
Salary
CA$80.00 hourly
Job type
  • Part-time
  • Remote
  • Quick Apply
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Data Engineer (Coding Agent Experience)
Type: Contract
Compensation: $80/hour
Location: Remote

Role Responsibilities

  • Use frontier AI coding agents to complete and evaluate complex data engineering tasks.
  • Review model-generated implementations involving ETL pipelines, data warehouses, analytics platforms, and distributed data systems.
  • Identify bugs, edge cases, scalability issues, and failure modes in model outputs.
  • Compare outputs from multiple frontier models and assess their strengths and weaknesses.
  • Apply professional engineering judgment to realistic data engineering scenarios.

Qualifications

Must-Have

  • 2+ years of professional data engineering experience.
  • Experience building ETL pipelines, data warehouses, analytics platforms, or distributed data systems.
  • Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
  • Ability to evaluate model-generated data infrastructure and pipeline implementations.

Preferred

  • Experience operating large-scale data platforms.

Compensation & Legal

  • $400 per accepted task.
  • Compensation is tied to accepted work.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Create a job alert for this search

Data Engineer - AI Model Evaluator • Toronto, Ontario, Canada

Similar jobs

Data Modeler / Analytics Engineer | Toronto (On-site) | $80K-$100K

CQ Search Group Ltd.Toronto, ON, CA
Full-time

Toronto-based data intelligence company that turns millions of unstructured public documents into high-value datasets powering infrastructure markets across North America.Looking for a data profess... Show more

 • Promoted

AI Data Engineer

Definity Financial CorporationOld Toronto, ON, CA
Full-time

The AI Data Engineer is a critical role that bridges the gap between data science and engineering, enabling the development and deployment of data assets with integrated models.This role is respons... Show more

 • Promoted

Ai Model Evaluator - Legal Expert Needed

ObsidianToronto, Canada
Part-time

Mercor invites you to a part-time role as a Legal Expert focusing on AI training.Your legal acumen will evaluate responses regarding employment law matters.This position, in collaboration with a pr... Show more

 • Promoted

Experienced Data Engineer - Hybrid Model

searchlabsmarkham, on, Canada
Full-time

Take on a one-year contract as a Data Engineer with a hybrid work model in the Greater Toronto Area, focusing on data integration and pipeline management.Your advanced technical skills are crucial.... Show more

 • Promoted

AI-ML Engineer

ampliphi RMS softwareToronto, ON, CA
Full-time

Global Talent Acquisition at Valsoft Corporation and Aspire Software.We are hiring for an AI-ML Engineer to join our growing team at Ampliphi in Toronto!.As an AI Engineer at Ampliphi, you will be ... Show more

 • Promoted

Python & Kubernetes Data Engineer for AI/ML Analytics

CanonicalToronto, ON, CA
Full-time

Join a pioneering tech firm at the forefront of the open-source movement.As a Python and Kubernetes Software Engineer, you'll develop cutting-edge data analytics solutions using popular machine lea... Show more

 • Promoted

Lead AI/ML Research Engineer - Hybrid, Growth & Impact

Thomson ReutersToronto, ON, CA
Full-time

A global technology company is seeking a Lead Research Engineer to spearhead innovative AI and ML capabilities.This role involves leading technical teams, developing large-scale data processing pip... Show more

 • Promoted

AI-Focused Data Engineer Role

Drive CapitalToronto
Full-time

Impact the future of AI marketing at Yolando as a Data Engineer.This hybrid role involves developing ETL pipelines and managing real-time data solutions in a growing startup environment in Toronto.... Show more

 • Promoted

Remote R&D Biologist: AI Model Evaluation & Design

DataAnnotationMarkham, York Region, CA
Remote
Full-time

An innovative company is seeking a Research and Development Biologist to enhance AI models through rigorous evaluation and problem-solving.This exciting remote role offers flexibility in project se... Show more

 • Promoted

AI Model Evaluator - Legal Expert Needed

ObsidianToronto
Full-time +1

Mercor invites you to a part-time role as a Legal Expert focusing on AI training.Your legal acumen will evaluate responses regarding employment law matters.This position, in collaboration with a pr... Show more

 • Promoted

Intern Researcher - AI Agent Evaluation

Huawei CanadaMarkham, York Region, CA
Full-time

Huawei Canada has an immediate 4-12 month internship opening for an Intern Researcher.Established in 2014, the Distributed Scheduling and Data Engine Lab is Huawei Cloud's technical innovation cent... Show more

 • Promoted

Senior Researcher - Generative Modeling Expert

Huawei Technologies Canada Co., Ltd.markham, on, Canada
Full-time

Become a Senior Researcher at Huawei Canada, specializing in generative modeling and 3D computer vision.Contribute to transformative AI research within a leading lab environment.At Huawei Canada's ... Show more

 • Promoted

Senior Machine Learning Engineer for AI Tax Solutions

Blue JToronto, ON, CA
Full-time

Drive innovation in AI-driven tax research as a Senior Machine Learning Engineer.This hybrid position, requiring proximity to Toronto, emphasizes developing state-of-the-art ML systems.With a stron... Show more

 • Promoted

AI Engineer

BioRenderToronto, ON, CA
Full-time

At BioRender, we don’t settle for average, and neither should you.We’re building tools that transform how scientists communicate complex ideas, and we need someone who’s ready to turn ambitious ide... Show more

 • Promoted

AI Engineer – Generative AI Expertise

Synechrontoronto, on, Canada
Full-time

Join Synechron as an AI Engineer specializing in Generative AI.Leverage your advanced skills in machine learning to innovate solutions for capital markets.As a vital contributor, you will focus on ... Show more

 • Promoted

Data Modeler

Cpus Engineering Staffing Solutions Inc.Toronto, ON, CA
Full-time

We are currently requesting resumes for the following position.Thursday, August 21, 2025 (5:00PM EST).Temp – 700 University Ave, Toronto, Base – CHQ on rotating schedule.Analyze and document existi... Show more

 • Promoted

Remote AI Data Quality & Evaluation Engineer

Veeva Systemstoronto, on, Canada
Remote
Full-time

A leading cloud technology company in Toronto is seeking an experienced professional to validate and ensure the reliability of Veeva AI Agents.The ideal candidate should have expertise in data qual... Show more

 • Promoted

Machine Learning Engineer

Linkus GroupToronto, ON, CA
Full-time

In this role, you'll build the next generation of AI tools that preserve and enhance critical thinking for humanity.The ideal candidate is someone who is adept at creating reliable AI agents, promp... Show more

 • Promoted

Machine Learning Engineer in AI Solutions

CalabrioToronto, ON, CA
Full-time

Drive innovation as a Machine Learning Engineer at Calabrio-Verint, focusing on AI solutions that reshape customer experiences.Work with AI, machine learning, and cutting-edge NLP technologies.In t... Show more

 • Promoted

Data Engineer

University of TorontoGreater Toronto Area, ON, CA
Full-time +1

Press Tab to Move to Skip to Content Link.Select how often (in days) to receive an alert:.Ofc of Vice Pres, Research & Innovation.The Vice-President, Research & Innovation (VPRI) portfolio supports... Show more