Talent.com
Mercor
Data Engineer - AI Model EvaluationMercor • Toronto, Ontario, Canada
Data Engineer - AI Model Evaluation

Data Engineer - AI Model Evaluation

Mercor • Toronto, Ontario, Canada
1 day ago
Salary
CA$80.00 hourly
Job type
  • Part-time
  • Remote
  • Quick Apply
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Data Engineer (Coding Agent Experience)
Type: Contract
Compensation: $80/hour
Location: Remote

Role Responsibilities

  • Use frontier AI coding agents to complete and evaluate complex data engineering tasks.
  • Review model-generated implementations involving ETL pipelines, data warehouses, analytics platforms, and distributed data systems.
  • Identify bugs, edge cases, scalability issues, and failure modes in model outputs.
  • Compare outputs from multiple frontier models and assess their strengths and weaknesses.
  • Apply professional engineering judgment to realistic data engineering scenarios.

Qualifications

Must-Have

  • 2+ years of professional data engineering experience.
  • Experience building ETL pipelines, data warehouses, analytics platforms, or distributed data systems.
  • Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
  • Ability to evaluate model-generated data infrastructure and pipeline implementations.

Preferred

  • Experience operating large-scale data platforms.

Compensation & Legal

  • $400 per accepted task.
  • Compensation is tied to accepted work.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Create a job alert for this search

Data Engineer - AI Model Evaluation • Toronto, Ontario, Canada

Similar jobs

Data Modeler / Analytics Engineer | Toronto (On-site) | $80K-$100K

CQ Search Group Ltd.Toronto, ON, CA
Full-time

Toronto-based data intelligence company that turns millions of unstructured public documents into high-value datasets powering infrastructure markets across North America.Looking for a data profess... Show more

 • Promoted

AI Data Engineer

Definity Financial CorporationOld Toronto, ON, CA
Full-time

The AI Data Engineer is a critical role that bridges the gap between data science and engineering, enabling the development and deployment of data assets with integrated models.This role is respons... Show more

 • Promoted

Senior Genai Data Scientist - Llm Strategy & Evaluation - C$135,000 - C$175,000 A Year

Insurtech CompanyToronto, Canada
Full-time

A leading insurtech company based in Vancouver is seeking a Senior Data Scientist for Generative AI to drive LLM strategies.You will evaluate model performance, fine-tune complex models, and collab... Show more

 • Promoted

AI Platform Engineer: Build & Evaluate AI Systems

Armilla AItoronto, on, Canada
Full-time

A leading AI-focused startup in Toronto is seeking an experienced AI Engineer to shape the future of AI risk management.In this pivotal role, you will be responsible for building core AI tools and ... Show more

 • Promoted

Generative Ai Data Engineer At Riverside

Riverside Natural Foods Ltd. (Home of MadeGood)Toronto, Canada
Full-time

Advance your career with Riverside Natural Foods as a Generative AI Engineer.Drive the integration of sophisticated data analytics for enhanced decision-making and product development.In this role,... Show more

 • Promoted

Experienced Data Engineer - Hybrid Model

searchlabsmarkham, on, Canada
Full-time

Take on a one-year contract as a Data Engineer with a hybrid work model in the Greater Toronto Area, focusing on data integration and pipeline management.Your advanced technical skills are crucial.... Show more

 • Promoted

Python & Kubernetes Data Engineer for AI/ML Analytics

CanonicalToronto, ON, CA
Full-time

Join a pioneering tech firm at the forefront of the open-source movement.As a Python and Kubernetes Software Engineer, you'll develop cutting-edge data analytics solutions using popular machine lea... Show more

 • Promoted

Software Engineer Advancing Evaluation Infrastructure for AI Innovation

Waabitoronto, on, Canada
Full-time

Join a collaborative team as a Software Engineer enhancing the evaluation infrastructure for AI-driven vehicles.Be at the forefront of autonomous technology development in a flexible work environme... Show more

 • Promoted

Generative AI Machine Learning Engineer Position

HelloFreshtoronto, on, Canada
Full-time

Be a part of HelloFresh's innovative ML Solutions squad as a Machine Learning Engineer, focusing on generative AI for culinary content.This hybrid role involves collaborating with teams to build ad... Show more

 • Promoted

Senior Ai Quality & Evaluation Architect - C$100,000 - C$143,000 A Year

Global Technology Intelligence ProviderNorth York, Canada
Full-time

Software Engineer role in Toronto focused on designing AI evaluation infrastructure, building automated tests, and ensuring AI response quality.Requires 6+ years of software engineering experience ... Show more

 • Promoted

Data Engineer II with AI Focus

Pinteresttoronto, on, Canada
Full-time

Join Pinterest as a Data Engineer II and innovate with data in a hybrid work model.This role involves utilizing AI to improve data processes and deliver insights to enhance business strategies.As a... Show more

 • Promoted

AI Engineer

BioRenderToronto, ON, CA
Full-time

At BioRender, we don’t settle for average, and neither should you.We’re building tools that transform how scientists communicate complex ideas, and we need someone who’s ready to turn ambitious ide... Show more

 • Promoted

Remote Ai Data Quality & Evaluation Engineer - C$85,000 - C$225,000 A Year - Remote

Cloud Technology CompanyToronto, Canada
Remote
Full-time

A leading cloud technology company in Toronto is seeking an experienced professional to validate and ensure the reliability of Veeva AI Agents.The ideal candidate should have expertise in data qual... Show more

 • Promoted

Data Modeler / Analytics Engineer | Toronto (On-Site) | $80k-$100k - C$80,000 - C$100,000 A Year

Data Intelligence CompanyToronto County, Canada
Full-time

Designs schemas and models data from structured and unstructured sources to create clean, queryable datasets, collaborating with engineering and product teams. Show more

 • Promoted

AI Engineer – Generative AI Expertise

Synechrontoronto, on, Canada
Full-time

Join Synechron as an AI Engineer specializing in Generative AI.Leverage your advanced skills in machine learning to innovate solutions for capital markets.As a vital contributor, you will focus on ... Show more

 • Promoted

AI / ML Engineer

US Mobiletoronto, on, Canada
Full-time

US Mobile is a venture‑backed company on a mission to revolutionize connectivity with a software platform for 5G and IoT.We are expanding rapidly and seek an AI/ML Engineer to develop and scale mac... Show more

 • Promoted

Data Engineer with GCP & AI Expertise

Loblaw Digitaltoronto, on, Canada
Full-time

Transform data processing at Loblaw as a Data Engineer focusing on GCP and AI integration.Leverage your skills in building scalable data solutions to support advanced analytics.This role requires d... Show more

 • Promoted

Remote AI Data Quality & Evaluation Engineer

Veeva Systemstoronto, on, Canada
Remote
Full-time

A leading cloud technology company in Toronto is seeking an experienced professional to validate and ensure the reliability of Veeva AI Agents.The ideal candidate should have expertise in data qual... Show more

 • Promoted

AI-Focused Data Engineer Role

Drive CapitalToronto, ON, CA
Full-time

Impact the future of AI marketing at Yolando as a Data Engineer.This hybrid role involves developing ETL pipelines and managing real-time data solutions in a growing startup environment in Toronto.... Show more

 • Promoted

Thomson Reuters Lead Engineer in AI Innovation

PowerToFlytoronto, on, Canada
Full-time

Thrive as a Lead Research Engineer at Thomson Reuters, where you will harness AI and Deep Learning to create transformative solutions for clients.Drive innovative projects in a dynamic hybrid work ... Show more