Talent.com

Program evaluation Offres d'emploi - Toronto, ON

Créer une alerte emploi pour cette recherche

Program evaluation • toronto on

Dernière mise à jour : il y a 19 heures

AI Agent Evaluation Engineer - Remote

YO AI LabsToronto, ON, Canada
Télétravail
Temps plein
Quick Apply

AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using.You will design reproducible environments, deterministic veri... Voir plus

Remote Software Developer – AI Research & Evaluation

TuringToronto, Ontario, Canada
200,00 $CA – 300,00 $CA par jour
Télétravail
Temps plein
Quick Apply

Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems.Turing support... Voir plus

 • Nouvelle offre

Technical Program Coordinator

Yorkville UniversityToronto, ON, CA
70 000,00 $CA par an
Temps plein
Quick Apply

Who we are At Yorkville University and Toronto Film School, we believe education is more than the pursuit of knowledge – it is a catalyst for transformation.Our mission, grounded in democrati... Voir plus

Program Lead – Afterschool Programs

National EsportsToronto, Ontario, Canada
Temps partiel

Part-time / Contract (with growth potential).We are building a new generation of afterschool programs designed to give students real exposure to modern industries—esports,... Voir plus

Program Coordinator

Kensington HealthToronto, Ontario, Canada
Temps plein

At Kensington Health, we are proud to have built a community where people can bring their full selves to work.As a not-for-profit, we believe in the work we do every day.It's what motivates us, ins... Voir plus

Senior Program Manager

Randstad CanadaToronto, Ontario, CA
90,22 $CA par heure
Temporaire
Quick Apply

We are seeking a highly accomplished Senior Program Manager to provide strategic leadership and oversight for large-scale, complex technology modernization and transformation initiatives across mul... Voir plus

Director, Program Manager

Royal Bank of Canada>TORONTO, Canada
Temps plein

Lead a mission-critical program portfolio governing settlement, clearing, and middle office operations for RBC Capital Markets.You'll drive strategic technology transformation across collateral man... Voir plus

Program Manager 5999

FoilconToronto, Ontario, Canada
90,00 $CA par heure
Temporaire

Ontario and #x27;s Public Safety Radio Network (PSRN) is one of the largest and most complex public safety radio networks in North America.It covers approximately 750,000 km2 of area.PSRN serves mo... Voir plus

Program Advisor

University of TorontoToronto, ON, CA
Temps plein +1

The Faculty of Arts & Science is the heart of Canada’s leading university and one of the most comprehensive and diverse academic divisions in the world.The strength of Arts & Science derive... Voir plus

Technical Program Manager / Technical Program Lead

Staffingine LLCToronto, ON, Canada
Temps plein
Quick Apply

Job Title: Technical Program Manager / Technical Program Lead<br /> Job Location: Toronto, ON<br /> Job Type: Contract</b></p> <p style="margin-bottom:13px"&g... Voir plus

SAP Program Manager

High Cliff Partners Inc.Toronto, ON, CA
Temps plein
Quick Apply

Our Toronto based client is seeking an experienced SAP Program Manager to join their project immediately and will run for 10 months, with possibility of an extension.The ideal candidate brings... Voir plus

Capital & Maintenance Program Analyst

Toronto HydroToronto, ON, CA
Temps plein

Target Variable Performance Pay: 8%.The salary range shown above reflects the expected  compensation for this position.The final salary offered will be determined based on a holistic assessment of ... Voir plus

Lead Product Program Manager

0076 eBay CanadaToronto
Temps plein

At eBay, we're more than a global ecommerce leader — we’re changing the way the world shops and sells.Our platform empowers millions of buyers and sellers in more than 190 markets around the world.... Voir plus

Program Advisor

Toronto Film SchoolToronto, CA
55 000,00 $CA par an
Temps plein
Quick Apply

Who we are At Yorkville University and Toronto Film School, we believe education is more than the pursuit of knowledge – it is a catalyst for transformation.Our mission, grounded in democrati... Voir plus

Video Evaluation Specialist - Annotator

MercorToronto, Ontario, Canada
15,00 $CA –20,00 $CA par heure
Télétravail
Temps partiel
Quick Apply

Headquartered in San Francisco, our investors include.Evaluate paired video outputs by comparing two short video clips against a provided rubric for prompt adherence, motion quality, visual artifac... Voir plus

Program Support Assistant

Cuso InternationalToronto, Ontario
Permanent

This Volunteer Placement is Located in:.Open to Canadian Citizens and Permanent Residents of Canada only.Are you looking to use your organizational skills to advance human rights and gender equalit... Voir plus

 • Offre sponsorisée

DSM Evaluation Manager - EM&V

Resource InnovationsToronto, ON, CA
Télétravail
Temps plein
Quick Apply

DSM Evaluation Manager to join our expanding team.In this role, you will provide technical support and project management services within the Advisory Services Group business unit, focusing on ener... Voir plus

Program Manager

Active DynamicsToronto, ON, CA
100 000,00 $CA par an
Temps plein
Quick Apply

Active Dynamics is a progressive OEM supplier that designs, tests, and manufactures unique solutions for multiple systems and multiple industries.This full-service, end-to-end capabilities are pair... Voir plus

Director, Program Manager

0000050007 Royal Bank of CanadaTORONTO, Ontario, Canada
Temps plein

What is the opportunity?Lead a mission-critical program portfolio governing settlement, clearing, and middle office operations for RBC Capital Markets.You'll drive strategic technology transformati... Voir plus

Program Manager - GFC Acceleration

0017 eBay Canada TechnologyToronto
Temps plein

At eBay, we're more than a global ecommerce leader — we’re changing the way the world shops and sells.Our platform empowers millions of buyers and sellers in more than 190 markets around the world.... Voir plus

AI Agent Evaluation Engineer - Remote

AI Agent Evaluation Engineer - Remote

YO AI LabsToronto, ON, Canada
Il y a 12 jours
Type de contrat
  • Temps plein
  • Télétravail
  • Quick Apply
Description de poste

Senior Software Engineer

Job Type: Contractor (~15 hours/week)
Location: Remote

Job Summary

We are seeking experienced Senior Software Engineers to support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools.

You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization. No prior AI experience is required.

Key Responsibilities

  • Create reinforcement learning environments for software engineering tasks.
  • Design tasks involving bug fixing, feature development, refactoring, and performance optimization.
  • Build deterministic verification systems and golden reference solutions.
  • Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively.
  • Develop realistic, reproducible software engineering scenarios.
  • Ensure tasks accurately measure coding ability, problem-solving, and tool usage.
  • Document solutions and provide clear technical feedback.

Required Skills

  • Strong proficiency in Python 3, Java, Rust, C++, or TypeScript.
  • Strong understanding of algorithms and data structures.
  • Experience with bug fixing and debugging complex software issues.
  • Proven experience in feature implementation and codebase refactoring.
  • Strong knowledge of performance optimization and tuning.
  • Excellent written and verbal communication.
  • Strong attention to detail.

Preferred Qualifications

  • Experience working with large-scale or distributed codebases.
  • Familiarity with AI/ML systems is a plus but not required.
  • Experience with rigorous code reviews and software engineering best practices.
  • Experience working effectively in remote or cross-functional teams.

Hiring Process

  1. Submit an application and screening questions.
  2. Complete an AI interview (~30 minutes).
  3. Complete a technical assessment, if required.
  4. Hiring Manager review.

Compensation

Compensation is output-based, with payment provided per task that meets project specifications. Minimum weekly submission requirements may apply.

Availability

Selected experts should be prepared to begin their first tasks within 24–48 hours of completing onboarding.