Talent.com

Program evaluation Jobs in Toronto, ON

Create a job alert for this search

Program evaluation • toronto on

Last updated: 3 days ago

Remote Software Developer – AI Research & Evaluation

TuringToronto, Ontario, Canada
CA$200.00 daily
Remote
Full-time
Quick Apply

Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems.Turing support... Show more

Technical Program Manager

0000050007 Royal Bank of CanadaTORONTO, Ontario, Canada
Full-time

We're looking for a Technical Program Manager who will drive delivery execution for agentic AI engineering squads shipping production-grade solutions across RBC.You'll own sprint planning, velocity... Show more

Program Quality Consultant

Michener InstituteToronto, Ontario, Canada
Full-time

Reporting to the Manager, Centre for Program Review and Accreditation, the Program Quality Consultant will lead aspects of major projects and continuous quality improvement initiatives across acade... Show more

Program Coordinator

Kensington HealthToronto, Ontario, Canada
Full-time

At Kensington Health, we are proud to have built a community where people can bring their full selves to work.As a not-for-profit, we believe in the work we do every day.It's what motivates us, ins... Show more

Program Coordinator

University of TorontoToronto, ON, CA
Full-time

Home to over 40 departments and institutes, the University of Toronto's Temerty Faculty of Medicine lies at the heart of the Toronto Academic Health Science Network and is a global leader in ground... Show more

SAP Program Manager

High Cliff Partners Inc.Toronto, ON, CA
Full-time
Quick Apply

Our Toronto based client is seeking an experienced SAP Program Manager to join their project immediately and will run for 10 months, with possibility of an extension.The ideal candidate brings... Show more

RQ11267 - Program Manager - Senior

Source CodeToronto, ON, Canada
CA$139.03 daily
Full-time
Quick Apply

RQ11267 - Program Manager - Senior.Year 6 months - 1 Possible extension.Yonge Street; 222 Jarvis Street.I&IT Programs in Public sector or Broader Public Sector (BPS).Superior knowledge of curre... Show more

Manager, Planning and Evaluation

MS CanadaToronto, ON, CA
CA$68,000.00 yearly
Full-time
Quick Apply

We're inspired by the vision of a world free of multiple sclerosis (MS).MS is a neurological disease of the central nervous system (brain, spinal cord) and Canada has one of the highest rates ... Show more

Program Advisor

Toronto Film SchoolToronto, CA
CA$55,000.00 yearly
Full-time
Quick Apply

Who we are At Yorkville University and Toronto Film School, we believe education is more than the pursuit of knowledge – it is a catalyst for transformation.Our mission, grounded in democrati... Show more

Graduate Program Assistant

University of TorontoToronto, ON, CA
CA$9.00 hourly
Full-time

The Rotman School of Management is part of the University of Toronto, a global centre of research and academic excellence at the heart of Canada’s commercial and financial capital.Rotman is a catal... Show more

Management Development Program - Industrial

EMCO CorporationToronto, Ontario, Canada
Full-time

Base Salary - $52,500 + Profit Sharing.We are currently seeking new or recent graduates to join our .Management Development Program.This is a full-time, salaried position with a comprehen... Show more

Technical Program Manager

Royal Bank of Canada>TORONTO, Canada
Full-time

We're looking for a Technical Program Manager who will drive delivery execution for agentic AI engineering squads shipping production-grade solutions across RBC.You'll own sprint planning, velocity... Show more

Lead Technical Program Manager

0017 eBay Canada TechnologyToronto
Full-time

At eBay, we're more than a global ecommerce leader — we’re changing the way the world shops and sells.Our platform empowers millions of buyers and sellers in more than 190 markets around the world.... Show more

Office Document Evaluation Specialist

MercorToronto, Ontario, Canada
CA$70.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.Perform side-by-side comparisons of candidate responses to determine which better fulfills the prompt.Assess content and rendering of documents... Show more

DSM Evaluation Manager - EM&V

Resource InnovationsToronto, ON, CA
Remote
Full-time
Quick Apply

DSM Evaluation Manager to join our expanding team.In this role, you will provide technical support and project management services within the Advisory Services Group business unit, focusing on ener... Show more

Program Coordinator

University of TorontoToronto, ON, CA
CA$9.00 hourly
Full-time

Home to over 40 departments and institutes, the University of Toronto's Temerty Faculty of Medicine lies at the heart of the Toronto Academic Health Science Network and is a global leader in ground... Show more

Program Manager

Active DynamicsToronto, ON, CA
CA$100,000.00 yearly
Full-time
Quick Apply

Active Dynamics is a progressive OEM supplier that designs, tests, and manufactures unique solutions for multiple systems and multiple industries.This full-service, end-to-end capabilities are pair... Show more

Program Manager

Canadian Race Relations FoundationToronto, ON, CA
Full-time
Quick Apply

JOB DESCRIPTION | Program Manager The Canadian Race Relations Foundation The Canadian Race Relations Foundation (CRRF) was created in 1996 to reaffirm the principles of justice and equality for all... Show more

Senior Program Manager

Randstad CanadaToronto, Ontario, CA
CA$90.22 hourly
Temporary
Quick Apply

We are seeking a highly accomplished Senior Program Manager to provide strategic leadership and oversight for large-scale, complex technology modernization and transformation initiatives across mul... Show more

People also ask
Remote Software Developer – AI Research & Evaluation

Remote Software Developer – AI Research & Evaluation

TuringToronto, Ontario, Canada
7 days ago
Salary
CA$200.00 daily
Job type
  • Full-time
  • Remote
  • Quick Apply
Job description
About Us:Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in software engineering, logical reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.
Ideal Background:This role is ideal for engineers who have shipped high-impact products at fast-moving companies like Stripe, Airbnb, Cloudflare, Datadog, Coinbase, or similar high-growth engineering environments. We especially welcome graduates from top computer science programs such as Stanford, MIT, Carnegie Mellon, UC Berkeley, Georgia Tech, and comparable institutions — though exceptional experience and skill always take precedence over pedigree.
Project Overview:As a Software Engineering evaluator, you will create cutting-edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers. This includes curating code examples, providing precise solutions, and making corrections in Python, C/C++, Rust, Go, Java, and JavaScript (including ReactJS) — with particular emphasis on systems-level code, performance-critical applications, and infrastructure. You will evaluate and refine AI-generated code for efficiency, scalability, and reliability, and work with cross-functional teams to enhance enterprise-level AI-driven coding solutions.
What Does a Typical Day Look Like?:
  • Work on AI model training initiatives by curating code examples, building solutions, and correcting code in Python, C/C++, Rust, Go, Java, and JavaScript (including ReactJS).
  • Evaluate and refine AI-generated code with an emphasis on systems-level correctness, performance, and reliability.
  • Collaborate with cross-functional teams to enhance AI-driven coding solutions against industry performance benchmarks.
  • Build agents that can verify the quality of systems-level and infrastructure code and identify error patterns.
  • Hypothesize on steps in the software engineering cycle (prototyping, architecture design, API design, production implementation, launch, experiments, monitoring, operational maintenance) and evaluate model capabilities on them.
  • Design verification mechanisms that can automatically verify a solution to a software engineering task.

Required Skills:
  • Several years of software engineering experience (3 years or more).
  • Strong expertise in systems programming, infrastructure, or backend development using languages like Python, C/C++, Rust, and Go.
  • Experience building and deploying scalable, production-grade software using modern languages and tools.
  • Deep understanding of software architecture, design, development, debugging, and code quality/review assessment.
  • Excellent oral and written communication skills for clear, structured evaluation rationales.

Engagement Details:
  • Commitment: flexible engagement, minimum 10 hrs/week, up to 40 hrs/week.
  • Type: Contractor (no medical/paid leave).
  • Duration: 1 month (potential extensions based on performance and fit).
  • Location: Candidates must be based in the United States.

Evaluation Process:
  • The application process takes 15–30 minutes.
  • Completion of an AI video interview is required.





    About Turing:

    Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.