Talent.com

Program evaluation Jobs in Edmonton, AB

Create a job alert for this search

Program evaluation • edmonton ab

Last updated: 3 days ago

AI Agent Evaluation Engineer - Remote

YO AI LabsEdmonton, AB, Canada
RemoteRemote
Full-timeFull-time
Quick Apply

AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using.You will design reproducible environments, deterministic veri... Show more

Strategic Development Program Trainee

MacDonald Search GroupEdmonton

Our client is a leading Canadian distributor of industrial pipe, valves, fittings, and flow control products, serving customers across the energy and industrial sectors.Known for their technical ex... Show more

Physician Assistant

Alberta Health ServicesEdmonton, Edmonton Zone
CA$48.26–CA$68.45 hourlyCA$48.26–CA$68.45 hourly

This is an exciting opportunity at Alberta Health Services! Edmonton Zone Medical Affairs is currently recruiting for a Physician Assistant (PA) to join the Urology team at the University of Albert... Show more

Remote Photography Expert - Data Labelling

WorkadaSherwood Park, Alberta, ca
RemoteRemote

At Workada, we're not just labeling data, we're helping improve the technology people use every day.Our work creates the examples and feedback that make advanced systems more accurate, consistent, ... Show more

Registered Nurse

Qualicare, Edmonton SouthEdmonton, AB, CA
CA$35.00–CA$45.00 hourlyCA$35.00–CA$45.00 hourly
Part-timePart-time

Shifts ranging anywhere from 4 hours up to 8 hours.Flexible working hours - Mon-Friday and some on call weekends.PPE provided (Personal protective equipment).Ongoing shifts in order to build close ... Show more

Co-op Researcher – LLM Post-Training & Agentic Coding

Huawei Technologies Canada Co., Ltd.Edmonton, Alberta, CA
InternshipInternship

Huawei Canada has an immediate Co-op opening for a Researcher.Founded in 2012, the Noah’s Ark lab has evolved into a prominent research organization with notable achievements in academia and indust... Show more

Safety Systems Coordinator

Spark PowerEdmonton, Alberta, Canada
Full-timeFull-time

The Safety Systems Coordinator supports the administration, compliance, and continuous improvement of Spark Power's HSE programs across North America.Reporting to the Senior Director of Health, Saf... Show more

HUB International Internship Program Summer 2027

10102 HUB Intl Canada West ULC (Prairies)Edmonton, AB
Internship, Full-timeInternship, Full-time

At HUB, we believe the best work happens when people are given real space to grow and then given the autonomy to exercise it.We power progress and protect ambition: for the clients who count on us,... Show more

2027 NEXT Program银保渠道管培生(分公司)

Company 43 - Manulife-Sinochem Life Insurance Co. Ltd.Beijing, Beijing Branch

NEXT管理培训生项目 | Graduate Trainee Program.Nimble/Evolutionary/X-crossover/Talent.NEXT管理培训生项目,依托体系化轮岗、实战历练与业务赋能,定向培养分公司营销管理与总部职能管理人才,为全公司各条线核心管理梯队储备未来青年领袖。.AI测评 ➡ HR面试(11-12月) ➡ 业务面试 ➡ 发放offer(次年1-2月).... Show more

Future Leaders Program – Management Trainee

EMCO CorporationEdmonton, Alberta, Canada
Full-timeFull-time

As a Management Trainee, you’ll rotate through a structured, four-phase program designed to give you full visibility into how a successful business operates — from supply chain and operations to sa... Show more

Dental Instructor

CDI CollegeEdmonton, AB, CA

Established more than 60 years ago, Reeves College is a vocational licensed college that embodies excellence in education with courses that empower graduates for remarkable success in business.We h... Show more

Adult Day Program Aide - Devonshire ADP

Park Place Seniors LivingEdmonton, AB, CA
CA$20.83–CA$26.10 hourlyCA$20.83–CA$26.10 hourly
Part-timePart-time
Quick Apply

DEVONSHIRE SENIORS COMMUNITY Closing Date: Until Position is Filled POSITION AVAILABLE – Adult Day Program Aide (3 Positions Available) EMPLOYMENT OPPORTUNITY – Part-Time WAGE RATE - $20.Per AUPE c... Show more

Teacher Training and Pedagogical Support Advisor - Spanish Required

Cuso InternationalSherwood Park, Alberta
PermanentPermanent

This Volunteer Placement is Located in:.Please submit a Spanish Resume and Statement of Interest.Open to Canadian Citizens and Permanent Residents of Canada only.Are you passionate about teacher de... Show more

Leadership Academy Coordinator

PCL ConstructionEdmonton, AB, CA

The future you want is within reach.PCL Family of Companies (PCL), we don't just build projects --  we build opportunities, careers and communities.We are 100% employee-owned, every employee has a ... Show more

Remote Editorial Expert - Data Labelling

WorkadaSherwood Park, Alberta, ca
RemoteRemote

At Workada, we're not just labeling data, we're helping improve the technology people use every day.Our work creates the examples and feedback that make advanced systems more accurate, consistent, ... Show more

EDGE Program, Technical Sales & Consulting: Account Manager (Canada)

Rockwell AutomationEdmonton, Alberta, Canada
CA$70,000.00–CA$90,000.00 yearlyCA$70,000.00–CA$90,000.00 yearly

Rockwell Automation is a global technology leader focused on helping the world’s manufacturers be more productive, sustainable, and agile.With more than 28,000 employees who make the world better e... Show more

Leadership Academy Coordinator

PCL ConstructorsEdmonton, AB, CA

Coordinate leadership programs and events within the Professional Development team.Manage application intake, update materials, validate graduation, and send related communications.Handle logistics... Show more

Teacher Training and Pedagogical Support Advisor - Spanish Required

Cuso InternationalSt. Albert, Alberta
PermanentPermanent

This Volunteer Placement is Located in:.Please submit a Spanish Resume and Statement of Interest.Open to Canadian Citizens and Permanent Residents of Canada only.Are you passionate about teacher de... Show more

Junior Structural Technologist - BIM

EntuitiveEdmonton, AB, CA
Full-timeFull-time
Quick Apply

What is the opportunity? .We are a firm that does things a little differently.This is your opportunity to join our high-calibre, experienced group of professionals on a mission to re-imagine t... Show more

People also ask
The cities near Edmonton, AB that boast the highest number of program evaluation jobs are:
AI Agent Evaluation Engineer - Remote

AI Agent Evaluation Engineer - Remote

YO AI LabsEdmonton, AB, Canada
7 days ago
Job type
  • Full-time
  • Remote
  • Quick Apply
Job description

Senior Software Engineer

Job Type: Contractor (~15 hours/week)
Location: Remote

Job Summary

We are seeking experienced Senior Software Engineers to support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools.

You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization. No prior AI experience is required.

Key Responsibilities

  • Create reinforcement learning environments for software engineering tasks.
  • Design tasks involving bug fixing, feature development, refactoring, and performance optimization.
  • Build deterministic verification systems and golden reference solutions.
  • Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively.
  • Develop realistic, reproducible software engineering scenarios.
  • Ensure tasks accurately measure coding ability, problem-solving, and tool usage.
  • Document solutions and provide clear technical feedback.

Required Skills

  • Strong proficiency in Python 3, Java, Rust, C++, or TypeScript.
  • Strong understanding of algorithms and data structures.
  • Experience with bug fixing and debugging complex software issues.
  • Proven experience in feature implementation and codebase refactoring.
  • Strong knowledge of performance optimization and tuning.
  • Excellent written and verbal communication.
  • Strong attention to detail.

Preferred Qualifications

  • Experience working with large-scale or distributed codebases.
  • Familiarity with AI/ML systems is a plus but not required.
  • Experience with rigorous code reviews and software engineering best practices.
  • Experience working effectively in remote or cross-functional teams.

Hiring Process

  1. Submit an application and screening questions.
  2. Complete an AI interview (~30 minutes).
  3. Complete a technical assessment, if required.
  4. Hiring Manager review.

Compensation

Compensation is output-based, with payment provided per task that meets project specifications. Minimum weekly submission requirements may apply.

Availability

Selected experts should be prepared to begin their first tasks within 24–48 hours of completing onboarding.