Talent.com

Program evaluation Jobs in Edmonton, AB

Create a job alert for this search

Program evaluation • edmonton ab

Last updated: 2 days ago

AI Agent Evaluation Engineer - Remote

YO AI LabsEdmonton, AB, Canada
Remote
Full-time
Quick Apply

AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using.You will design reproducible environments, deterministic veri... Show more

Indigenous Student Program - January 2027

SuncorSherwood Park, AB, CAN
Full-time

At Suncor, we produce and provide energy.When you join Suncor, you become part of a company that has built a solid foundation for both business and employee success.We are a place where talented pe... Show more

Trainer - Senior (ONSITE) JP965

P@thlion Staffing CareersEdmonton, AB, Canada
Full-time
Quick Apply

Procurement System Modernization.The Province is seeking up to two Trainers.The 1GX Centre of Excellence (CoE) supports the Government of Alberta's enterprise resource planning (ERP) solution, 1GX,... Show more

Psychologist II

Alberta Health ServicesEdmonton, Edmonton Zone
Full-time

As a registered psychologist, you will provide advanced clinical services to adult inpatients with acquired brain injury, stroke, spinal cord injury, amputations/orthopedic injuries, and general ne... Show more

Service Roofing (Apprentice, Journeyman and Foreman)

Flynn Group of CompaniesEdmonton, AB
CA$28.00 hourly
Full-time

Our Service Roofers specialize in inspecting, repairing, and maintaining roofs on commercial buildings, including tasks like fixing leaks, replacing damaged material, applying coatings, and perform... Show more

Registered Nurse

Qualicare, Edmonton SouthEdmonton, AB, CA
CA$35.00–CA$45.00 hourly
Part-time

Shifts ranging anywhere from 4 hours up to 8 hours.Flexible working hours - Mon-Friday and some on call weekends.PPE provided (Personal protective equipment).Ongoing shifts in order to build close ... Show more

Data Labeling Specialist: Remote Contract

WorkadaEdmonton, Alberta, ca
Remote
Full-time

At Workada, we're not just labeling data, we're helping improve the technology people use every day.Our work creates the examples and feedback that make advanced systems more accurate, consistent, ... Show more

 • Promoted

SAP S/4HANA Project Experience & Consulting Exposure Program (Remote)

Sapsol Technologies IncEdmonton, AB, CA
Remote
Full-time
Quick Apply

Many SAP-trained candidates understand SAP concepts but still look for additional exposure to implementation workflows, consulting practices, project collaboration, and interview-oriented discussio... Show more

Forex & Crypto Trader – Remote - Entry Level

Maverick FXEdmonton, Alberta
Remote
Full-time

Maverick Currencies is a proprietary trading firm that has been funding and developing traders since 1997.We provide capital, structured training, and ongoing mentorship — so you trade our mo... Show more

Lead Coach - Full Time

KidStrong of AlbertaEdmonton, AB, CA
CA$20.00 hourly
Full-time

Reporting to the General Manager, the Lead Coach is the leader of the coaches.In this role, you will coach approximately 25 hours per week over 5 working days.You will then be tasked with onboardin... Show more

Compensation and Job Evaluation Specialist

WCB AlbertaEdmonton, Alberta
CA$94,909.00 yearly
Full-time +1

As an equal opportunity employer, we are looking to build a diverse workforce that reflects the diversity of our clients and the customers we serve.Learn more about working for WCB atCareers - WCB ... Show more

Classrooms Program Administrator

CASA Mental HealthEdmonton, AB, CA
CA$55,053.00–CA$82,580.00 yearly
Permanent
Quick Apply

A Rewarding Career at CASA Mental Health Are you passionate about creating hope for children, youth and families?.At CASA Mental Health, every role contributes to our vision of a community where al... Show more

Program Support Assistant

Cuso InternationalEdmonton, Alberta
Permanent

This Volunteer Placement is Located in:.Open to Canadian Citizens and Permanent Residents of Canada only.Are you looking to use your organizational skills to advance human rights and gender equalit... Show more

Data Labeling Specialist: Remote Contract

WorkadaSt. Albert, Alberta, ca
Remote
Full-time

At Workada, we're not just labeling data, we're helping improve the technology people use every day.Our work creates the examples and feedback that make advanced systems more accurate, consistent, ... Show more

 • Promoted

Management Development Program - Midfield

EMCO CorporationEdmonton, Alberta, Canada
Full-time

Base Salary - $52,500 + Profit Sharing.We are currently seeking new or recent graduates to join our .Management Development Program.This is a full-time, salaried position with a comprehen... Show more

Adult Day Program Aide - Devonshire ADP

Park Place Seniors LivingEdmonton, AB, CA
CA$20.83 hourly
Part-time
Quick Apply

DEVONSHIRE SENIORS COMMUNITY Closing Date: Until Position is Filled POSITION AVAILABLE – Adult Day Program Aide (3 Positions Available) EMPLOYMENT OPPORTUNITY – Part-Time WAGE RATE - $2... Show more

Communications, Training & Security Awareness Specialist to support the continued development and

S.i. SystemsEdmonton
Full-time +1

Our large Oil & Gas industry client is seeking a.Communications, Training & Security Awareness Specialist.Human Risk Management and Security Awareness Program.This role is ideal for a communication... Show more

Senior Program Manager – Sustaining Capital Project Alliance

WoodEdmonton, AB, Canada
Full-time

Remarkable people, trusted by clients to design and advance the world.Wood is seeking a Senior Program Manager to join our Canada Projects business in Edmonton, delivering some of the world's bolde... Show more

Junior Structural Technologist - BIM

EntuitiveEdmonton, AB, CA
Full-time
Quick Apply

What is the opportunity? .We are a firm that does things a little differently.This is your opportunity to join our high-calibre, experienced group of professionals on a mission to re-imagine t... Show more

Operations Consultant - Flex

SephoraEdmonton, Canada
Full-time +1

Mayfield Common NW Unit I004, Edmonton, AB T5P 4B3, Canada (CA).This position is for an existing, open vacancy.The Operations Consultant works in partnership with the Operations Supervisor to maint... Show more

People also ask
The cities near Edmonton, AB that boast the highest number of program evaluation jobs are:
AI Agent Evaluation Engineer - Remote

AI Agent Evaluation Engineer - Remote

YO AI LabsEdmonton, AB, Canada
11 days ago
Job type
  • Full-time
  • Remote
  • Quick Apply
Job description

Senior Software Engineer

Job Type: Contractor (~15 hours/week)
Location: Remote

Job Summary

We are seeking experienced Senior Software Engineers to support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools.

You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization. No prior AI experience is required.

Key Responsibilities

  • Create reinforcement learning environments for software engineering tasks.
  • Design tasks involving bug fixing, feature development, refactoring, and performance optimization.
  • Build deterministic verification systems and golden reference solutions.
  • Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively.
  • Develop realistic, reproducible software engineering scenarios.
  • Ensure tasks accurately measure coding ability, problem-solving, and tool usage.
  • Document solutions and provide clear technical feedback.

Required Skills

  • Strong proficiency in Python 3, Java, Rust, C++, or TypeScript.
  • Strong understanding of algorithms and data structures.
  • Experience with bug fixing and debugging complex software issues.
  • Proven experience in feature implementation and codebase refactoring.
  • Strong knowledge of performance optimization and tuning.
  • Excellent written and verbal communication.
  • Strong attention to detail.

Preferred Qualifications

  • Experience working with large-scale or distributed codebases.
  • Familiarity with AI/ML systems is a plus but not required.
  • Experience with rigorous code reviews and software engineering best practices.
  • Experience working effectively in remote or cross-functional teams.

Hiring Process

  1. Submit an application and screening questions.
  2. Complete an AI interview (~30 minutes).
  3. Complete a technical assessment, if required.
  4. Hiring Manager review.

Compensation

Compensation is output-based, with payment provided per task that meets project specifications. Minimum weekly submission requirements may apply.

Availability

Selected experts should be prepared to begin their first tasks within 24–48 hours of completing onboarding.