Talent.com

Program evaluation Jobs in Edmonton, AB

Create a job alert for this search

Program evaluation • edmonton ab

Last updated: 3 days ago

AI Agent Evaluation Engineer - Remote

YO AI LabsEdmonton, AB, Canada
Remote
Full-time
Quick Apply

AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using.You will design reproducible environments, deterministic veri... Show more

Trainer - Senior (ONSITE) JP965

P@thlion Staffing CareersEdmonton, AB, Canada
Full-time
Quick Apply

Procurement System Modernization.The Province is seeking up to two Trainers.The 1GX Centre of Excellence (CoE) supports the Government of Alberta's enterprise resource planning (ERP) solution, 1GX,... Show more

Service Research Design, Agile, Workshops, Usability Testing

Vantix Systems IncEdmonton
Remote
Full-time

Our Client is seeking up to fourteen (23) Service Designer(s) to work on service innovation, program review and digital transformation projects.The Service Designer will work as part of cross-funct... Show more

Psychologist II

Alberta Health ServicesEdmonton, Edmonton Zone
Full-time

As a registered psychologist, you will provide advanced clinical services to adult inpatients with acquired brain injury, stroke, spinal cord injury, amputations/orthopedic injuries, and general ne... Show more

Service Roofing (Apprentice, Journeyman and Foreman)

Flynn Group of CompaniesEdmonton, AB
CA$28.00 hourly
Full-time

Our Service Roofers specialize in inspecting, repairing, and maintaining roofs on commercial buildings, including tasks like fixing leaks, replacing damaged material, applying coatings, and perform... Show more

Registered Nurse

Qualicare, Edmonton SouthEdmonton, AB, CA
CA$35.00–CA$45.00 hourly
Part-time

Shifts ranging anywhere from 4 hours up to 8 hours.Flexible working hours - Mon-Friday and some on call weekends.PPE provided (Personal protective equipment).Ongoing shifts in order to build close ... Show more

SAP S/4HANA Project Experience & Consulting Exposure Program (Remote)

Sapsol Technologies IncEdmonton, AB, CA
Remote
Full-time
Quick Apply

Many SAP-trained candidates understand SAP concepts but still look for additional exposure to implementation workflows, consulting practices, project collaboration, and interview-oriented discussio... Show more

Lead Coach - Full Time

KidStrong of AlbertaEdmonton, AB, CA
CA$20.00 hourly
Full-time

Reporting to the General Manager, the Lead Coach is the leader of the coaches.In this role, you will coach approximately 25 hours per week over 5 working days.You will then be tasked with onboardin... Show more

Compensation and Job Evaluation Specialist

WCB AlbertaEdmonton, Alberta
CA$94,909.00 yearly
Full-time +1

As an equal opportunity employer, we are looking to build a diverse workforce that reflects the diversity of our clients and the customers we serve.Learn more about working for WCB atCareers - WCB ... Show more

Program Support Assistant

Cuso InternationalEdmonton, Alberta
Permanent

This Volunteer Placement is Located in:.Open to Canadian Citizens and Permanent Residents of Canada only.Are you looking to use your organizational skills to advance human rights and gender equalit... Show more

 • Promoted

Data Labeling Specialist: Remote Contract

WorkadaSt. Albert, Alberta, ca
Remote
Full-time

At Workada, we're not just labeling data, we're helping improve the technology people use every day.Our work creates the examples and feedback that make advanced systems more accurate, consistent, ... Show more

 • Promoted

Forex & Crypto Trader – Remote - Entry Level

Maverick FXSt. Albert, Alberta
Remote
Full-time

Maverick Currencies is a proprietary trading firm that has been funding and developing traders since 1997.We provide capital, structured training, and ongoing mentorship — so you trade our mo... Show more

Buyer IV

Randstad CanadaEdmonton, Alberta, CA
Temporary
Quick Apply

SCM Procurement – Project Buyer IV - CWR.Do you thrive in managing procurement processes, ensuring compliance and acting as a strategic partner to a large Project Team? As Project Buyer IV (contra... Show more

Management Development Program - Midfield

EMCO CorporationEdmonton, Alberta, Canada
Full-time

Base Salary - $52,500 + Profit Sharing.We are currently seeking new or recent graduates to join our .Management Development Program.This is a full-time, salaried position with a comprehen... Show more

Program Manager, CASA House and Adolescent Day Program

CASA Mental HealthEdmonton, AB, CA
CA$86,815.00–CA$131,281.00 yearly
Permanent
Quick Apply

Help build the future of adolescent mental health care in Alberta CASA Mental Health is expanding its circle of care around the province to provide much needed mental health services to as many fam... Show more

Adult Day Program Aide - Devonshire ADP

Park Place Seniors LivingEdmonton, AB, CA
CA$20.83 hourly
Part-time
Quick Apply

DEVONSHIRE SENIORS COMMUNITY Closing Date: Until Position is Filled POSITION AVAILABLE – Adult Day Program Aide (3 Positions Available) EMPLOYMENT OPPORTUNITY – Part-Time WAGE RATE - $2... Show more

Data Labeling Specialist: Remote Contract

WorkadaSherwood Park, Alberta, ca
Remote
Full-time

At Workada, we're not just labeling data, we're helping improve the technology people use every day.Our work creates the examples and feedback that make advanced systems more accurate, consistent, ... Show more

 • Promoted

Senior Program Director to lead a high-profile Business Technology Renewal (BTR) Program for a

S.i. SystemsEdmonton
Temporary

Our client has a requirement for an Alberta-based .Senior Program Director to lead a high-profile Business Technology Renewal (BTR) Program for a large Alberta-based organization.This is an opportu... Show more

Junior Structural Technologist - BIM

EntuitiveEdmonton, AB, CA
Full-time
Quick Apply

What is the opportunity? .We are a firm that does things a little differently.This is your opportunity to join our high-calibre, experienced group of professionals on a mission to re-imagine t... Show more

Operations Consultant - Flex

SephoraEdmonton, Canada
Full-time +1

Mayfield Common NW Unit I004, Edmonton, AB T5P 4B3, Canada (CA).This position is for an existing, open vacancy.The Operations Consultant works in partnership with the Operations Supervisor to maint... Show more

People also ask
The cities near Edmonton, AB that boast the highest number of program evaluation jobs are:
AI Agent Evaluation Engineer - Remote

AI Agent Evaluation Engineer - Remote

YO AI LabsEdmonton, AB, Canada
12 days ago
Job type
  • Full-time
  • Remote
  • Quick Apply
Job description

Senior Software Engineer

Job Type: Contractor (~15 hours/week)
Location: Remote

Job Summary

We are seeking experienced Senior Software Engineers to support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools.

You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization. No prior AI experience is required.

Key Responsibilities

  • Create reinforcement learning environments for software engineering tasks.
  • Design tasks involving bug fixing, feature development, refactoring, and performance optimization.
  • Build deterministic verification systems and golden reference solutions.
  • Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively.
  • Develop realistic, reproducible software engineering scenarios.
  • Ensure tasks accurately measure coding ability, problem-solving, and tool usage.
  • Document solutions and provide clear technical feedback.

Required Skills

  • Strong proficiency in Python 3, Java, Rust, C++, or TypeScript.
  • Strong understanding of algorithms and data structures.
  • Experience with bug fixing and debugging complex software issues.
  • Proven experience in feature implementation and codebase refactoring.
  • Strong knowledge of performance optimization and tuning.
  • Excellent written and verbal communication.
  • Strong attention to detail.

Preferred Qualifications

  • Experience working with large-scale or distributed codebases.
  • Familiarity with AI/ML systems is a plus but not required.
  • Experience with rigorous code reviews and software engineering best practices.
  • Experience working effectively in remote or cross-functional teams.

Hiring Process

  1. Submit an application and screening questions.
  2. Complete an AI interview (~30 minutes).
  3. Complete a technical assessment, if required.
  4. Hiring Manager review.

Compensation

Compensation is output-based, with payment provided per task that meets project specifications. Minimum weekly submission requirements may apply.

Availability

Selected experts should be prepared to begin their first tasks within 24–48 hours of completing onboarding.