Talent.com

Program evaluation Jobs in Edmonton, AB

Create a job alert for this search

Program evaluation • edmonton ab

Last updated: 2 days ago

AI Agent Evaluation Engineer - Remote

YO AI LabsEdmonton, AB, Canada
Remote
Full-time
Quick Apply

AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using.You will design reproducible environments, deterministic veri... Show more

Labour Market Analysis Advisor - Spanish Required

Cuso InternationalSherwood Park, Alberta
Permanent

This Volunteer Placement is Located in:.Please submit a Spanish Resume and Statement of Interest.Open to Canadian Citizens and Permanent Residents of Canada only.As part of Cuso International's com... Show more

 • Promoted

Labour Market Analysis Advisor - Spanish Required

Cuso InternationalSt. Albert, Alberta
Permanent

This Volunteer Placement is Located in:.Please submit a Spanish Resume and Statement of Interest.Open to Canadian Citizens and Permanent Residents of Canada only.As part of Cuso International's com... Show more

 • Promoted

Psychologist II

Alberta Health ServicesEdmonton, Edmonton Zone
Full-time

As a registered psychologist, you will provide advanced clinical services to adult inpatients with acquired brain injury, stroke, spinal cord injury, amputations/orthopedic injuries, and general ne... Show more

Registered Nurse

Qualicare, Edmonton SouthEdmonton, AB, CA
CA$35.00–CA$45.00 hourly
Part-time

Shifts ranging anywhere from 4 hours up to 8 hours.Flexible working hours - Mon-Friday and some on call weekends.PPE provided (Personal protective equipment).Ongoing shifts in order to build close ... Show more

SAP S/4HANA Project Experience & Consulting Exposure Program (Remote)

Sapsol Technologies IncEdmonton, AB, CA
Remote
Full-time
Quick Apply

Many SAP-trained candidates understand SAP concepts but still look for additional exposure to implementation workflows, consulting practices, project collaboration, and interview-oriented discussio... Show more

Forex & Crypto Trader – Remote - Entry Level

Maverick FXSherwood Park, Alberta
Remote
Full-time

Maverick Currencies is a proprietary trading firm that has been funding and developing traders since 1997.We provide capital, structured training, and ongoing mentorship — so you trade our mo... Show more

Buyer IV

Randstad CanadaEdmonton, Alberta, CA
Temporary
Quick Apply

SCM Procurement – Project Buyer IV - CWR.Do you thrive in managing procurement processes, ensuring compliance and acting as a strategic partner to a large Project Team? As Project Buyer IV (contra... Show more

Scrum Master (REMOTE) JP1008

P@thlion Staffing CareersEdmonton, AB, Canada
Remote
Full-time
Quick Apply

The Government of Alberta (GoA) has embarked on transforming the work of government to deliver simpler, more efficient, and better services for the citizens of Alberta, thereby ensuring that the ne... Show more

Management Training Program - Edmonton

Guillevin InternationalEdmonton
Full-time

Management Training Program - Edmonton.Manage a business centre as if you owned it, without the financial risk.Serve a local market and be the reference for projects of all sizes, work with the top... Show more

Labour Market Analysis Advisor - Spanish Required

Cuso InternationalEdmonton, Alberta
Permanent

This Volunteer Placement is Located in:.Please submit a Spanish Resume and Statement of Interest.Open to Canadian Citizens and Permanent Residents of Canada only.As part of Cuso International's com... Show more

 • Promoted

Remote UI/UX design Expert - Data Labelling

WorkadaSt. Albert, Alberta, ca
Remote
Full-time

At Workada, we're not just labeling data, we're helping improve the technology people use every day.Our work creates the examples and feedback that make advanced systems more accurate, consistent, ... Show more

 • Promoted

Adult Day Program Aide - Devonshire ADP

Park Place Seniors LivingEdmonton, AB, CA
CA$20.83 hourly
Part-time
Quick Apply

DEVONSHIRE SENIORS COMMUNITY Closing Date: Until Position is Filled POSITION AVAILABLE – Adult Day Program Aide (3 Positions Available) EMPLOYMENT OPPORTUNITY – Part-Time WAGE RATE - $2... Show more

Teacher Training and Pedagogical Support Advisor - Spanish Required

Cuso InternationalSherwood Park, Alberta
Permanent

This Volunteer Placement is Located in:.Please submit a Spanish Resume and Statement of Interest.Open to Canadian Citizens and Permanent Residents of Canada only.Are you passionate about teacher de... Show more

 • Promoted

Leadership Academy Coordinator

PCL ConstructionEdmonton, AB, CA
Full-time

The future you want is within reach.PCL Family of Companies (PCL), we don't just build projects --  we build opportunities, careers and communities.We are 100% employee-owned, every employee has a ... Show more

Senior Program Manager – Sustaining Capital Project Alliance

WoodEdmonton, AB, Canada
Full-time

Remarkable people, trusted by clients to design and advance the world.Wood is seeking a Senior Program Manager to join our Canada Projects business in Edmonton, delivering some of the world's bolde... Show more

Account Representative- Sales Training Program (Alberta) October 2026

CDWEdmonton, AB, CA
CA$50,000.00 yearly
Full-time
Quick Apply

We are looking for high energy, driven self-starters to sell the most innovative and trusted technology brands in the IT industry.Join us and you will start out as a Sales Account Representative wi... Show more

Teacher Training and Pedagogical Support Advisor - Spanish Required

Cuso InternationalEdmonton, Alberta
Permanent

This Volunteer Placement is Located in:.Please submit a Spanish Resume and Statement of Interest.Open to Canadian Citizens and Permanent Residents of Canada only.Are you passionate about teacher de... Show more

 • Promoted

Junior Structural Technologist - BIM

EntuitiveEdmonton, AB, CA
Full-time
Quick Apply

What is the opportunity? .We are a firm that does things a little differently.This is your opportunity to join our high-calibre, experienced group of professionals on a mission to re-imagine t... Show more

Operations Consultant - Flex

SephoraEdmonton, Canada
Full-time +1

Mayfield Common NW Unit I004, Edmonton, AB T5P 4B3, Canada (CA).This position is for an existing, open vacancy.The Operations Consultant works in partnership with the Operations Supervisor to maint... Show more

AI Agent Evaluation Engineer - Remote

AI Agent Evaluation Engineer - Remote

YO AI LabsEdmonton, AB, Canada
30+ days ago
Job type
  • Full-time
  • Remote
  • Quick Apply
Job description

Senior Software Engineer

Job Type: Contractor (~15 hours/week)
Location: Remote

Job Summary

We are seeking experienced Senior Software Engineers to support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools.

You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization. No prior AI experience is required.

Key Responsibilities

  • Create reinforcement learning environments for software engineering tasks.
  • Design tasks involving bug fixing, feature development, refactoring, and performance optimization.
  • Build deterministic verification systems and golden reference solutions.
  • Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively.
  • Develop realistic, reproducible software engineering scenarios.
  • Ensure tasks accurately measure coding ability, problem-solving, and tool usage.
  • Document solutions and provide clear technical feedback.

Required Skills

  • Strong proficiency in Python 3, Java, Rust, C++, or TypeScript.
  • Strong understanding of algorithms and data structures.
  • Experience with bug fixing and debugging complex software issues.
  • Proven experience in feature implementation and codebase refactoring.
  • Strong knowledge of performance optimization and tuning.
  • Excellent written and verbal communication.
  • Strong attention to detail.

Preferred Qualifications

  • Experience working with large-scale or distributed codebases.
  • Familiarity with AI/ML systems is a plus but not required.
  • Experience with rigorous code reviews and software engineering best practices.
  • Experience working effectively in remote or cross-functional teams.

Hiring Process

  1. Submit an application and screening questions.
  2. Complete an AI interview (~30 minutes).
  3. Complete a technical assessment, if required.
  4. Hiring Manager review.

Compensation

Compensation is output-based, with payment provided per task that meets project specifications. Minimum weekly submission requirements may apply.

Availability

Selected experts should be prepared to begin their first tasks within 24–48 hours of completing onboarding.