Talent.com
Outlier AI
AI Quality Engineer (Remote)Outlier AI • Winnipeg, Manitoba, Canada
No longer accepting applications
AI Quality Engineer (Remote)

AI Quality Engineer (Remote)

Outlier AI • Winnipeg, Manitoba, Canada
21 days ago
Job type
  • Full-time
  • Remote
Job description

About the Project

Outlier helps the world’s most innovative companies improve their AI agents by providing human feedback. Do you want to shape the future of autonomous agents like OpenClaw?

We collaborate with leading AI organizations to train Large Language Models (LLMs) to function as proactive, multi-step agents. Our projects focus on teaching these systems how to design, coordinate, and optimize complex, real-world architectural workflows.

Whether you are a passionate orchestration guru or experienced software developer — we want you to help us train the world's most advanced generative systems.

Ideal Qualifications

  • 2+ years of experience in backend engineering, AI automation, or complex systems integration.
  • Proven ability to build and maintain production-grade software with modular separation (e.g., distinct services for data parsing, logic processing, and reporting).
  • Strong command of at least two major languages (e.g., Python, JavaScript, Go, or Java) and experience working with SQL databases.
  • Practical experience building for live, non-mocked environments and handling multi-turn system interactions.
  • Outstanding attention to detail and the ability to provide clear, high-density technical feedback on complex system behaviors.

Nice to have

  • Expertise building multi-stage coordination tasks where data acquisition leads to reasoned output.
  • Hands-on experience integrating agents with live tools such as Supabase, Gmail, and various APIs to solve real-world problems.
  • High level of comfort implementing persistent state and session discovery using MEMORY.md to track agent progress.
  • Experience identifying subtle failures like privacy leaks, authority escalation, or indirect prompt injections.

Create a job alert for this search

AI Quality Engineer (Remote) • Winnipeg, Manitoba, Canada

Similar jobs

Senior QA Infrastructure Engineer - Remote AI Testing

StackAdapt Inc.Winnipeg, MB, CA
Remote
Full-time

A leading marketing technology firm is seeking a Senior Quality Engineer to lead the design and implementation of testing infrastructure projects in a remote-first environment.The ideal candidate w... Show more

 • Promoted

Remote Software Engineer – AI Trajectory Annotations

Weekday AI (YC W21)Winnipeg, MB, CA
Remote
Part-time

A leading AI consultancy is seeking experienced Software Engineers to assist in creating training datasets for AI models.This part-time role, based in Canada, demands a minimum of 2 years' experien... Show more

 • Promoted

AI Engineer

BioRenderWinnipeg, MB, CA
Full-time

At BioRender, we don’t settle for average, and neither should you.We’re building tools that transform how scientists communicate complex ideas, and we need someone who’s ready to turn ambitious ide... Show more

 • Promoted

Senior/ Lead - AI Engineer

FICOwinnipeg, mb, ca
Full-time

As a Senior Engineer on our Applied AI team, you will be at the forefront of building AI-powered software that transforms how our platform operates.You will design, build, and maintain production-g... Show more

 • Promoted

AI Agent Engineer: Deploy & Integrate (Remote UK)

CrestaWinnipeg, MB, CA
Remote
Full-time

A leading AI technology firm is seeking an AI Agent Engineer to develop state-of-the-art AI agents.The role involves deploying AI solutions, optimizing performance, and collaborating across teams t... Show more

 • Promoted

Remote Applied AI Engineer: Automation & LLMs

FusemachinesWinnipeg, MB, CA
Remote
Full-time

A leading AI services provider in Toronto is seeking an Applied AI Engineer(Automation) to create and deploy impactful AI solutions.This role involves collaborating with various stakeholders to int... Show more

 • Promoted

AI Engineer (Remote)

LumenaltaWinnipeg, MB, CA
Remote
Full-time

At Lumenalta, we partner with forward‑thinking organizations to build technology solutions that scale, delight users, and accelerate business growth.Our global teams bring curiosity, commitment, an... Show more

 • Promoted

Senior Product Engineer, AI Compliance Platform (Remote)

HRBWinnipeg, MB, CA
Remote
Full-time

A leading startup in the fintech space is looking for a Senior Product Engineer to design and implement event-driven and scalable systems.The ideal candidate will have deep architectural experience... Show more

 • Promoted

AI Engineer

NTT DATA North AmericaWinnipeg, MB, CA
Full-time

NTT DATA strives to hire exceptional, innovative, and passionate individuals who want to grow with us.We are an inclusive, adaptable, and forward‑thinking organization.We are seeking a highly motiv... Show more

 • Promoted

Expert Senior AI Engineer - Remote Role

NTT DATA, Inc.Winnipeg, MB, CA
Remote
Full-time

Make a difference in AI technology with NTT DATA as a Remote Senior AI Engineer from Toronto, Ontario.Focus on designing AI models and enhancing existing architectures for impactful solutions.As a ... Show more

 • Promoted

Senior AI & Automation Engineer - Data & Analytics (Remote)

GrafanaWinnipeg, MB, CA
Remote
Full-time

A leading tech company is seeking a Senior Software Engineer specializing in AI and automation.The successful candidate will develop AI-powered tools and workflows for Sales and Customer Success te... Show more

 • Promoted

Senior Applied AI Software Engineer Remote

Photonic Inc.Winnipeg, MB, CA
Remote
Full-time

Take the lead in AI innovation with Photonic as a Senior Applied AI Software Engineer.Work remotely in Canada to apply your AI expertise in the ambitious realm of quantum engineering.In this key ro... Show more

 • Promoted

Remote Research Engineer - Decentralized AI Systems

Yotta LabsWinnipeg, MB, CA
Remote
Full-time

A leading tech company is seeking a Research Engineer specializing in decentralized AI systems.The role involves designing efficient workload orchestration for AI applications across a global netwo... Show more

 • Promoted

Senior AI Engineer - Remote (Canada)

NTT DATA North AmericaWinnipeg, MB, CA
Remote
Full-time

A leading technology company is hiring an AI Engineer for a remote position in Canada.The role requires expertise in designing, developing, and deploying AI-driven solutions.Responsibilities includ... Show more

 • Promoted

Remote AI Data Quality & Evaluation Engineer

Veeva SystemsWinnipeg, MB, CA
Remote
Full-time

A leading cloud technology company in Toronto is seeking an experienced professional to validate and ensure the reliability of Veeva AI Agents.The ideal candidate should have expertise in data qual... Show more

 • Promoted

Remote AI Development Engineer Crafting Innovative Solutions

NTT Data Americas, Inc.Winnipeg, MB, CA
Remote
Full-time

Elevate your career as a Remote AI Development Engineer focused on cutting-edge AI solutions.Utilize your expertise in machine learning and data engineering to transform complex business challenges... Show more

 • Promoted

Remote AI Product Engineer Opportunity

Valsoft CorpWinnipeg, MB, CA
Remote
Full-time

Fluent Software Group is hiring an AI Product Engineer to accelerate idea implementation through rapid prototyping.This remote role emphasizes innovative AI solutions and flexible workflows.As an A... Show more

 • Promoted

AI Solutions Engineer - Remote Opportunity

Yeah! GlobalWinnipeg, MB, CA
Remote
Full-time

Elevate your career as an AI Solutions Engineer with a remote role for a California-based client.Focus on designing and launching innovative AI initiatives that drive business success.We're buildin... Show more

 • Promoted

Remote Senior Solutions Engineer — Enterprise AI & Risk

GatekeeperWinnipeg, MB, CA
Remote
Full-time

A technology company is seeking an experienced Senior Solutions Engineer for a fully remote role in Canada.The selected candidate will be responsible for leading enterprise customer implementations... Show more

 • Promoted

Innovative Analytics Engineer Driving AI and Data Quality Standards

Luxury PresenceWinnipeg, MB, CA
Full-time

Take charge as a Staff Analytics Engineer, building AI systems that enhance how teams utilize data.Collaborate with teams to define metrics, ensuring data quality and creating impactful insights fo... Show more