Talent.com
Outlier AI
AI Quality Engineer (Remote)Outlier AI • Kingston, Ontario, Canada
No longer accepting applications
AI Quality Engineer (Remote)

AI Quality Engineer (Remote)

Outlier AI • Kingston, Ontario, Canada
12 days ago
Job type
  • Full-time
  • Remote
Job description

About the Project

Outlier helps the world’s most innovative companies improve their AI agents by providing human feedback. Do you want to shape the future of autonomous agents like OpenClaw?

We collaborate with leading AI organizations to train Large Language Models (LLMs) to function as proactive, multi-step agents. Our projects focus on teaching these systems how to design, coordinate, and optimize complex, real-world architectural workflows.

Whether you are a passionate orchestration guru or experienced software developer — we want you to help us train the world's most advanced generative systems.

Ideal Qualifications

  • 2+ years of experience in backend engineering, AI automation, or complex systems integration.
  • Proven ability to build and maintain production-grade software with modular separation (e.g., distinct services for data parsing, logic processing, and reporting).
  • Strong command of at least two major languages (e.g., Python, JavaScript, Go, or Java) and experience working with SQL databases.
  • Practical experience building for live, non-mocked environments and handling multi-turn system interactions.
  • Outstanding attention to detail and the ability to provide clear, high-density technical feedback on complex system behaviors.

Nice to have

  • Expertise building multi-stage coordination tasks where data acquisition leads to reasoned output.
  • Hands-on experience integrating agents with live tools such as Supabase, Gmail, and various APIs to solve real-world problems.
  • High level of comfort implementing persistent state and session discovery using MEMORY.md to track agent progress.
  • Experience identifying subtle failures like privacy leaks, authority escalation, or indirect prompt injections.

Create a job alert for this search

AI Quality Engineer (Remote) • Kingston, Ontario, Canada

Similar jobs

Director of AI

People In AIkingston, on, ca
Full-time

Director, AI / ML (Applied AI & Agentic Systems).A scaled, product-led technology company operating at the intersection of data, AI, and vertical SaaS—focused on transforming how complex, real-worl... Show more

 • Promoted

Head of AI ($200K - $275K USD)

Ecom.jobskingston, on, ca
Full-time

Our client is an Ecommerce holding company.They're self-funded, which means no outside capital, no VC timeline, and no portfolio they're propping up for a fund.They operate what they own, move quic... Show more

 • Promoted

Senior/ Lead - AI Engineer

FICOkingston, on, ca
Full-time

As a Senior Engineer on our Applied AI team, you will be at the forefront of building AI-powered software that transforms how our platform operates.You will design, build, and maintain production-g... Show more

 • Promoted

Senior/ Lead - AI Engineer - FICO

FICOkingston, on, ca
Full-time

As a Senior Engineer on our Applied AI team, you will be at the forefront of building AI-powered software that transforms how our platform operates.You will design, build, and maintain production-g... Show more

 • Promoted

AI Research Engineer Contract at Huawei

Huawei CanadaKingston, Kingston, CA
Temporary

Join Huawei Canada as a Research Engineer focused on LLM Training & Alignment for a 12-month contract.Engage in transformative research to advance software engineering practices.The Centre for Soft... Show more

 • Promoted

Search Consultant - Remote - Berkner Group

Berkner Groupkingston, on, ca
Remote
Full-time

Berkner Group is a specialized search firm focused on building leadership and technical teams for companies across climate, deep tech, and other innovation-driven sectors.We work closely with found... Show more

 • Promoted

Head of AI ($200K - $275K USD) - Ecom.jobs

Ecom.jobskingston, on, ca
Full-time

Our client is an Ecommerce holding company.They're self-funded, which means no outside capital, no VC timeline, and no portfolio they're propping up for a fund.They operate what they own, move quic... Show more

 • Promoted

Research Engineer - LLM Training & Alignment Systems

Huawei Technologies Canada Co., Ltd.Kingston, Kingston, CA
Temporary

Huawei Canada has an immediate 12-month contract opening for a Research Engineer.The Centre for Software Excellence Lab conducts pioneering research in software engineering, focusing on next-genera... Show more

 • Promoted

Senior Consultant, AI - Konica Minolta Business Solutions Canada

Konica Minolta Business Solutions Canadakingston, on, ca
Full-time

Exciting Opportunity in Canada - Remote.Lead the design and implementation/delivery of AI solutions, AI Training, Adoption, or Assessments, ensuring alignment with customer objectives, adhering to ... Show more

 • Promoted

Search Consultant - Remote

Berkner Groupkingston, on, ca
Remote
Full-time

Berkner Group is a specialized search firm focused on building leadership and technical teams for companies across climate, deep tech, and other innovation-driven sectors.We work closely with found... Show more

 • Promoted

AI Agentic Developer

GSPANN Technologies, Inckingston, on, ca
Full-time

Headquartered in California, U.GSPANN is a leading provider of consulting and IT services to global clients.We specialize in helping clients transform their IT capabilities, optimize business pract... Show more

 • Promoted

AI Agentic Developer - GSPANN Technologies, Inc

GSPANN Technologies, Inckingston, on, ca
Full-time

Headquartered in California, U.GSPANN is a leading provider of consulting and IT services to global clients.We specialize in helping clients transform their IT capabilities, optimize business pract... Show more

 • Promoted

Research Engineer - LLM Evaluation Systems

Huawei Technologies Canada Co., Ltd.Kingston, Kingston, CA
Temporary

Join Huawei Canada as a Research Engineer focused on LLM evaluation and training systems within a 12-month contract.Lead the charge in research and prototyping for cutting-edge large-scale model de... Show more

 • Promoted

Senior/ Lead - AI Engineer - kingston

FICOkingston, on, ca
Full-time

As a Senior Engineer on our Applied AI team, you will be at the forefront of building AI-powered software that transforms how our platform operates.You will design, build, and maintain production-g... Show more

 • Promoted

Business Strategy Consultant | Remote | $80 –$120/hr

Call For Referralkingston, on, ca
Remote
Part-time

This role focuses on improving AI systems’ reasoning in business strategy, organizational design, and executive decision-making.The work involves applying real-world consulting expertise to evaluat... Show more

 • Promoted

Quality Improvement Research Associate Role

Queen's UniversityKingston, ON, CA
Full-time

Enhance your career with a unique role as a Quality Improvement Research Associate in the Family Medicine Department at Queen's University.Work on vital projects focusing on Quality Improvement and... Show more

 • Promoted

Senior Consultant, AI

Konica Minolta Business Solutions Canadakingston, on, ca
Full-time

Exciting Opportunity in Canada - Remote.Lead the design and implementation/delivery of AI solutions, AI Training, Adoption, or Assessments, ensuring alignment with customer objectives, adhering to ... Show more

 • Promoted

Director of AI - People In AI

People In AIkingston, on, ca
Full-time

Director, AI / ML (Applied AI & Agentic Systems).A scaled, product-led technology company operating at the intersection of data, AI, and vertical SaaS—focused on transforming how complex, real-worl... Show more

 • Promoted

Lead Generative AI Engineer - kingston

Inizio Partnerskingston, on, ca
Full-time

Role - Lead Generative AI Engineer.Location - Can be based anywhere in Canada.Travel - Should be open to frequent travel to client sites.We are looking for a Staff Generative AI Engineer to design,... Show more

 • Promoted

Research Engineer - LLM Training & Alignment Systems

Huawei CanadaKingston, Kingston, CA
Temporary

Huawei Canada has an immediate 12-month contract opening for a Research Engineer.The Centre for Software Excellence Lab conducts pioneering research in software engineering, focusing on next-genera... Show more