Talent.com
Outlier AI
AI Quality Engineer (Remote)Outlier AI • Halifax, Nova Scotia, Canada
No longer accepting applications
AI Quality Engineer (Remote)

AI Quality Engineer (Remote)

Outlier AI • Halifax, Nova Scotia, Canada
2 days ago
Job type
  • Full-time
  • Remote
Job description

About the Project

Outlier helps the world’s most innovative companies improve their AI agents by providing human feedback. Do you want to shape the future of autonomous agents like OpenClaw?

We collaborate with leading AI organizations to train Large Language Models (LLMs) to function as proactive, multi-step agents. Our projects focus on teaching these systems how to design, coordinate, and optimize complex, real-world architectural workflows.

Whether you are a passionate orchestration guru or experienced software developer — we want you to help us train the world's most advanced generative systems.

Ideal Qualifications

  • 2+ years of experience in backend engineering, AI automation, or complex systems integration.
  • Proven ability to build and maintain production-grade software with modular separation (e.g., distinct services for data parsing, logic processing, and reporting).
  • Strong command of at least two major languages (e.g., Python, JavaScript, Go, or Java) and experience working with SQL databases.
  • Practical experience building for live, non-mocked environments and handling multi-turn system interactions.
  • Outstanding attention to detail and the ability to provide clear, high-density technical feedback on complex system behaviors.

Nice to have

  • Expertise building multi-stage coordination tasks where data acquisition leads to reasoned output.
  • Hands-on experience integrating agents with live tools such as Supabase, Gmail, and various APIs to solve real-world problems.
  • High level of comfort implementing persistent state and session discovery using MEMORY.md to track agent progress.
  • Experience identifying subtle failures like privacy leaks, authority escalation, or indirect prompt injections.

Create a job alert for this search

AI Quality Engineer (Remote) • Halifax, Nova Scotia, Canada

Similar jobs

AI Engineer

BDO CanadaHalifax, Nova Scotia, Canada
Full-time

Putting people first, every day.BDO is a firm built on a foundation of positive relationships with our people and our clients.Each day, our professionals provide exceptional service, helping client... Show more

 • Promoted

Ai Engineer

BDO CanadaHalifax, Canada
Full-time

Putting people first, every day BDO is a firm built on a foundation of positive relationships with our people and our clients.Each day, our professionals provide exceptional service, helping client... Show more

 • Promoted

AI Integration Engineer

RBCHalifax, Nova Scotia, Canada
Full-time

What is the opportunity? RBC Capital Markets is a leading global investment banking company dedicated to providing banking, finance, and capital markets services to corporations, institutional inve... Show more

 • Promoted

Lead Generative AI Engineer

Inizio Partnershalifax, ns, ca
Full-time

Role - Lead Generative AI Engineer.Location - Can be based anywhere in Canada.Travel - Should be open to frequent travel to client sites.We are looking for a Staff Generative AI Engineer to design,... Show more

 • Promoted

Design Automation Specialist with AI Insights

StantecDartmouth, NS, CA
Full-time

Lead automation initiatives and enhance design delivery as a Design Automation Specialist.Apply expertise in software development and AI-assisted solutions to streamline workflows in project enviro... Show more

 • Promoted

Online Data Analyst - Odia Speakers (Remote)

TELUS Digital AI Data SolutionsNS, CA
Remote
Full-time

Online Data Analyst - Odia Speakers (Remote).Remote opportunity with TELUS Digital AI Data Solutions.Join us in enhancing digital maps used worldwide.Conduct research and evaluation tasks in a web-... Show more

 • Promoted

Senior AI Engineer

MPA RecruitmentHalifax, Nova Scotia, Canada
Full-time

As a Senior AI Engineer, you will deliver advanced AI solutions leveraging state-of-the‑art machine learning, generative and agentic AI technologies.You will drive the adoption of modern AI framewo... Show more

 • Promoted

Director of AI

People In AIdartmouth, ns, ca
Full-time

Director, AI / ML (Applied AI & Agentic Systems).A scaled, product-led technology company operating at the intersection of data, AI, and vertical SaaS—focused on transforming how complex, real-worl... Show more

 • Promoted

DevOps Engineer (AI)

Affinitydartmouth, ns, ca
Full-time

Client: Enterprise class EMR provider.On behalf of our client, Affinity is seeking a DevOps Engineer to build and evolve the infrastructure behind its flagship EMR platform.You’ll own Kubernetes-ba... Show more

 • Promoted

Remote Physics Content Developer for AI Training

DataAnnotationNS, CA
Remote
Full-time

An innovative company is seeking a physics expert for a remote Content Developer role.This position involves training AI models by providing complex physics problems and evaluating their logic.Cand... Show more

 • Promoted

Principal AI Engineer

Workerbeehalifax, ns, ca
Permanent

No C2C or third-party submissions.Workerbee connects workers with employers through trusted introductions.By joining Workerbee you can be matched for project-based, contract, or permanent opportuni... Show more

 • Promoted

AI Optimization Engineer for HPC Systems

A*STAR ResearchDartmouth, NS, CA
Full-time

Step into a vital role as an AI Optimization Engineer for HPC Systems.Focus on maximizing research efficiency by refining AI workflows within a high-performance computing environment.In this positi... Show more

 • Promoted

Full-Stack Cloud & AI Engineer

IBMBedford, NS, CA
Full-time

A leading technology company in Bedford, Nova Scotia seeks an experienced application developer.You'll design, code, and test innovative solutions, troubleshoot issues, and gain certifications in c... Show more

 • Promoted

Remote Search Quality Evaluator

TELUS DigitalNS, CA
Remote
Part-time

A leading technology firm in Canada is seeking a Personalized Internet Assessor to analyze and provide feedback on various information types for top search engines.This part-time, freelance role al... Show more

 • Promoted

Generative AI Developer – Retail/CPG Domain

Comprehensive Resources Incdartmouth, ns, ca
Full-time

Generative AI Developer (Retail/CPG).Seeking a GenAI Developer with expertise in LLMs, RAG, and prompt engineering.Build scalable AI solutions using Python, LangChain, HuggingFace, and vector DBs l... Show more

 • Promoted

Senior Consultant, AI

Konica Minolta Business Solutions Canadadartmouth, ns, ca
Full-time

Exciting Opportunity in Canada - Remote.Lead the design and implementation/delivery of AI solutions, AI Training, Adoption, or Assessments, ensuring alignment with customer objectives, adhering to ... Show more

 • Promoted

AI Engineer

NTT DATA North AmericaHalifax, Halifax County, Canada
Full-time

NTT DATA strives to hire exceptional, innovative, and passionate individuals who want to grow with us.We are an inclusive, adaptable, and forward‑thinking organization.We are seeking a highly motiv... Show more

 • Promoted

Ai Engineer

NTT DATA North AmericaHalifax, Canada
Full-time

Company OverviewNTT DATA strives to hire exceptional, innovative, and passionate individuals who want to grow with us.We are an inclusive, adaptable, and forward‐thinking organization.PositionAI En... Show more

 • Promoted

Agentic AI Architect

Inizio Partnershalifax, ns, ca
Full-time

This role can be based in US or Canada - EST working hours.Role & Responsibilities Overview:.Architecture & Technical Leadership.Define end-to-end architecture for agentic AI-enabled platform acros... Show more

 • Promoted

Remote Data Analyst: Digital Maps & Research

TELUS Digital AI Data SolutionsNS, CA
Remote
Full-time

A leading digital AI solutions company is seeking an Online Data Analyst for a remote role in Canada.You will enhance digital maps and complete research tasks in a web-based environment.Ideal candi... Show more