Talent.com
United Software Group Inc
QA Engineer (AI)United Software Group Inc • Montreal, QC, Canada
QA Engineer (AI)

QA Engineer (AI)

United Software Group Inc • Montreal, QC, Canada
Il y a 6 jours
Type de contrat
  • Temps plein
  • Quick Apply
Description de poste

QA Engineer (AI)

Location: Montreal, QC (4 Days Onsite/Week)
Interview: Face-to-Face Required
Employment Type: Contract

Job Summary

We are looking for an experienced QA Engineer (AI) to lead testing initiatives for AI/LLM-powered applications. The ideal candidate will have expertise in Generative AI testing, RAG pipelines, prompt engineering, automation, and API testing, along with strong experience in QA automation and enterprise application testing.

Key Responsibilities

  • Design and execute comprehensive test strategies for AI/LLM applications.
  • Validate prompt quality, hallucination detection, bias, safety, and response accuracy.
  • Test Retrieval-Augmented Generation (RAG) pipelines, vector databases, embeddings, and retrieval accuracy.
  • Build and maintain automated test frameworks using Python and Java.
  • Perform API, integration, regression, functional, and performance testing.
  • Validate LangChain/LangGraph workflows and AI agent integrations.
  • Collaborate with developers, product owners, and business stakeholders.
  • Lead defect triage, quality reporting, and production support.
  • Mentor QA team members and promote QA best practices.

Required Skills

  • 7+ years of QA/Quality Engineering experience.
  • 3+ years in a Senior or Lead QA role.
  • Strong experience with:
    • AI/LLM Testing
    • Prompt Engineering
    • Hallucination & Bias Testing
    • RAG Testing
    • Vector Databases
    • LangChain / LangGraph
    • Python & Java
    • API Automation
    • Selenium, Playwright, Robot Framework, or similar
    • CI/CD (Jenkins, GitHub, etc.)
  • Experience with SQL, database validation, and reconciliation testing.
  • Knowledge of LLM architecture, embeddings, tokenization, and inference.

Preferred Skills

  • Model Context Protocol (MCP).
  • AI Safety, Red Teaming, and Responsible AI testing.
  • Capital Markets or Securitization domain experience.
  • DevOps and cloud-based testing.
  • Agile/Scrum methodologies.

eye

Créer une alerte emploi pour cette recherche

QA Engineer (AI) • Montreal, QC, Canada

Offres similaires

AI Engineer

BioRenderMontreal (administrative region), QC, CA
Temps plein

At BioRender, we don’t settle for average, and neither should you.We’re building tools that transform how scientists communicate complex ideas, and we need someone who’s ready to turn ambitious ide... Voir plus

 • Offre sponsorisée

Expert Senior AI Engineer - Remote Role

NTT DATA, Inc.Montreal (administrative region), QC, CA
Télétravail
Temps plein

Make a difference in AI technology with NTT DATA as a Remote Senior AI Engineer from Toronto, Ontario.Focus on designing AI models and enhancing existing architectures for impactful solutions.As a ... Voir plus

 • Offre sponsorisée

Solutions Engineer for Gatekeeper's AI Platform

GatekeeperMontreal (administrative region), QC, CA
Temps plein

Join Gatekeeper to empower compliance-driven organizations as a Solutions Engineer specializing in customer success.This fully remote role allows you to help clients leverage innovative AI features... Voir plus

 • Offre sponsorisée

Senior QA Automation Engineer – 100% Remote *Completed*

Corporate Recruiters Ltd.Montreal (administrative region), QC, CA
Télétravail
Temporaire

Our client develops advanced (including AI) based software for scheduling complex operations.They offer an entrepreneurial and dynamic environment that emphasizes delivering innovative and quality ... Voir plus

 • Offre sponsorisée

Remote Kotlin QA Engineer & AI Trainer (Freelance)

MindriftMontreal (administrative region), QC, CA
Télétravail
Temps plein

A forward-thinking tech company seeks a Freelance Software Developer skilled in Kotlin and iOS development.This remote role offers flexibility, with responsibilities including designing automated t... Voir plus

 • Offre sponsorisée

Senior QA Infrastructure Engineer - Remote AI Testing

StackAdapt Inc.Montreal (administrative region), QC, CA
Télétravail
Temps plein

A leading marketing technology firm is seeking a Senior Quality Engineer to lead the design and implementation of testing infrastructure projects in a remote-first environment.The ideal candidate w... Voir plus

 • Offre sponsorisée

QA Automation Engineer - Trading Platform

Evolvic Inc.Montreal (administrative region), QC, CA
Temporaire

A leading software development company in Montreal seeks a QA Analyst to enhance software quality for the Orchestrade application.The role involves executing test campaigns, improving test processe... Voir plus

 • Offre sponsorisée

AI Enablement Engineer - AI Tools & Agents (Equity)

BasetenMontreal
Temps plein

A leading AI platform company in Montreal is looking for an AI Enablement Engineer.This role involves building and integrating AI tools that enhance productivity for engineering workflows.The ideal... Voir plus

 • Offre sponsorisée

Senior QA Automation Engineer - Web & Mobile

GreenShieldMontreal (administrative region), QC, CA
Temps plein

A not-for-profit health benefits provider in Montreal is seeking a highly skilled QA Automation Engineer III.The role involves designing and maintaining test automation frameworks for web and mobil... Voir plus

 • Offre sponsorisée

Forward Deployed AI Engineer, Canada - BCG X

BCG XMontreal (administrative region), QC, CA
Permanent

Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities.BCG was the pioneer in business strategy whe... Voir plus

 • Offre sponsorisée

Contract Software Engineer Specializing in Advanced AI Techniques

TuringMontreal (administrative region), QC, CA
Temps plein

Embrace an exciting challenge as a Software Engineer specializing in AI.Collaborate with teams in a remote setting to elevate AI code quality and efficiency.You will be responsible for applying you... Voir plus

 • Offre sponsorisée

Senior/ Lead - AI Engineer

FICOsaint-esprit, qc, ca
Temps plein

As a Senior Engineer on our Applied AI team, you will be at the forefront of building AI-powered software that transforms how our platform operates.You will design, build, and maintain production-g... Voir plus

 • Offre sponsorisée

Applied AI Engineer

Simpro SoftwareMontreal (administrative region), QC, CA
Temps plein

Le Applied AI Software Engineer sera responsable de la conception technique rapide et de la livraison d'agents et de cadres d'IA construits sur les SIMPRO FSM.En étroite collaboration avec le dépar... Voir plus

 • Offre sponsorisée

QA Automation Engineer - Pre-Trade Capital Markets

QUANTEAM - North America (RAINBOW PARTNERS Group)Montreal
Temps plein

A leading financial technology firm in Montreal is seeking an Associate to manage the testing and support of Sales applications used in capital markets.The ideal candidate will have strong skills i... Voir plus

 • Offre sponsorisée

Innovative AI Engineer – Pulsora Canada

PulsoraMontreal (administrative region), QC, CA
Temps plein

Leverage your AI expertise at Pulsora as a Remote Engineer focused on developing impactful AI applications.This full-time role prioritizes cutting-edge technology for sustainability efforts.As part... Voir plus

 • Offre sponsorisée

Lead Software Engineer - AI and SaaS

Human AgencyMontreal (administrative region), QC, CA
Temps plein

Take the lead as a Software Engineer, specializing in AI and SaaS application development.Tackle backend and frontend challenges while driving innovative solutions for complex enterprise problems.I... Voir plus

 • Offre sponsorisée

Senior ML Engineer, AI Governance – Remote Canada

OptroMontreal (administrative region), QC, CA
Télétravail
Temps plein

A leading SaaS company based in Canada is seeking a Machine Learning Engineer to innovate risk management solutions using cutting-edge AI techniques.Your role involves developing product features, ... Voir plus

 • Offre sponsorisée

Dynamic AI Agent Engineer Delivering Real-World Solutions

CrestaMontreal (administrative region), QC, CA
Temps plein

Be at the forefront of AI technology by developing innovative agents that drive business efficiency and enhance customer satisfaction.In this role, leverage your skills to implement AI solutions th... Voir plus

 • Offre sponsorisée

Applied AI Engineer

Norbert HealthMontreal (administrative region), QC, CA
Temps plein

Norbert is building autonomous robots that deliver healthcare.Our AI sensing platform enables existing robotic platforms to become care team members: rounding on patients, capturing vitals without ... Voir plus

 • Offre sponsorisée

Remote Senior QA Automation Engineer

RELQ TECHNOLOGIESMontreal (administrative region), QC, CA
Télétravail
Temps plein

A leading technology firm in Canada is seeking a skilled Sr.QA Automation Engineer to design and maintain automated test frameworks.This role requires collaboration with developers and product team... Voir plus