Talent.com

Software testing Jobs in Longueuil, QC

Create a job alert for this search

Software testing • longueuil qc

Last updated: 5 hours ago

QA Lead — AI Systems & Models Testing

Jay AnalytixMontreal, Quebec, Canada
Full-timeFull-time

QA Lead — AI Systems & Models Testing.Quality Assurance  •  Artificial Intelligence  •  Contract Position.We are seeking an experienced QA Lead with deep expertise in AI sys... Show more

Developer, software

Solution Meriatek IncMontréal, QC, Canada
Full-time +1Full-time +1

Write, modify, integrate and test software code.Maintain existing computer programs by making modifications as required.Communicate technical problems, processes and solutions.Prepare reports, manu... Show more

Senior Software Engineer

Motion RecruitmentMontreal, Quebec, Canada
Full-timeFull-time

We’re working with a wearable technology company in Montreal with a strong mission.They are currently looking to add a Senior Software Engineer to their team with a background in C/C++.This is a fu... Show more

Software Development Manager

Tecsys Inc.Montreal, QC, CA
Full-timeFull-time
Quick Apply

Having recognized the advantages of remote work, such as improved employee morale, increased productivity, and positive impacts on both employee wellbeing and the environment, we are proud to be a ... Show more

Online Product Testing - $25-$45 Per Hour

OCPALa Prairie, Quebec, CA
CA$25.00–CA$45.00 hourlyCA$25.00–CA$45.00 hourly
Part-time +1Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

Software Engineer

L3Harris TechnologiesMontreal, Quebec
CA$62,500.00–CA$112,500.00 yearlyCA$62,500.00–CA$112,500.00 yearly
Full-timeFull-time

L3Harris is dedicated to recruiting and developing high-performing talent who are passionate about what they do.Our employees are unified in a shared dedication to our customers’ mission and quest ... Show more

Online Product Testing - $25-$45 Per Hour

OCPAMontreal, Quebec, CA
CA$25.00–CA$45.00 hourlyCA$25.00–CA$45.00 hourly
Part-time +1Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

Software Developer

Royal Bank of CanadaMONTRÉAL, Quebec, Canada
Full-timeFull-time

We are looking for a top-notch, driven, Software Developer who is a great team player and passionate about the quality of their code.As a Software Developer, you will be contributing to the technic... Show more

Senior Software Developer, Backend

DialogueMontréal, Quebec, Canada, H3A 3G3
CA$118,530.00–CA$138,285.00 yearlyCA$118,530.00–CA$138,285.00 yearly
Full-timeFull-time
Quick Apply

Dialogue is the #1 virtual care provider in Canada.Integrated Health Platform🅫, we provide exceptional online health and wellness programs (primary care, mental health, iCBT, EAP, and wellness) to... Show more

Software Developer

Botpress Technologies Inc.Montreal, QC, CA
Full-timeFull-time
Quick Apply

Help redefine customer support for the AI era.Most companies are running support on ticketing systems built in 2007, with AI bolted on as an afterthought.Botpress is the enterprise-grade AI agent p... Show more

Software Engineer – MLOPS

UbisoftMontreal, Québec, Canada
Full-timeFull-time

As a Machine Learning Operations Software Engineer at Ubisoft Montréal, you will help build.Ubisoft’s Data Office, whose mission is to use data to support players throughout their journey in a safe... Show more

AI Software Engineer - Remote

YO AI LabsMontréal, QC, Canada
RemoteRemote
Full-timeFull-time
Quick Apply

AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using.You will design reproducible environments, deterministic veri... Show more

Developpeur logiciel pour systemes d'essai moteurs | Software Developer for Engine Testing Systems

Raytheon TechnologiesCA-QC-LONGUEUIL-J ~ Blvd Marie-Victorin ~ J BLDG
Full-timeFull-time

CA-QC-LONGUEUIL-J01 ~ 1000 Blvd Marie-Victorin ~ J01 BLDG.Développeur logiciel pour systèmes d'essais moteurs.À propos de Pratt & Whitney Canada.Pratt & Whitney Canada (P&WC) est un leader mondial ... Show more

Senior Testing Officer/Auditor

Randstad CanadaMontréal, Quebec, CA
CA$40.00 hourlyCA$40.00 hourly
Permanent +1Permanent +1
Quick Apply

Are you looking to elevate your career? Join a prestigious global financial institution in Montreal as a Senior Testing Officer/Auditort! In this key contract role, you will shape regional complian... Show more

Online Product Testing - $25-$45 Per Hour

OCPAWestmount, Quebec, CA
CA$25.00–CA$45.00 hourlyCA$25.00–CA$45.00 hourly
Part-time +1Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

Software Engineer III

Trane TechnologiesMontreal, Quebec, Canada
Full-timeFull-time

Be a part of our mission! As a world leader in creating comfortable, sustainable, and efficient climate solutions for buildings, homes and transportation, it's our responsibility to put the planet ... Show more

 • Promoted

Embedded Software Developer

ScalianMontreal, Canada
Full-timeFull-time

The main function of an embedded software developer is to document and implement complex flight software modules for various space applications including communications and satellites.Support devel... Show more

 • New!

Senior Software Developer

FundicaMontreal, Quebec, Canada
Full-timeFull-time

Canada's most award-winning online funding tool -- a search engine for all funding programs in Canada.The platform matches entrepreneurs, private investors, public funders and advisors, through a u... Show more

Full Stack Software Developer

Engineered Arts LLCMontreal, Quebec, Canada, H3A 0A8
Full-timeFull-time
Quick Apply

Engineered Arts is the leading manufacturer of full-size humanoid robots used for entertainment, education and communication.With 20 years of hardware and software development, our robots have been... Show more

QA Lead — AI Systems & Models Testing

QA Lead — AI Systems & Models Testing

Jay AnalytixMontreal, Quebec, Canada
30+ days ago
Job type
  • Full-time
Job description

QA Lead — AI Systems & Models Testing

Quality Assurance • Artificial Intelligence • Contract Position

Contract

Montreal, QC

AI / ML Testing

LLM / RAG / LangChain

ABOUT THE ROLE

We are seeking an experienced QA Lead with deep expertise in AI systems testing to join our team on a contract basis in Montreal, Québec. This role sits at the intersection of quality engineering and artificial intelligence, requiring hands-on proficiency in LLM behavior analysis, RAG pipeline validation, and modern AI orchestration frameworks. You will own the end-to-end test strategy for complex AI products and help define quality standards in a rapidly evolving space.

MUST-HAVE SKILLS

  • Proven QA leadership experience designing and executing test strategies for AI/ML systems or LLM-powered applications.
  • Strong understanding of LLM internals: tokenization, embeddings, attention mechanisms, and inference behavior to anticipate and diagnose failure modes.
  • Hands-on experience with prompt engineering — constructing effective prompts, detecting hallucinations, and evaluating outputs across accuracy, tone, coherence, and bias dimensions.
  • Experience testing RAG pipelines and knowledge base integrations, including validation of data quality and retrieval accuracy as they impact model outputs.
  • Familiarity with vector database mechanics: similarity search thresholds, embedding drift, near-duplicate documents, and sparse vs. dense embeddings.
  • Practical experience with LangChain and/or LangGraph — able to read chain/graph construction code, identify failure points, and write test harnesses.
  • Ability to validate MCP (Model Context Protocol) integration points, including tool availability and error-handling scenarios.
  • Proficiency applying generative AI evaluation metrics and establishing quality thresholds appropriate for production AI systems.
  • Excellent written and verbal communication in English; bilingualism (English/French) is a plus for the Montreal market.

NICE-TO-HAVE SKILLS

  • Experience with bias detection and safety testing frameworks for AI systems.
  • Exposure to performance and scalability testing of vector databases under high load.
  • Familiarity with CI/CD pipelines for ML model deployment and automated regression testing.
  • Knowledge of responsible AI principles and AI governance frameworks.
  • Contributions to or experience with open-source AI testing or evaluation tooling (e.g., DeepEval, Ragas, PromptFlow).
  • Background in data engineering or data quality practices relevant to AI pipeline inputs.
  • Cloud platform experience (AWS, Azure, or GCP) in the context of deploying or testing AI workloads.

KEY RESPONSIBILITIES

  • Lead design and execution of comprehensive test strategies across AI systems, including prompt evaluation, output quality assessment, and bias/safety analysis.
  • Develop and maintain test harnesses for LangChain and LangGraph-based applications; review chain and graph construction code to proactively surface integration risks.
  • Validate RAG pipeline integrity — data ingestion, chunking, retrieval accuracy, and embedding consistency — and define edge-case coverage for vector database interactions.
  • Establish and track generative AI quality metrics and thresholds; report on model output quality across multiple evaluation dimensions.
  • Collaborate with ML engineers, data scientists, and product teams to embed quality practices throughout the AI development lifecycle.
  • Document test findings clearly for both technical and non-technical stakeholders.

Contract position based in Montreal, Québec, Canada • On-site / Hybrid