Talent.com

Software testing Jobs in Saint-Laurent, QC

Create a job alert for this search

Software testing • saint laurent qc

Last updated: 12 hours ago

QA Lead — AI Systems & Models Testing

jay analytixMontreal, Quebec, Canada
Full-time

QA Lead — AI Systems & Models Testing.Quality Assurance  •  Artificial Intelligence  •  Contract Position.We are seeking an experienced QA Lead with deep expertise in AI sys... Show more

Developer, software

solution meriatekMontréal, QC, Canada
Full-time +1

Write, modify, integrate and test software code.Maintain existing computer programs by making modifications as required.Communicate technical problems, processes and solutions.Prepare reports, manu... Show more

Senior Software Engineer

motion recruitmentMontreal, Quebec, Canada
Full-time

We’re working with a wearable technology company in Montreal with a strong mission.They are currently looking to add a Senior Software Engineer to their team with a background in C/C++.This is a fu... Show more

Online Product Testing - $25-$45 Per Hour

ocpaMont-Royal, Quebec, CA
CA$25.00–CA$45.00 hourly
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

Software Development Manager

tecsysMontreal, QC, CA
Full-time
Quick Apply

Having recognized the advantages of remote work, such as improved employee morale, increased productivity, and positive impacts on both employee wellbeing and the environment, we are proud to be a ... Show more

Inside Sales Representative - Software

schneider electricMontréal, Canada
CA$81.00 hourly
Full-time

Schneider Electric is seeking a motivated and customer-focused Inside Sales Representative (ISR) to support the growth of our Secure Power Software portfolio across Canada.This is an excellent oppo... Show more

Senior Software Engineer

bbgcMontreal, QC, CA
Full-time
Quick Apply

We are seeking an experienced Senior Developer to support the implementation, optimisation, and transformation of Power Platform initiatives.The role requires deep understanding of the solution and... Show more

Software Developer

botpress technologiesMontreal, QC, CA
Full-time
Quick Apply

Help redefine customer support for the AI era.Most companies are running support on ticketing systems built in 2007, with AI bolted on as an afterthought.Botpress is the enterprise-grade AI agent p... Show more

Software Developer

sap it business systemeMontreal, Canada
Full-time +1

We are looking for a dynamic and motivated Software Developer who embrace AI-assisted software development as part of their everyday engineering practice to join our engineering team.The SAP Custom... Show more

 • New!

Software Engineer – MLOPS

ubisoftMontreal, Québec, Canada
Full-time

As a Machine Learning Operations Software Engineer at Ubisoft Montréal, you will help build.Ubisoft’s Data Office, whose mission is to use data to support players throughout their journey in a safe... Show more

C++ Software Developer

aversanSt-Laurent, Quebec, Canada
CA$100,000.00–CA$130,000.00 yearly
Full-time

Aversan delivers leading-edge and reliable safety-critical electronics and software systems to the aerospace, defence, and space industries.We are currently seeking a qualified.Participate in the d... Show more

Full Stack Software Developer

lancesoftMontreal, QC, CA
CA$65.52–CA$80.00 hourly
Full-time
Quick Apply

Job Title: Full Stack Software Developer.Location: Montreal (day 1 onboarding onsite / in-office presence required 3x/week).Years of experience: up to 7 years.The ideal candidate should be a self-d... Show more

 • New!

Senior Testing Officer/Auditor

randstad canadaMontréal, Quebec, CA
CA$40.00 hourly
Permanent +1
Quick Apply

Are you looking to elevate your career? Join a prestigious global financial institution in Montreal as a Senior Testing Officer/Auditort! In this key contract role, you will shape regional complian... Show more

QA Engineer – Performance & Automation Testing

astra north infoteckLaval, Qc
Full-time

QA Engineer – Performance & Automation Testing.Montreal, QC - Onsite (5 Days WFO).Contribute to DevOps automation and improvements.Evolve/Build Integration and System test suites with latest fe... Show more

Online Product Testing - $25-$45 Per Hour

ocpaWestmount, Quebec, CA
CA$25.00–CA$45.00 hourly
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

Developer, software

gameloftMontréal, QC, Canada
Full-time +1

Do you have experience working in this field?.Heures de travail: 36 hours per week. Show more

Senior Software Developer

fundicaMontreal, Quebec, Canada
Full-time

Canada's most award-winning online funding tool -- a search engine for all funding programs in Canada.The platform matches entrepreneurs, private investors, public funders and advisors, through a u... Show more

Software Engineer III

trane technologiesMontreal, Quebec, Canada
Full-time

Be a part of our mission! As a world leader in creating comfortable, sustainable, and efficient climate solutions for buildings, homes and transportation, it's our responsibility to put the planet ... Show more

 • Promoted

Full Stack Software Developer

engineered artsMontreal, Quebec, Canada, H3A 0A8
Full-time
Quick Apply

Engineered Arts is the leading manufacturer of full-size humanoid robots used for entertainment, education and communication.With 20 years of hardware and software development, our robots have been... Show more

Senior Software Engineer (Infrastructure)

motionMontréal, QC, CA
Full-time +1

AI-native platform that bridges the gap between performance marketers and creative teams, so they can uncover what’s working, what’s not, and ship more winning ads across platforms like YouTube, Li... Show more

QA Lead — AI Systems & Models Testing

QA Lead — AI Systems & Models Testing

jay analytixMontreal, Quebec, Canada
30+ days ago
Job type
  • Full-time
Job description

QA Lead — AI Systems & Models Testing

Quality Assurance • Artificial Intelligence • Contract Position

Contract

Montreal, QC

AI / ML Testing

LLM / RAG / LangChain

ABOUT THE ROLE

We are seeking an experienced QA Lead with deep expertise in AI systems testing to join our team on a contract basis in Montreal, Québec. This role sits at the intersection of quality engineering and artificial intelligence, requiring hands-on proficiency in LLM behavior analysis, RAG pipeline validation, and modern AI orchestration frameworks. You will own the end-to-end test strategy for complex AI products and help define quality standards in a rapidly evolving space.

MUST-HAVE SKILLS

  • Proven QA leadership experience designing and executing test strategies for AI/ML systems or LLM-powered applications.
  • Strong understanding of LLM internals: tokenization, embeddings, attention mechanisms, and inference behavior to anticipate and diagnose failure modes.
  • Hands-on experience with prompt engineering — constructing effective prompts, detecting hallucinations, and evaluating outputs across accuracy, tone, coherence, and bias dimensions.
  • Experience testing RAG pipelines and knowledge base integrations, including validation of data quality and retrieval accuracy as they impact model outputs.
  • Familiarity with vector database mechanics: similarity search thresholds, embedding drift, near-duplicate documents, and sparse vs. dense embeddings.
  • Practical experience with LangChain and/or LangGraph — able to read chain/graph construction code, identify failure points, and write test harnesses.
  • Ability to validate MCP (Model Context Protocol) integration points, including tool availability and error-handling scenarios.
  • Proficiency applying generative AI evaluation metrics and establishing quality thresholds appropriate for production AI systems.
  • Excellent written and verbal communication in English; bilingualism (English/French) is a plus for the Montreal market.

NICE-TO-HAVE SKILLS

  • Experience with bias detection and safety testing frameworks for AI systems.
  • Exposure to performance and scalability testing of vector databases under high load.
  • Familiarity with CI/CD pipelines for ML model deployment and automated regression testing.
  • Knowledge of responsible AI principles and AI governance frameworks.
  • Contributions to or experience with open-source AI testing or evaluation tooling (e.g., DeepEval, Ragas, PromptFlow).
  • Background in data engineering or data quality practices relevant to AI pipeline inputs.
  • Cloud platform experience (AWS, Azure, or GCP) in the context of deploying or testing AI workloads.

KEY RESPONSIBILITIES

  • Lead design and execution of comprehensive test strategies across AI systems, including prompt evaluation, output quality assessment, and bias/safety analysis.
  • Develop and maintain test harnesses for LangChain and LangGraph-based applications; review chain and graph construction code to proactively surface integration risks.
  • Validate RAG pipeline integrity — data ingestion, chunking, retrieval accuracy, and embedding consistency — and define edge-case coverage for vector database interactions.
  • Establish and track generative AI quality metrics and thresholds; report on model output quality across multiple evaluation dimensions.
  • Collaborate with ML engineers, data scientists, and product teams to embed quality practices throughout the AI development lifecycle.
  • Document test findings clearly for both technical and non-technical stakeholders.

Contract position based in Montreal, Québec, Canada • On-site / Hybrid