Intermediate AI Software Quality Assurance (QA)

About Delta Intelligent Building Technologies (Canada) Inc. (formerly known as Delta Controls)

Delta Intelligent Building Technologies (Canada) Inc. is a leading building controls manufacturer. For over three decades, we have provided innovative building automation solutions for commercial, healthcare, education, and leisure facilities.

Job Summary

We are seeking an Intermediate AI Software QA to ensure the reliability of our AI-driven platforms.

In this role, you will test multi-agent, LLM-based services, validate retrieval and embedding pipelines, and work with AWS Bedrock and serverless integrations, while building Python-based automated backend tests. You will collaborate with developers on quality criteria, troubleshoot APIs and cloud infrastructure, and contribute to test and release documentation.

Responsibilities

• Develop and maintain test plans for multi-agent, LLM-driven features and workflows
• Design and execute functional, integration, end-to-end, and regression tests for cloud-based AI services
• Validate retrieval pipelines, embeddings, knowledge-base updates, and AWS Bedrock/serverless integrations
• Build automated test suites (Python preferred) for backend workflows and microservices
• Collaborate with developers to define quality criteria, ensure testability, and troubleshoot APIs, agents, and cloud infrastructure
• Contribute to documentation for test cases, quality processes, and release readiness

Required Skills / Qualification

• 3+ years of QA or software engineering experience
• Strong proficiency in Python scripting and experience working with BDD frameworks and tools including Pytest-BDD, Playwright, and Gherkin (or similar)
• Experience with LLMs, model inference workflows, or prompt evaluation
• Familiarity with RAG concepts, retrieval pipelines, embeddings, or vector search
• Strong analytical thinker with excellent attention to detail
• Clear communicator, comfortable working independently
• Cloud Experience (Asset): Exposure to AWS Lambda or serverless applications, experience testing services integrated with AWS Bedrock, familiarity with cloud databases such as DynamoDB or Aurora, knowledge of S3, CloudWatch, IAM, and distributed service debugging; experience with Terraform or CloudFormation is a plus

No prior AI or AWS experience? Candidates eager to learn will be supported and gain hands-on exposure in production.

Work Location: Hybrid (In-office 3 days per week, subject to change)
City: Surrey
Type: Full-time, Permanent
Salary: $90,000 - $110,000 CAD
This range reflects the minimum and maximum target payable for the base salary of new hires across all Canadian locations. Actual compensation may vary outside this range and is dependent on various factors.

Why work for us?

We provide fantastic opportunities to individuals passionate about business and technology. Delta Electronics products are the most energy efficient power products in the industry and our company is perfect for those who want to create, design and build sustainable solutions using massively scalable, big-data architecture, with a strong focus on building automation. Here are some of the Delta perks you’ll receive from day 1!

• Employee & safety centric culture with the possibility of remote work
• Flexible hours and scheduling available
• Competitive total compensation along with generous vacation allowances
• Vacation leaves
• Wellness - onsite fitness center & company reimbursement for personal gym memberships
• Internal Recognition
• Employee Referral bonuses
• Transit accessible with free onsite parking
• Regular company events such as "Food Truck Fridays", Lunch & Learn and other planned activities