Senior Software Test Engineer

Job description : Job description :

About the Role

We are seeking a highly skilled Senior Software Testing Engineer to lead advanced validation efforts across Neural Processing Unit (NPU) software, AI workloads, Windows AI features, and machine learning quantization workflows. This role focuses on ensuring software stability, certification readiness, and optimal performance across next-generation Windows AI platforms. You will collaborate closely with cross-functional teams, including firmware, driver, software, and Microsoft engineering partners.

Key Duties & Responsibilities

Perform comprehensive software validation of NPU-related firmware, drivers, and execution layers to ensure performance, functionality, and power efficiency meet certification requirements.

Participate in certification processes for the NPU Execution Provider (NPU EP) to ensure compatibility and reliability within Microsoft AI frameworks.

Generate detailed test reports, log defects, and provide actionable feedback to firmware, driver, and software teams to improve throughput, stability, and feature compliance.

Validate AI workloads running on NPU hardware, focusing on software-level performance, scalability, and stability under varying test conditions.

Collaborate with Microsoft engineering teams to certify DirectML Execution Provider (DML EP) functionality and ensure alignment with AI workload requirements.

Debug and troubleshoot AI inference and training pipelines during validation to ensure smooth software integration on Windows AI platforms.

Conduct functional, performance, and security testing of Windows AI Copilot features built for NPU-enabled devices.

Validate end-to-end user scenarios across Co-Pilot applications such as Paint Co-Creator, Live Translation, Recall, and Settings Agent.

Analyze software telemetry, system logs, and user feedback to identify defects and collaborate with development teams for timely issue resolution.

Develop, implement, and validate software-based quantization methods using the Olive toolchain and other AI frameworks to optimize model size while maintaining accuracy.

Perform quantization-aware validation to ensure models meet required quality and performance benchmarks on resource-constrained platforms.

Benchmark quantized models across multiple hardware targets and AI workloads to verify consistency, compatibility, and certification readiness.

Qualifications

Bachelors or Masters degree in Computer Science, Electrical Engineering, or a related field.

5 10+ years of experience in software testing, validation, or quality engineering (ideally in AI, ML, or NPU systems).

Strong understanding of machine learning frameworks, AI workload execution, and performance testing.

Hands-on experience with Windows platform testing, hardware-software integration, and debugging tools.

Familiarity with quantization methods, ONNX, DirectML, Olive, or similar ML toolchains (preferred).

Excellent analytical, problem-solving, and communication skills; ability to collaborate with global engineering teams.

Job Type : Full-time

Benefits : Dental care

Employee assistance program

Extended health care

Life insurance

On-site parking

Paid time off

RRSP match