Talent.com
Sapphire Stream Technology
AI Performance Engineer – GPU & ROCmSapphire Stream Technology • Toronto, ON, Canada
AI Performance Engineer – GPU & ROCm

AI Performance Engineer – GPU & ROCm

Sapphire Stream Technology • Toronto, ON, Canada
6 days ago
Job type
  • Full-time
Job description

We are looking for a GPU AI Performance Engineer to optimize and deploy AI and machine-learning workloads using ROCm.

You will improve the speed, memory efficiency, and scalability of AI training and inference workloads. You will also work with GPU software, AI frameworks, profiling tools, and cloud or containerized environments.

Key Responsibilities

  • Improve training speed, inference latency, memory usage, and multi-GPU scalability.
  • Work with large language models, vision models, multimodal AI, and generative AI.
  • Develop and troubleshoot applications using ROCm and HIP.
  • Work with PyTorch, TensorFlow, ONNX Runtime, vLLM, SGLang, or MIGraphX.
  • Profile GPU applications and identify performance bottlenecks.
  • Apply mixed precision, quantization, kernel tuning, operator fusion, and memory optimization.
  • Support AI deployment on Linux, cloud, edge, and containerized platforms.
  • Develop performance benchmarks and automated validation tests.
  • Collaborate with hardware, compiler, runtime, framework, and infrastructure teams.

Required Qualifications

  • Bachelor’s or master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
  • Strong programming skills in C++ and Python.
  • Experience with Linux and GPU computing.
  • Hands‑on experience with ROCm, HIP, CUDA, or similar GPU technologies.
  • Understanding of GPU architecture, parallel programming, and memory management.
  • Experience with PyTorch, TensorFlow, ONNX Runtime, or similar AI frameworks.
  • Experience profiling and optimizing GPU applications.
  • Knowledge of AI model training, inference, and performance optimization.

Preferred Qualifications

  • Experience optimizing large language models or generative AI applications.
  • Experience with vLLM, SGLang, or distributed inference.
  • Familiarity with LLVM, MLIR, or compiler technologies.
  • Experience migrating workloads between CUDA and HIP.
  • Knowledge of Kubernetes, containers, and distributed AI systems.
  • Contributions to ROCm or other open-source GPU projects.
#J-18808-Ljbffr
Create a job alert for this search

AI Performance Engineer – GPU & ROCm • Toronto, ON, Canada

Similar jobs

AI Manufacturing Integration Lead: Predictive Analytics

Onico Solutionsrichmond hill, york region, Canada
Permanent

A leading technology solutions provider in Richmond Hill is seeking an AI Integration Specialist (Manufacturing) to enhance AI capabilities within manufacturing processes.The ideal candidate will h... Show more

 • Promoted

Expert AI Engineer Driving AI Initiatives with Advanced Technologies

GEI Consultantsmarkham, york region, Canada
Full-time

Elevate your career as an AI Engineer responsible for pioneering AI solutions that transform business workflows.Focus on deploying scalable AI initiatives integrating modern technologies to meet st... Show more

 • Promoted

Remote Aerospace AI Engineer — Train & Improve Models

DataAnnotationmarkham, york region, Canada
Remote
Full-time

An innovative company is seeking a skilled Aerospace Engineer to enhance AI models through the application of physics.This role allows you to work remotely, choose your projects, and set your own s... Show more

 • Promoted

AI Software Engineer — ROCm & GPU Innovation

AMDMarkham, York Region, CA
Full-time

A leading semiconductor company in Markham is seeking a Software Development Engineer to focus on innovative AI software features.The role involves validating and releasing software, contributing t... Show more

 • Promoted

AI Engineering Expert Position Richmond Hill

OpenTextrichmond hill, york region, Canada
Full-time

Contribute to AI innovation at OpenText as a Sr.Principal AI Developer in Richmond Hill, ON.Design and implement scalable AI solutions that meet enterprise demands using your extensive skill set.In... Show more

 • Promoted

AI Engineer

Tata Consultancy ServicesToronto, ON, CA
Full-time

Tata Consultancy Services (TCS) is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to c... Show more

 • Promoted

ML Engineer (Speech-to-Speech) — Subject Matter Expert

Vosyntoronto, on, Canada
Full-time

ML Engineer (Speech-to-Speech) — Subject Matter Expert.At Vosyn, we embrace the exciting, game-changing world of Artificial Intelligence, driving innovation and pioneering impactful projects across... Show more

 • Promoted

Ai Performance Architect: Hardware-Software Co-Design (Remote) - $100,000 - $300,000 A Year - Remote

TenstorrentEast York, Canada
Remote
Full-time

AI Performance Architect sought to model and optimize AI workloads.Requires C++ and Python experience.Salary ranges from $100k to $500k. Show more

 • Promoted

Thomson Reuters AI Engineering Lead

Thomson Reuterstoronto, on, Canada
Full-time

Lead the charge in AI innovation as the AI Engineering Lead at Thomson Reuters.Empower analysts to harness self-service tools and robust AI agents.You'll own the foundational engineering processes ... Show more

 • Promoted

World Models Research Engineer - Generative AI for Dynamic Scenes

Waabitoronto, on, Canada
Full-time

A leading autonomous technology company in Toronto is seeking a Research Engineer to design and implement generative and predictive modeling systems.You will collaborate with research scientists to... Show more

 • Promoted

EA Research Engineer in Game AI and LLMs

Electronic Arts Inc.Toronto, ON, CA
Full-time

Elevate interactive entertainment as a Research Engineer focusing on Large Language Models at Electronic Arts.This impactful role allows you to pioneer groundbreaking applications for gaming techno... Show more

 • Promoted

Performance Engineer for AI Benchmarking and Inference Insights

CerebrasToronto, Ontario, Canada
Full-time

Enhance AI capabilities as a Performance Engineer focused on Benchmarking! Collaborate with experts to measure, analyze, and optimize performance in pioneering AI systems deployed at scale.In this ... Show more

 • Promoted

Lead Engineer for AI Model Infrastructure

MediumToronto, ON, CA
Full-time

Step into the role of Lead Engineer focusing on building AI model infrastructure.Harness GPU resources and create self-service platforms to enhance AI deployment capabilities.As a Lead Engineer, yo... Show more

 • Promoted

GPU Performance Engineer - Neural Reconstruction

NVIDIAtoronto, on, Canada
Full-time

Today, we’re tapping into the unlimited potential of AI to define the next era of computing.An era in which our GPU acts as the brains of computers, robots, and self‑driving cars that can understan... Show more

 • Promoted

AI / ML Engineer

US Mobiletoronto, on, Canada
Full-time

US Mobile is a venture‑backed company on a mission to revolutionize connectivity with a software platform for 5G and IoT.We are expanding rapidly and seek an AI/ML Engineer to develop and scale mac... Show more

 • Promoted

ASIC Verification Engineer in AI Development

Qualcommmarkham, on, Canada
Full-time

Advance your career at Qualcomm Canada ULC as an ASIC Verification Engineer focused on low-power AI solutions.Leverage your skills to drive ASIC verification efforts in groundbreaking audio applica... Show more

 • Promoted

AI Engineer

BioRenderToronto, ON, CA
Full-time

At BioRender, we don’t settle for average, and neither should you.We’re building tools that transform how scientists communicate complex ideas, and we need someone who’s ready to turn ambitious ide... Show more

 • Promoted

AI Inference Optimization Engineer at Cerebras

Cerebras Systems, Inc.Toronto, ON, CA
Full-time

Enhance AI technologies at Cerebras Systems as an AI Inference Optimization Engineer.Utilize your programming expertise to build systems that optimize large-scale ML performance.Cerebras is looking... Show more

 • Promoted

Senior AI Engineer

MIR Digital Solutionstoronto, on, Canada
Full-time

Senior Machine Learning Engineer.Direct message the job poster from MIR Digital Solutions.At MIR Digital, we’re more than a company - we’re a collective of innovators, builders, and change-makers.W... Show more

 • Promoted

Senior ML Engineer - Build Production-Grade AI Systems

TheAppLabbToronto, ON, CA
Full-time

A cutting-edge digital solutions provider in Toronto seeks a Senior Machine Learning Engineer to design, develop, and deploy scalable ML solutions.You will work closely with cross-functional teams,... Show more