Talent.com
ROCm AI System Software Architect
ROCm AI System Software ArchitectAdvanced Micro Devices, Inc • MARKHAM, Ontario, Canada
ROCm AI System Software Architect

ROCm AI System Software Architect

Advanced Micro Devices, Inc • MARKHAM, Ontario, Canada
30+ days ago
Job type
  • Full-time
Job description

WHAT YOU DO AT AMD CHANGES EVERYTHING At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you’ll discover the real differentiator is our culture. We push the limits of innovation to solve the world’s most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond. Together, we advance your career. THE PERSON You are an expert on efficient system software design and optimization. You have strong technical and analytical skills in C / C++ and Python, with experience in AI development across Windows and Linux environments. You’re familiar with GPU programming and compilers. As a capable problem-solver and a technical leader, you excel at defining goals, scoping projects, and driving development efforts. With excellent communication skills and a passion for AI technologies, you are motivated to deliver feature-rich, efficient solutions to customers. THE ROLE We are seeking an expert-level Machine Learning System Software Engineer to join the AMD GPU Technology and Engineering Software Team. You will develop cutting-edge AI software technologies, optimize the AI software stack, and deliver innovative solutions with powerful engineer-oriented debugging / profiling tools across AMD Radeon and Ryzen product families. Collaboration with cross-functional teams will be essential to ensure peak performance of AI solutions. KEY RESPONSIBILITIES Develop and deliver advanced AI software solutions for AMD customers and users. Enable and optimize the AI software stack for frameworks like PyTorch, vLLM, and GGML / llama.cpp, as well as emerging open-source AI software. Implement state-of-the-art AI models and enhance their performance. Lead the full AI software development lifecycle, including scoping, implementation, integration, verification, and customer enablement. Drive and deliver powerful debugging and profiling tools with consistent user experience across Radeon GPUs on both Linux and Windows PREFERRED EXPERIENCE Expertise in system software design and optimization, with experience on cross-platform development and programming languages C / C++ and Python. Proven problem-solving skills and effective communication abilities. Experience with AI frameworks, inference stacks, and GPU-accelerated development, including GEMM, CONV, Flash Attention, fused MoE, and non-linear operators. Compiler and low-level GPU programming is a plus. Solid understanding of AI / ML concepts, with knowledge of the performance impact of compute, memory, and communication configurations. Open-source software development experience is a plus. ACADEMIC CREDENTIALS Bachelor’s, Master’s, or PhD in Computer Science, Electrical Engineering, or a related field. #LI-IA1 #LI-Hybrid Benefits offered are described : AMD benefits at a glance. AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and / or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.THE PERSON You are an expert on efficient system software design and optimization. You have strong technical and analytical skills in C / C++ and Python, with experience in AI development across Windows and Linux environments. You’re familiar with GPU programming and compilers. As a capable problem-solver and a technical leader, you excel at defining goals, scoping projects, and driving development efforts. With excellent communication skills and a passion for AI technologies, you are motivated to deliver feature-rich, efficient solutions to customers. THE ROLE We are seeking an expert-level Machine Learning System Software Engineer to join the AMD GPU Technology and Engineering Software Team. You will develop cutting-edge AI software technologies, optimize the AI software stack, and deliver innovative solutions with powerful engineer-oriented debugging / profiling tools across AMD Radeon and Ryzen product families. Collaboration with cross-functional teams will be essential to ensure peak performance of AI solutions. KEY RESPONSIBILITIES Develop and deliver advanced AI software solutions for AMD customers and users. Enable and optimize the AI software stack for frameworks like PyTorch, vLLM, and GGML / llama.cpp, as well as emerging open-source AI software. Implement state-of-the-art AI models and enhance their performance. Lead the full AI software development lifecycle, including scoping, implementation, integration, verification, and customer enablement. Drive and deliver powerful debugging and profiling tools with consistent user experience across Radeon GPUs on both Linux and Windows PREFERRED EXPERIENCE Expertise in system software design and optimization, with experience on cross-platform development and programming languages C / C++ and Python. Proven problem-solving skills and effective communication abilities. Experience with AI frameworks, inference stacks, and GPU-accelerated development, including GEMM, CONV, Flash Attention, fused MoE, and non-linear operators. Compiler and low-level GPU programming is a plus. Solid understanding of AI / ML concepts, with knowledge of the performance impact of compute, memory, and communication configurations. Open-source software development experience is a plus. ACADEMIC CREDENTIALS Bachelor’s, Master’s, or PhD in Computer Science, Electrical Engineering, or a related field. #LI-IA1 #LI-Hybrid

Benefits offered are described : AMD benefits at a glance. AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and / or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

Create a job alert for this search

Software Architect • MARKHAM, Ontario, Canada

Similar jobs
Senior Applied AI Systems Developer / Architect

Senior Applied AI Systems Developer / Architect

Klick • Toronto, ON, Canada
Full-time
The Klick Group—comprising Klick Health (including Klick Katalyst and btwelve), Klick Media Group, Klick Applied Sciences (including Klick Labs), Klick Consulting, and Klick Ventures—is...Show more
Last updated: 30+ days ago • Promoted
Pega System Architect

Pega System Architect

Rules Cube • Toronto, Ontario, CA
Full-time
Quick Apply
Work Location : Remote due to Covid Description Rules Cube is an official Pegasystems partner with deep expertise in building enterprise applications using PEGA. We are looking for a talented Pega Sy...Show more
Last updated: 30+ days ago
AI Agent Architect for Autonomous AI Systems

AI Agent Architect for Autonomous AI Systems

Atos SE • Toronto, Canada
Full-time
A global digital transformation leader is seeking a candidate in Windsor, Ontario, with expertise in LLMs and significant experience in designing and implementing agentic solutions.The role demands...Show more
Last updated: 3 days ago • Promoted
Senior AI Systems Engineer (LLMs) — Production at Scale

Senior AI Systems Engineer (LLMs) — Production at Scale

Latinx in AI (LXAI) • Toronto
Full-time
A forward-thinking AI organization in Toronto seeks a Senior / Principal Machine Learning Engineer who will design and implement core machine learning systems for AI agents.This role involves collabo...Show more
Last updated: 6 days ago • Promoted
Remote Software Architect -.NET / Azure, Grants System

Remote Software Architect -.NET / Azure, Grants System

Jobgether • Toronto, Canada
Remote
Full-time
A leading recruitment agency is seeking a Software Architect to lead the technical direction of the Common System for Grants application. Remote work options are available.The ideal candidate will h...Show more
Last updated: 4 days ago • Promoted
Engineer, AI Systems Architecture

Engineer, AI Systems Architecture

Qualcomm • Markham
Full-time
Engineer, AI Systems Architecture.Engineering Group, Machine Learning Engineering.Do you ever wonder when will connected devices become thinking devices? Be part of the group that is working on tec...Show more
Last updated: 8 days ago • Promoted
Chief Software Architect & AI Systems Lead

Chief Software Architect & AI Systems Lead

HRB • Toronto
Full-time
A leading company in the live operations games industry is seeking a Principal Engineer / Chief Software Architect.This pivotal role involves driving the evolution of core platforms, focusing on AI...Show more
Last updated: 29 days ago • Promoted
Senior AI Multi-Agent Systems Architect — Cloud Scale

Senior AI Multi-Agent Systems Architect — Cloud Scale

Huawei Canada • Markham
Full-time
A leading telecommunications firm in Markham, Ontario is looking for a Senior Principal Software Engineer - AI Multi-Agents. You will lead the design and deployment of innovative AI Multi-Agent syst...Show more
Last updated: 29 days ago • Promoted
Senior AI-Native Systems Architect

Senior AI-Native Systems Architect

Intuit Inc. • Toronto
Full-time
A leading software company in Toronto is seeking a Senior Staff / Principal Software Developer to enhance AI-native applications. The role involves driving technology initiatives, collaborating with c...Show more
Last updated: 4 days ago • Promoted
Software Architect - REMOTE

Software Architect - REMOTE

Jobgether • Toronto, Canada
Remote
Full-time
This position is posted by Jobgether on behalf of a partner company.We are currently looking for a Software Architect.In this role, you will be instrumental in leading the technical direction of th...Show more
Last updated: 5 days ago • Promoted
ROCm AI System Software Architect

ROCm AI System Software Architect

Advanced Micro Devices • Markham
Full-time
WHAT YOU DO AT AMD CHANGES EVERYTHING.At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded syst...Show more
Last updated: 6 days ago • Promoted
ROCm AI System Software Architect

ROCm AI System Software Architect

AMD • Markham
Full-time
ROCm AI System Software Architect.Get AI-powered advice on this job and more exclusive features.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more....Show more
Last updated: 29 days ago • Promoted
Power Architect for AI Compute Systems

Power Architect for AI Compute Systems

Tenstorrent Inc. • Toronto
Full-time
An innovative technology company is seeking a Power Architect to lead architectural strategy and design decisions for high-performance AI compute systems. This hybrid role involves optimizing power ...Show more
Last updated: 8 days ago • Promoted
Head of AI Engineering & System Architecture

Head of AI Engineering & System Architecture

Siena AI • Toronto
Full-time
A forward-thinking AI company in Toronto is seeking a Head of Engineering to lead the technical vision for an innovative customer experience platform. The ideal candidate will have a successful trac...Show more
Last updated: 29 days ago • Promoted
Senior Architect - Efficient AI Data Systems

Senior Architect - Efficient AI Data Systems

GuruLink • Toronto C6A, ON, Canada
Full-time
A leading AI Research Firm in Toronto seeks skilled engineers to design foundational data systems.Responsibilities include optimizing data processing through innovative metadata solutions and devel...Show more
Last updated: 7 days ago • Promoted
Growth-Focused Solutions Architect for AI / ML - Remote

Growth-Focused Solutions Architect for AI / ML - Remote

temporal • Toronto, Canada
Remote
Full-time
A leading software development company in Canada is looking for individuals passionate about improving developer experiences and building open-source software. You will collaborate with clients to a...Show more
Last updated: 6 days ago • Promoted
Mgr, System Architect Infrastructure

Mgr, System Architect Infrastructure

Hydro One • Toronto
Full-time
Hydro One is proud to be the largest electricity transmission and distribution provider in Ontario, serving nearly 1.We have a long history in the industry with our roots dating back over 110 years...Show more
Last updated: 8 days ago • Promoted
Senior SoC Verification Architect – Cloud ML Accelerators

Senior SoC Verification Architect – Cloud ML Accelerators

Amazon Web Services (AWS) • Toronto
Full-time
A global cloud services leader is seeking a design verification engineer in Toronto to enhance its innovative team.In this role, you'll verify hardware and software solutions, develop multi-faceted...Show more
Last updated: 29 days ago • Promoted