Talent.com
ROCm AI System Software Architect
ROCm AI System Software ArchitectAdvanced Micro Devices, Inc • MARKHAM, Ontario, Canada
ROCm AI System Software Architect

ROCm AI System Software Architect

Advanced Micro Devices, Inc • MARKHAM, Ontario, Canada
30+ days ago
Job type
  • Full-time
Job description

WHAT YOU DO AT AMD CHANGES EVERYTHING At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you’ll discover the real differentiator is our culture. We push the limits of innovation to solve the world’s most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond. Together, we advance your career. THE PERSON You are an expert on efficient system software design and optimization. You have strong technical and analytical skills in C / C++ and Python, with experience in AI development across Windows and Linux environments. You’re familiar with GPU programming and compilers. As a capable problem-solver and a technical leader, you excel at defining goals, scoping projects, and driving development efforts. With excellent communication skills and a passion for AI technologies, you are motivated to deliver feature-rich, efficient solutions to customers. THE ROLE We are seeking an expert-level Machine Learning System Software Engineer to join the AMD GPU Technology and Engineering Software Team. You will develop cutting-edge AI software technologies, optimize the AI software stack, and deliver innovative solutions with powerful engineer-oriented debugging / profiling tools across AMD Radeon and Ryzen product families. Collaboration with cross-functional teams will be essential to ensure peak performance of AI solutions. KEY RESPONSIBILITIES Develop and deliver advanced AI software solutions for AMD customers and users. Enable and optimize the AI software stack for frameworks like PyTorch, vLLM, and GGML / llama.cpp, as well as emerging open-source AI software. Implement state-of-the-art AI models and enhance their performance. Lead the full AI software development lifecycle, including scoping, implementation, integration, verification, and customer enablement. Drive and deliver powerful debugging and profiling tools with consistent user experience across Radeon GPUs on both Linux and Windows PREFERRED EXPERIENCE Expertise in system software design and optimization, with experience on cross-platform development and programming languages C / C++ and Python. Proven problem-solving skills and effective communication abilities. Experience with AI frameworks, inference stacks, and GPU-accelerated development, including GEMM, CONV, Flash Attention, fused MoE, and non-linear operators. Compiler and low-level GPU programming is a plus. Solid understanding of AI / ML concepts, with knowledge of the performance impact of compute, memory, and communication configurations. Open-source software development experience is a plus. ACADEMIC CREDENTIALS Bachelor’s, Master’s, or PhD in Computer Science, Electrical Engineering, or a related field. #LI-IA1 #LI-Hybrid Benefits offered are described : AMD benefits at a glance. AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and / or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process. AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here. This posting is for an existing vacancy.THE PERSON You are an expert on efficient system software design and optimization. You have strong technical and analytical skills in C / C++ and Python, with experience in AI development across Windows and Linux environments. You’re familiar with GPU programming and compilers. As a capable problem-solver and a technical leader, you excel at defining goals, scoping projects, and driving development efforts. With excellent communication skills and a passion for AI technologies, you are motivated to deliver feature-rich, efficient solutions to customers. THE ROLE We are seeking an expert-level Machine Learning System Software Engineer to join the AMD GPU Technology and Engineering Software Team. You will develop cutting-edge AI software technologies, optimize the AI software stack, and deliver innovative solutions with powerful engineer-oriented debugging / profiling tools across AMD Radeon and Ryzen product families. Collaboration with cross-functional teams will be essential to ensure peak performance of AI solutions. KEY RESPONSIBILITIES Develop and deliver advanced AI software solutions for AMD customers and users. Enable and optimize the AI software stack for frameworks like PyTorch, vLLM, and GGML / llama.cpp, as well as emerging open-source AI software. Implement state-of-the-art AI models and enhance their performance. Lead the full AI software development lifecycle, including scoping, implementation, integration, verification, and customer enablement. Drive and deliver powerful debugging and profiling tools with consistent user experience across Radeon GPUs on both Linux and Windows PREFERRED EXPERIENCE Expertise in system software design and optimization, with experience on cross-platform development and programming languages C / C++ and Python. Proven problem-solving skills and effective communication abilities. Experience with AI frameworks, inference stacks, and GPU-accelerated development, including GEMM, CONV, Flash Attention, fused MoE, and non-linear operators. Compiler and low-level GPU programming is a plus. Solid understanding of AI / ML concepts, with knowledge of the performance impact of compute, memory, and communication configurations. Open-source software development experience is a plus. ACADEMIC CREDENTIALS Bachelor’s, Master’s, or PhD in Computer Science, Electrical Engineering, or a related field. #LI-IA1 #LI-Hybrid

Benefits offered are described : AMD benefits at a glance. AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and / or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process. AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here. This posting is for an existing vacancy.

Create a job alert for this search

ROCm AI System Software Architect • MARKHAM, Ontario, Canada

Similar jobs
Engineer, AI Systems Architecture

Engineer, AI Systems Architecture

Qualcomm • Markham
Full-time
Engineer, AI Systems Architecture.Engineering Group, Machine Learning Engineering.Do you ever wonder when will connected devices become thinking devices? Be part of the group that is working on tec...Show more
Last updated: 30+ days ago • Promoted
Senior AI Software Architect & Design Systems Lead — Hybrid

Senior AI Software Architect & Design Systems Lead — Hybrid

Appnovation • Toronto
Full-time
A global digital solutions provider in Toronto is seeking a Senior AI Software Engineer to transform business ideas into production-ready applications.This role focuses on frontend development, str...Show more
Last updated: 2 days ago • Promoted
Chief Software Architect & AI Systems Lead

Chief Software Architect & AI Systems Lead

HRB • Toronto
Full-time
A leading company in the live operations games industry is seeking a Principal Engineer / Chief Software Architect.This pivotal role involves driving the evolution of core platforms, focusing on AI...Show more
Last updated: 30+ days ago • Promoted
Lead AI/ML Architect: Cloud‑Native Agentic Systems

Lead AI/ML Architect: Cloud‑Native Agentic Systems

Autodesk • Toronto
Full-time
A leading software company in Toronto is seeking a Principal Developer for its Applied AI team.This hands-on role focuses on designing and delivering cloud-native AI applications while collaboratin...Show more
Last updated: 2 days ago • Promoted
Enterprise AI Architect — LLMs & MLOps Leader

Enterprise AI Architect — LLMs & MLOps Leader

Publicis Groupe ANZ • Toronto
Full-time
A leading communications group in Toronto is seeking a Senior AI/ML Solutions Architect to guide the delivery of production-grade AI capabilities.This role involves designing scalable, secure archi...Show more
Last updated: 15 days ago • Promoted
Senior AI Multi-Agent Systems Architect — Cloud Scale

Senior AI Multi-Agent Systems Architect — Cloud Scale

Huawei Canada • Markham
Full-time
A leading telecommunications firm in Markham, Ontario is looking for a Senior Principal Software Engineer - AI Multi-Agents.You will lead the design and deployment of innovative AI Multi-Agent syst...Show more
Last updated: 30+ days ago • Promoted
AI Systems Architect & Integration Engineer

AI Systems Architect & Integration Engineer

University of Toronto • Toronto
Full-time
A leading university in Canada is seeking an AI Developer & Integration Specialist.This full-time role involves architecting and engineering complex AI solutions, maintaining MLOps and CI/CD pipeli...Show more
Last updated: 2 days ago • Promoted
Senior AI-Native Systems Architect

Senior AI-Native Systems Architect

Intuit Inc. • Toronto
Full-time
A leading software company in Toronto is seeking a Senior Staff/Principal Software Developer to enhance AI-native applications.The role involves driving technology initiatives, collaborating with c...Show more
Last updated: 30+ days ago • Promoted
SoC System Performance Architect AI/ML

SoC System Performance Architect AI/ML

Advanced Micro Devices • Markham
Full-time
WHAT YOU DO AT AMD CHANGES EVERYTHING.At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded syst...Show more
Last updated: 7 days ago • Promoted
Strategic Systems Architect & AI Innovator

Strategic Systems Architect & AI Innovator

Cameron Stephens Mortgage Capital Ltd. • Toronto
Full-time
A leading mortgage capital firm in Toronto is seeking a Systems Architect to drive the technical evolution of their business.You will lead the design of enterprise systems and implement cutting-edg...Show more
Last updated: 30+ days ago • Promoted
Responsible AI Architect — RAIOps & Governance (Hybrid Toronto)

Responsible AI Architect — RAIOps & Governance (Hybrid Toronto)

Iris Software Inc. • Toronto
Full-time
A leading IT consulting firm is seeking an AI/ML Architect to lead the design and implementation of Responsible AI Governance frameworks.This position requires extensive experience in AI/ML archite...Show more
Last updated: 30+ days ago • Promoted
Lead AI Architect for Autonomous, Agentic AI Systems

Lead AI Architect for Autonomous, Agentic AI Systems

Kyndryl • Toronto
Full-time
A leading technology services provider in Toronto is seeking an experienced AI Architect to design innovative AI solutions.The role requires expertise in generative and agentic AI, with a focus on ...Show more
Last updated: 2 days ago • Promoted
Lead AI Software Engineer - Enterprise LLM & Systems

Lead AI Software Engineer - Enterprise LLM & Systems

Thomson Reuters • Toronto
Full-time
An influential information and technology provider in Toronto seeks a Lead Software Engineer - AI.In this role, you will spearhead the development of cutting-edge AI-powered solutions, mentor a tea...Show more
Last updated: 2 days ago • Promoted
Software Architect, Applied AI

Software Architect, Applied AI

PowerToFly • Toronto
Full-time
Job Requisition ID #25WD94061, Software Architect, Applied AI.If you love building real systems that real customers use—and you get genuinely excited about LLMs, RAG, MCP, and agentic architectures...Show more
Last updated: 30+ days ago • Promoted
Software Architect - AI Accelerated Engineering Lead (Toronto)

Software Architect - AI Accelerated Engineering Lead (Toronto)

Slalom • Toronto
Full-time
Software Architect - AI Accelerated Engineering Lead.Software Architect - AI Accelerated Engineering Lead.Slalom is a fiercely human business and technology consulting company that leads with outco...Show more
Last updated: 30+ days ago • Promoted
Power Architect for AI Compute Systems

Power Architect for AI Compute Systems

Tenstorrent Inc. • Toronto
Full-time
An innovative technology company is seeking a Power Architect to lead architectural strategy and design decisions for high-performance AI compute systems.This hybrid role involves optimizing power ...Show more
Last updated: 30+ days ago • Promoted
Senior AI Architect — Multi-Agent & GenAI Systems

Senior AI Architect — Multi-Agent & GenAI Systems

NTT DATA, Inc. • Toronto
Full-time
A global technology services company is seeking an experienced AI Specialist in Toronto.You will design and implement AI workflows across industries including healthcare and finance.The ideal candi...Show more
Last updated: 30+ days ago • Promoted
SoC System Performance Architect AI/ML

SoC System Performance Architect AI/ML

AMD • Markham
Full-time
WHAT YOU DO AT AMD CHANGES EVERYTHING.At AMD, our mission is to build great products that accelerate next‑generation computing experiences—from AI and data centers, to PCs, gaming and embedded syst...Show more
Last updated: 2 days ago • Promoted