Talent.com
ROCm AI System Software Architect
ROCm AI System Software ArchitectAdvanced Micro Devices, Inc • MARKHAM, Ontario, Canada
ROCm AI System Software Architect

ROCm AI System Software Architect

Advanced Micro Devices, Inc • MARKHAM, Ontario, Canada
30+ days ago
Job type
  • Full-time
Job description

WHAT YOU DO AT AMD CHANGES EVERYTHING At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you’ll discover the real differentiator is our culture. We push the limits of innovation to solve the world’s most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond. Together, we advance your career. THE PERSON You are an expert on efficient system software design and optimization. You have strong technical and analytical skills in C / C++ and Python, with experience in AI development across Windows and Linux environments. You’re familiar with GPU programming and compilers. As a capable problem-solver and a technical leader, you excel at defining goals, scoping projects, and driving development efforts. With excellent communication skills and a passion for AI technologies, you are motivated to deliver feature-rich, efficient solutions to customers. THE ROLE We are seeking an expert-level Machine Learning System Software Engineer to join the AMD GPU Technology and Engineering Software Team. You will develop cutting-edge AI software technologies, optimize the AI software stack, and deliver innovative solutions with powerful engineer-oriented debugging / profiling tools across AMD Radeon and Ryzen product families. Collaboration with cross-functional teams will be essential to ensure peak performance of AI solutions. KEY RESPONSIBILITIES Develop and deliver advanced AI software solutions for AMD customers and users. Enable and optimize the AI software stack for frameworks like PyTorch, vLLM, and GGML / llama.cpp, as well as emerging open-source AI software. Implement state-of-the-art AI models and enhance their performance. Lead the full AI software development lifecycle, including scoping, implementation, integration, verification, and customer enablement. Drive and deliver powerful debugging and profiling tools with consistent user experience across Radeon GPUs on both Linux and Windows PREFERRED EXPERIENCE Expertise in system software design and optimization, with experience on cross-platform development and programming languages C / C++ and Python. Proven problem-solving skills and effective communication abilities. Experience with AI frameworks, inference stacks, and GPU-accelerated development, including GEMM, CONV, Flash Attention, fused MoE, and non-linear operators. Compiler and low-level GPU programming is a plus. Solid understanding of AI / ML concepts, with knowledge of the performance impact of compute, memory, and communication configurations. Open-source software development experience is a plus. ACADEMIC CREDENTIALS Bachelor’s, Master’s, or PhD in Computer Science, Electrical Engineering, or a related field. #LI-IA1 #LI-Hybrid Benefits offered are described : AMD benefits at a glance. AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and / or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process. AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here. This posting is for an existing vacancy.THE PERSON You are an expert on efficient system software design and optimization. You have strong technical and analytical skills in C / C++ and Python, with experience in AI development across Windows and Linux environments. You’re familiar with GPU programming and compilers. As a capable problem-solver and a technical leader, you excel at defining goals, scoping projects, and driving development efforts. With excellent communication skills and a passion for AI technologies, you are motivated to deliver feature-rich, efficient solutions to customers. THE ROLE We are seeking an expert-level Machine Learning System Software Engineer to join the AMD GPU Technology and Engineering Software Team. You will develop cutting-edge AI software technologies, optimize the AI software stack, and deliver innovative solutions with powerful engineer-oriented debugging / profiling tools across AMD Radeon and Ryzen product families. Collaboration with cross-functional teams will be essential to ensure peak performance of AI solutions. KEY RESPONSIBILITIES Develop and deliver advanced AI software solutions for AMD customers and users. Enable and optimize the AI software stack for frameworks like PyTorch, vLLM, and GGML / llama.cpp, as well as emerging open-source AI software. Implement state-of-the-art AI models and enhance their performance. Lead the full AI software development lifecycle, including scoping, implementation, integration, verification, and customer enablement. Drive and deliver powerful debugging and profiling tools with consistent user experience across Radeon GPUs on both Linux and Windows PREFERRED EXPERIENCE Expertise in system software design and optimization, with experience on cross-platform development and programming languages C / C++ and Python. Proven problem-solving skills and effective communication abilities. Experience with AI frameworks, inference stacks, and GPU-accelerated development, including GEMM, CONV, Flash Attention, fused MoE, and non-linear operators. Compiler and low-level GPU programming is a plus. Solid understanding of AI / ML concepts, with knowledge of the performance impact of compute, memory, and communication configurations. Open-source software development experience is a plus. ACADEMIC CREDENTIALS Bachelor’s, Master’s, or PhD in Computer Science, Electrical Engineering, or a related field. #LI-IA1 #LI-Hybrid

Benefits offered are described : AMD benefits at a glance. AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and / or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process. AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here. This posting is for an existing vacancy.

Create a job alert for this search

ROCm AI System Software Architect • MARKHAM, Ontario, Canada

Similar jobs
Senior Architect - Efficient AI Data Systems

Senior Architect - Efficient AI Data Systems

GuruLink • Toronto
Full-time
A leading AI Research Firm in Toronto seeks skilled engineers to design foundational data systems.Responsibilities include optimizing data processing through innovative metadata solutions and devel...Show more
Last updated: 30+ days ago • Promoted
Engineer, AI Systems Architecture

Engineer, AI Systems Architecture

Qualcomm • Markham
Full-time
Engineer, AI Systems Architecture.Engineering Group, Machine Learning Engineering.Do you ever wonder when will connected devices become thinking devices? Be part of the group that is working on tec...Show more
Last updated: 30+ days ago • Promoted
Chief Software Architect & AI Systems Lead

Chief Software Architect & AI Systems Lead

HRB • Toronto
Full-time
A leading company in the live operations games industry is seeking a Principal Engineer / Chief Software Architect.This pivotal role involves driving the evolution of core platforms, focusing on AI...Show more
Last updated: 30+ days ago • Promoted
Lead AI/ML Architect: Cloud‑Native Agentic Systems

Lead AI/ML Architect: Cloud‑Native Agentic Systems

Autodesk • Toronto
Full-time
A leading software company in Toronto is seeking a Principal Developer for its Applied AI team.This hands-on role focuses on designing and delivering cloud-native AI applications while collaboratin...Show more
Last updated: 8 hours ago • Promoted • New!
Senior AI Multi-Agent Systems Architect — Cloud Scale

Senior AI Multi-Agent Systems Architect — Cloud Scale

Huawei Canada • Markham
Full-time
A leading telecommunications firm in Markham, Ontario is looking for a Senior Principal Software Engineer - AI Multi-Agents.You will lead the design and deployment of innovative AI Multi-Agent syst...Show more
Last updated: 30+ days ago • Promoted
Sr. AI/ML Software System Design Engineer

Sr. AI/ML Software System Design Engineer

AMD • Markham
Full-time
AI/ML Software System Design Engineer.Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.Your actual pay will be based on your skills and experience — ta...Show more
Last updated: 30+ days ago • Promoted
Software Architect, Applied AI

Software Architect, Applied AI

Autodesk, Inc. • Toronto
Full-time
Bachelor's or Master's degree in Computer Science, Machine Learning, Data Science, or equivalent practical experience* 8+ years building cloud-native software in production (distributed systems, AP...Show more
Last updated: 30+ days ago • Promoted
AI Systems Architect & Integration Engineer

AI Systems Architect & Integration Engineer

University of Toronto • Toronto
Full-time
A leading university in Canada is seeking an AI Developer & Integration Specialist.This full-time role involves architecting and engineering complex AI solutions, maintaining MLOps and CI/CD pipeli...Show more
Last updated: 8 hours ago • Promoted • New!
Senior AI-Native Systems Architect

Senior AI-Native Systems Architect

Intuit Inc. • Toronto
Full-time
A leading software company in Toronto is seeking a Senior Staff/Principal Software Developer to enhance AI-native applications.The role involves driving technology initiatives, collaborating with c...Show more
Last updated: 30+ days ago • Promoted
SoC System Performance Architect AI/ML

SoC System Performance Architect AI/ML

Advanced Micro Devices • Markham
Full-time
WHAT YOU DO AT AMD CHANGES EVERYTHING.At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded syst...Show more
Last updated: 5 days ago • Promoted
Strategic Systems Architect & AI Innovator

Strategic Systems Architect & AI Innovator

Cameron Stephens Mortgage Capital Ltd. • Toronto
Full-time
A leading mortgage capital firm in Toronto is seeking a Systems Architect to drive the technical evolution of their business.You will lead the design of enterprise systems and implement cutting-edg...Show more
Last updated: 30+ days ago • Promoted
Software Architect, Applied AI

Software Architect, Applied AI

PowerToFly • Toronto
Full-time
Job Requisition ID #25WD94061, Software Architect, Applied AI.If you love building real systems that real customers use—and you get genuinely excited about LLMs, RAG, MCP, and agentic architectures...Show more
Last updated: 30+ days ago • Promoted
System Architect

System Architect

CNA • Toronto
Full-time
System Architect page is loaded## System Architectlocations: Toronto, ON, CANtime type: Full timeposted on: Posted 2 Days Agojob requisition id: R-6930You have a clear vision of where your career c...Show more
Last updated: 30+ days ago • Promoted
Power Architect for AI Compute Systems

Power Architect for AI Compute Systems

Tenstorrent Inc. • Toronto
Full-time
An innovative technology company is seeking a Power Architect to lead architectural strategy and design decisions for high-performance AI compute systems.This hybrid role involves optimizing power ...Show more
Last updated: 30+ days ago • Promoted
AI/ML Architect

AI/ML Architect

Iris Software Inc. • Toronto
Full-time
Toronto, ON (Hybrid, 3 days onsite per week).Lead design and implementation of Responsible AI Governance frameworks.Build and operationalize RAIOps solutions to ensure ethical and compliant AI prac...Show more
Last updated: 30+ days ago • Promoted
Senior Software Architect Engineer (Aerospace / eVTOL)

Senior Software Architect Engineer (Aerospace / eVTOL)

Essence Coaching Group • Markham, ON, Canada
Full-time
Quick Apply
Senior Software Architect Engineer (Aerospace / eVTOL).CAD 120,000 – 165,000 (annual).A senior-level Software Architect & Engineer is sought to lead mission-critical aerospace software development....Show more
Last updated: 30+ days ago
Senior AI/ML Systems Architect – GPU & Data Center

Senior AI/ML Systems Architect – GPU & Data Center

AMD • Markham
Full-time
A leading semiconductor firm in Canada is seeking a Sr.AI/ML Software System Design Engineer to lead the design of advanced AI/ML architectures.This role involves defining strategies for AI validat...Show more
Last updated: 30+ days ago • Promoted
AI-First Software Architect & Engineering Lead

AI-First Software Architect & Engineering Lead

Slalom • Toronto
Full-time
A leading consulting firm in Toronto is seeking a Software Architect - AI Accelerated Engineering Lead.The role involves redefining AI-driven software development practices, managing teams, and col...Show more
Last updated: 30+ days ago • Promoted