Talent.com
ROCm AI System Software Architect
ROCm AI System Software ArchitectAMD • Markham, York Region, CA
ROCm AI System Software Architect

ROCm AI System Software Architect

AMD • Markham, York Region, CA
30+ days ago
Job type
  • Full-time
Job description

Join to apply for the ROCm AI System Software Architect role at AMD .

Get AI-powered advice on this job and more exclusive features.

This range is provided by AMD. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$183,600.00 / yr - $275,400.00 / yr

About AMD

At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you’ll discover the real differentiator is our culture. We push the limits of innovation to solve the world’s most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond. Together, we advance your career.

The Person

You are an expert on efficient system software design and optimization. You have strong technical and analytical skills in C / C++ and Python, with experience in AI development across Windows and Linux environments. You’re familiar with GPU programming and compilers. As a capable problem-solver and a technical leader, you excel at defining goals, scoping projects, and driving development efforts. With excellent communication skills and a passion for AI technologies, you are motivated to deliver feature‑rich, efficient solutions to customers.

The Role

We are seeking an expert-level Machine Learning System Software Engineer to join the AMD GPU Technology and Engineering Software Team. You will develop cutting‑edge AI software technologies, optimize the AI software stack, and deliver innovative solutions with powerful engineer‑oriented debugging / profiling tools across AMD Radeon and Ryzen product families. Collaboration with cross-functional teams will be essential to ensure peak performance of AI solutions.

Key Responsibilities

  • Develop and deliver advanced AI software solutions for AMD customers and users.
  • Enable and optimize the AI software stack for frameworks like PyTorch, vLLM, and GGML / llama.cpp, as well as emerging open‑source AI software.
  • Implement state‑of‑the‑art AI models and enhance their performance.
  • Lead the full AI software development lifecycle, including scoping, implementation, integration, verification, and customer enablement.
  • Drive and deliver powerful debugging and profiling tools with consistent user experience across Radeon GPUs on both Linux and Windows.

Preferred Experience

  • Expertise in system software design and optimization, with experience on cross-platform development and programming languages C / C++ and Python.
  • Proven problem‑solving skills and effective communication abilities.
  • Experience with AI frameworks, inference stacks, and GPU-accelerated development, including GEMM, CONV, Flash Attention, fused MoE, and non‑linear operators.
  • Compiler and low-level GPU programming is a plus.
  • Solid understanding of AI / ML concepts, with knowledge of the performance impact of compute, memory, and communication configurations.
  • Open‑source software development experience is a plus.
  • Academic Credentials

  • Bachelor’s, Master’s, or PhD in Computer Science, Electrical Engineering, or a related field.
  • Benefits

    Benefits offered are described : AMD benefits at a glance.

    AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee‑based recruitment services.

    AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and / or third‑party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

    #J-18808-Ljbffr

    Create a job alert for this search

    Software Architect • Markham, York Region, CA

    Similar jobs
    Senior Applied AI Systems Developer / Architect

    Senior Applied AI Systems Developer / Architect

    Klick • Toronto, ON, Canada
    Full-time
    The Klick Group—comprising Klick Health (including Klick Katalyst and btwelve), Klick Media Group, Klick Applied Sciences (including Klick Labs), Klick Consulting, and Klick Ventures—is...Show more
    Last updated: 30+ days ago • Promoted
    Pega System Architect

    Pega System Architect

    Rules Cube • Toronto, Ontario, CA
    Full-time
    Quick Apply
    Work Location : Remote due to Covid Description Rules Cube is an official Pegasystems partner with deep expertise in building enterprise applications using PEGA. We are looking for a talented Pega Sy...Show more
    Last updated: 30+ days ago
    AI Agent Architect for Autonomous AI Systems

    AI Agent Architect for Autonomous AI Systems

    Atos SE • Toronto, Canada
    Full-time
    A global digital transformation leader is seeking a candidate in Windsor, Ontario, with expertise in LLMs and significant experience in designing and implementing agentic solutions.The role demands...Show more
    Last updated: 3 days ago • Promoted
    Engineer, AI Systems Architecture

    Engineer, AI Systems Architecture

    Qualcomm • Markham
    Full-time
    Engineer, AI Systems Architecture.Engineering Group, Machine Learning Engineering.Do you ever wonder when will connected devices become thinking devices? Be part of the group that is working on tec...Show more
    Last updated: 8 days ago • Promoted
    Chief Software Architect & AI Systems Lead

    Chief Software Architect & AI Systems Lead

    HRB • Toronto
    Full-time
    A leading company in the live operations games industry is seeking a Principal Engineer / Chief Software Architect.This pivotal role involves driving the evolution of core platforms, focusing on AI...Show more
    Last updated: 29 days ago • Promoted
    Senior AI Multi-Agent Systems Architect — Cloud Scale

    Senior AI Multi-Agent Systems Architect — Cloud Scale

    Huawei Canada • Markham
    Full-time
    A leading telecommunications firm in Markham, Ontario is looking for a Senior Principal Software Engineer - AI Multi-Agents. You will lead the design and deployment of innovative AI Multi-Agent syst...Show more
    Last updated: 29 days ago • Promoted
    Senior AI-Native Systems Architect

    Senior AI-Native Systems Architect

    Intuit Inc. • Toronto
    Full-time
    A leading software company in Toronto is seeking a Senior Staff / Principal Software Developer to enhance AI-native applications. The role involves driving technology initiatives, collaborating with c...Show more
    Last updated: 4 days ago • Promoted
    Software Architect - REMOTE

    Software Architect - REMOTE

    Jobgether • Toronto, Canada
    Remote
    Full-time
    This position is posted by Jobgether on behalf of a partner company.We are currently looking for a Software Architect.In this role, you will be instrumental in leading the technical direction of th...Show more
    Last updated: 5 days ago • Promoted
    Technical Architect : AI-Driven, Scalable Systems (Hybrid)

    Technical Architect : AI-Driven, Scalable Systems (Hybrid)

    ShyftLabs • Toronto
    Full-time
    A leading tech company in Toronto is looking for a Technical Architect to design and develop scalable systems.The role involves collaborating closely with the Product team, leading architectural ef...Show more
    Last updated: 21 days ago • Promoted
    ROCm AI System Software Architect

    ROCm AI System Software Architect

    Advanced Micro Devices • Markham
    Full-time
    WHAT YOU DO AT AMD CHANGES EVERYTHING.At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded syst...Show more
    Last updated: 6 days ago • Promoted
    ROCm AI System Software Architect

    ROCm AI System Software Architect

    AMD • Markham
    Full-time
    ROCm AI System Software Architect.Get AI-powered advice on this job and more exclusive features.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more....Show more
    Last updated: 29 days ago • Promoted
    Power Architect for AI Compute Systems

    Power Architect for AI Compute Systems

    Tenstorrent Inc. • Toronto
    Full-time
    An innovative technology company is seeking a Power Architect to lead architectural strategy and design decisions for high-performance AI compute systems. This hybrid role involves optimizing power ...Show more
    Last updated: 8 days ago • Promoted
    Head of AI Engineering & System Architecture

    Head of AI Engineering & System Architecture

    Siena AI • Toronto, ON, Canada
    Full-time
    A forward-thinking AI company in Toronto is seeking a Head of Engineering to lead the technical vision for an innovative customer experience platform. The ideal candidate will have a successful trac...Show more
    Last updated: 30+ days ago • Promoted
    Senior ASIC Design Architect - AI / ML Hardware IP

    Senior ASIC Design Architect - AI / ML Hardware IP

    Talentlab • Toronto
    Full-time
    A leading semiconductor company is seeking a Senior Staff ASIC Design Engineer to develop innovative AI / ML hardware IP in Toronto. This role requires expertise in ASIC design, RTL development, and i...Show more
    Last updated: 18 hours ago • Promoted • New!
    Senior Agentic AI Solutions Architect for Enterprise

    Senior Agentic AI Solutions Architect for Enterprise

    Netomi • Toronto
    Full-time
    A leading AI platform provider is seeking an experienced Agentic Product Manager responsible for designing and deploying large-scale AI solutions for enterprise clients. You will work with customers...Show more
    Last updated: 8 days ago • Promoted
    Senior Architect - Efficient AI Data Systems

    Senior Architect - Efficient AI Data Systems

    GuruLink • Toronto C6A, ON, Canada
    Full-time
    A leading AI Research Firm in Toronto seeks skilled engineers to design foundational data systems.Responsibilities include optimizing data processing through innovative metadata solutions and devel...Show more
    Last updated: 7 days ago • Promoted
    Growth-Focused Solutions Architect for AI / ML - Remote

    Growth-Focused Solutions Architect for AI / ML - Remote

    temporal • Toronto, Canada
    Remote
    Full-time
    A leading software development company in Canada is looking for individuals passionate about improving developer experiences and building open-source software. You will collaborate with clients to a...Show more
    Last updated: 6 days ago • Promoted
    Mgr, System Architect Infrastructure

    Mgr, System Architect Infrastructure

    Hydro One • Toronto
    Full-time
    Hydro One is proud to be the largest electricity transmission and distribution provider in Ontario, serving nearly 1.We have a long history in the industry with our roots dating back over 110 years...Show more
    Last updated: 8 days ago • Promoted