Talent.com
ROCm AI System Software Architect
ROCm AI System Software ArchitectAMD • Markham, York Region, CA
ROCm AI System Software Architect

ROCm AI System Software Architect

AMD • Markham, York Region, CA
30+ days ago
Job type
  • Full-time
Job description

Join to apply for the ROCm AI System Software Architect role at AMD .

Get AI-powered advice on this job and more exclusive features.

This range is provided by AMD. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$183,600.00 / yr - $275,400.00 / yr

About AMD

At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you’ll discover the real differentiator is our culture. We push the limits of innovation to solve the world’s most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond. Together, we advance your career.

The Person

You are an expert on efficient system software design and optimization. You have strong technical and analytical skills in C / C++ and Python, with experience in AI development across Windows and Linux environments. You’re familiar with GPU programming and compilers. As a capable problem-solver and a technical leader, you excel at defining goals, scoping projects, and driving development efforts. With excellent communication skills and a passion for AI technologies, you are motivated to deliver feature‑rich, efficient solutions to customers.

The Role

We are seeking an expert-level Machine Learning System Software Engineer to join the AMD GPU Technology and Engineering Software Team. You will develop cutting‑edge AI software technologies, optimize the AI software stack, and deliver innovative solutions with powerful engineer‑oriented debugging / profiling tools across AMD Radeon and Ryzen product families. Collaboration with cross-functional teams will be essential to ensure peak performance of AI solutions.

Key Responsibilities

  • Develop and deliver advanced AI software solutions for AMD customers and users.
  • Enable and optimize the AI software stack for frameworks like PyTorch, vLLM, and GGML / llama.cpp, as well as emerging open‑source AI software.
  • Implement state‑of‑the‑art AI models and enhance their performance.
  • Lead the full AI software development lifecycle, including scoping, implementation, integration, verification, and customer enablement.
  • Drive and deliver powerful debugging and profiling tools with consistent user experience across Radeon GPUs on both Linux and Windows.

Preferred Experience

  • Expertise in system software design and optimization, with experience on cross-platform development and programming languages C / C++ and Python.
  • Proven problem‑solving skills and effective communication abilities.
  • Experience with AI frameworks, inference stacks, and GPU-accelerated development, including GEMM, CONV, Flash Attention, fused MoE, and non‑linear operators.
  • Compiler and low-level GPU programming is a plus.
  • Solid understanding of AI / ML concepts, with knowledge of the performance impact of compute, memory, and communication configurations.
  • Open‑source software development experience is a plus.
  • Academic Credentials

  • Bachelor’s, Master’s, or PhD in Computer Science, Electrical Engineering, or a related field.
  • Benefits

    Benefits offered are described : AMD benefits at a glance.

    AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee‑based recruitment services.

    AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and / or third‑party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

    #J-18808-Ljbffr

    Create a job alert for this search

    Software Architect • Markham, York Region, CA

    Similar jobs
    AI / ML Solutions Architect

    AI / ML Solutions Architect

    Avahi • Toronto C6A, ON, Canada
    Remote
    Full-time
    At Avahi, we’re redefining what it means to be a premier cloud‑first consulting company, recognized for our people, culture, and innovative solutions. With expertise in Managed Services, Reselling, ...Show more
    Last updated: 30+ days ago • Promoted
    AV System Architect

    AV System Architect

    AeroVect • Toronto C6A, ON, Canada
    Full-time
    Be among the first 25 applicants.AeroVect is transforming ground handling with autonomy, redefining how airlines and ground service providers around the globe run day-to-day operations.We are a Ser...Show more
    Last updated: 2 days ago • Promoted
    Senior AI Engineer - RAG & Production ML Systems

    Senior AI Engineer - RAG & Production ML Systems

    Refinitiv • Toronto C6A, ON, Canada
    Remote
    Full-time
    A leading technology firm is seeking a Senior Software Engineer - AI II to design and implement complex AI systems, ensuring quality and compliance. This role demands collaboration with cross-functi...Show more
    Last updated: 2 days ago • Promoted
    AI Solution Architect

    AI Solution Architect

    PricewaterhouseCoopers International • Toronto C6A, ON, Canada
    Full-time
    Step into a pivotal leadership role as a Gen AI Senior Solutions Architect within our dynamic Products & Technology organization, where you'll have the opportunity to shape the future of digital so...Show more
    Last updated: 30+ days ago • Promoted
    Remote AI Solutions Architect for Enterprise Platform

    Remote AI Solutions Architect for Enterprise Platform

    Cisco Systems • Toronto C6A, ON, Canada
    Remote
    Full-time
    A leading technology company is looking for an AI Solution Architect to join their team.The position is remote and involves working with AI and machine learning solutions to assist clients in overc...Show more
    Last updated: 1 day ago • Promoted
    Senior Principal Architect, Enterprise Architecture- Artificial Intelligence

    Senior Principal Architect, Enterprise Architecture- Artificial Intelligence

    Scotiabank • Toronto C6A, ON, Canada
    Full-time
    Title : Senior Principal Architect, Enterprise Architecture - Artificial Intelligence.Join a purpose driven winning team, committed to results, in an inclusive and high‑performing culture.The Enterp...Show more
    Last updated: 30+ days ago • Promoted
    Senior AI Software Engineer – RAG Systems (Hybrid)

    Senior AI Software Engineer – RAG Systems (Hybrid)

    TRSS • Toronto C6A, ON, Canada
    Remote
    Full-time
    A leading global technology company in Toronto seeks a Senior Software Engineer - AI to develop AI-driven software that enhances tax and accounting workflows. This role involves implementing complex...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Remote‑Flexible Enterprise AI Solutions Architect

    Remote‑Flexible Enterprise AI Solutions Architect

    Cohere • Toronto C6A, ON, Canada
    Remote
    Full-time
    A leading AI solutions provider in Toronto is seeking a Solutions Architect to drive customer-centric AI solutions.In this role, you'll develop scalable NLP solutions, collaborate with stakeholders...Show more
    Last updated: 11 days ago • Promoted
    Senior SoC Verification Architect – Cloud ML Accelerators

    Senior SoC Verification Architect – Cloud ML Accelerators

    Amazon Web Services (AWS) • Toronto C6A, ON, Canada
    Full-time
    A global cloud services leader is seeking a design verification engineer in Toronto to enhance its innovative team.In this role, you'll verify hardware and software solutions, develop multi-faceted...Show more
    Last updated: 30+ days ago • Promoted
    AI Solutions Architect - Enterprise (Remote)

    AI Solutions Architect - Enterprise (Remote)

    Cisco • Toronto C6A, ON, Canada
    Remote
    Full-time
    AI Solutions Architect - Enterprise (Remote).Get AI-powered advice on this job and more exclusive features.The application window is expected to close on : 1 / 14 / 26. This position is remote and can be...Show more
    Last updated: 2 days ago • Promoted
    Software Architect, Applied AI

    Software Architect, Applied AI

    PowerToFly • Toronto C6A, ON, Canada
    Full-time
    Job Requisition ID #25WD94061, Software Architect, Applied AI.If you love building real systems that real customers use—and you get genuinely excited about LLMs, RAG, MCP, and agentic architectures...Show more
    Last updated: 1 day ago • Promoted
    Software Architect (AI Platform)

    Software Architect (AI Platform)

    Conga • Southwestern Ontario, Toronto, Ontario, Ontario, Canada
    Full-time
    A career that’s the whole package!.At Conga, we’ve built a community where our colleagues can thrive.Here you’ll find opportunities to innovate and support growth through individual and team develo...Show more
    Last updated: 30+ days ago • Promoted
    RQ10051 - Sr. Applications Architect

    RQ10051 - Sr. Applications Architect

    Source Code • Toronto C6A, ON, Canada
    Full-time
    Central Agencies Cluster - Ministry of Treasury Board Secretariat.Applied to both the process and the outcome of thinking out and specifying the overall structure, logical components, and the logic...Show more
    Last updated: 30+ days ago • Promoted
    Strategic System Architect for Enablement Platforms Hybrid

    Strategic System Architect for Enablement Platforms Hybrid

    Sky • Toronto C6A, ON, Canada
    Remote
    Full-time
    A leading technology company in Toronto is seeking an experienced Software Engineer to define technology strategies and engage with cross-functional teams. The ideal candidate will have a strong bac...Show more
    Last updated: 1 day ago • Promoted
    Remote Software Architect : Lead Distributed Systems

    Remote Software Architect : Lead Distributed Systems

    Phreesia, Inc. • Toronto C6A, ON, Canada
    Remote
    Full-time
    A leading healthcare technology firm is seeking a Software Architect to lead the design and development of complex distributed software systems. This role involves collaborating closely with product...Show more
    Last updated: 1 day ago • Promoted
    Remote Rail Software Architect & System Design Lead

    Remote Rail Software Architect & System Design Lead

    Hitachi Vantara Corporation • Toronto C6A, ON, Canada
    Remote
    Full-time
    A global technology solutions provider is seeking a Software Architect in Toronto, Ontario, Canada.The successful candidate will have a minimum of 10 years relevant experience and will be responsib...Show more
    Last updated: 3 days ago • Promoted
    Senior AI Multi-Agent Systems Architect — Cloud Scale

    Senior AI Multi-Agent Systems Architect — Cloud Scale

    Huawei Canada • Markham, York Region, Canada
    Full-time
    A leading telecommunications firm in Markham, Ontario is looking for a Senior Principal Software Engineer - AI Multi-Agents. You will lead the design and deployment of innovative AI Multi-Agent syst...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Architect - AI Platform Lead (Remote)

    Senior Software Architect - AI Platform Lead (Remote)

    Crossover • Toronto C6A, ON, Canada
    Remote
    Full-time
    A global hiring platform is seeking a Senior Software Architect to drive technical and AI leadership while implementing complex components of the codebase. With a focus on strategic decisions and qu...Show more
    Last updated: 2 days ago • Promoted