Talent.com
Software Development Engineer– GPU Kernel & Community Development
Software Development Engineer– GPU Kernel & Community DevelopmentAdvanced Micro Devices • Markham, York Region, CA
Software Development Engineer– GPU Kernel & Community Development

Software Development Engineer– GPU Kernel & Community Development

Advanced Micro Devices • Markham, York Region, CA
3 days ago
Job type
  • Full-time
Job description

Overview

WHAT YOU DO AT AMD CHANGES EVERYTHING. At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers to PCs, gaming and embedded systems. We focus on innovation, collaboration, and bold ideas to solve important challenges. Join us as we shape the future of AI and beyond. Together, we advance your career.

The Role

As a core member of the team, you will play a pivotal role in optimizing and developing deep learning frameworks for AMD GPUs. Your experience will be critical in enhancing GPU kernels, deep learning models, and training / inference performance across multi-GPU and multi-node systems. You will engage with internal GPU library teams and open-source maintainers to ensure seamless integration of optimizations, utilizing cutting-edge compiler technologies and advanced engineering principles to drive continuous improvement.

The Person

Skilled engineer with strong technical and analytical expertise in C++ development within Linux environments. The ideal candidate will thrive in both collaborative team settings and independent work, with the ability to define goals, manage development efforts, and deliver high-quality solutions. Strong problem-solving skills, a proactive approach, and a keen understanding of software engineering best practices are essential.

Key Responsibilities

  • Optimize Deep Learning Frameworks : Enhance and optimize frameworks like TensorFlow and PyTorch for AMD GPUs in open-source repositories.
  • Develop GPU Kernels : Create and optimize GPU kernels to maximize performance for specific AI operations.
  • Develop & Optimize Models : Design and optimize deep learning models specifically for AMD GPU performance.
  • Collaborate with GPU Library Teams : Work closely with internal teams to analyze and improve training and inference performance on AMD GPUs.
  • Collaborate with Open-Source Maintainers : Engage with framework maintainers to ensure code changes are aligned with requirements and integrated upstream.
  • Work in Distributed Computing Environments : Optimize deep learning performance on both scale-up (multi-GPU) and scale-out (multi-node) systems.
  • Utilize Cutting-Edge Compiler Tech : Leverage advanced compiler technologies to improve deep learning performance.
  • Optimize Deep Learning Pipeline : Enhance the full pipeline, including integrating graph compilers.
  • Software Engineering Best Practices : Apply sound engineering principles to ensure robust, maintainable solutions.
  • Outstanding written and verbal communication : Publish tutorials, technical blogs, and keep user guides, tutorials, and API references up to date.
  • Passion for open-source and AI acceleration : Community-oriented mindset.

Preferred Experience

  • GPU Kernel Development & Optimization : Experienced in designing and optimizing GPU kernels for deep learning on AMD GPUs using HIP, CUDA, and assembly (ASM). Strong knowledge of AMD architectures (GCN, RDNA) and low-level programming to maximize performance for AI operations, leveraging tools like Compute Kernel (CK), CUTLASS, and Triton for multi-GPU and multi-platform performance.
  • Deep Learning Integration : Experience in integrating optimized GPU performance into machine learning frameworks (e.g., PyTorch, vLLM) to accelerate model training and inference, with a focus on scaling and throughput.
  • Software Engineering : Skilled in Python and C++, with experience in debugging, performance tuning, and test design to ensure high-quality, maintainable software solutions.
  • Hands-on experience with modern inference engines such as vLLM, SGLang, or other large-scale or multi-modal inference runtimes.
  • Written and Verbal Communication : Outstanding communication skills and experienced in publishing technical tutorials and blogs, maintaining comprehensive and up-to-date user documentation, including user guides, tutorials, and API references.
  • Open-Source and AI Acceleration : Active contributor to open-source initiatives with a strong interest in AI acceleration technologies; values community collaboration and knowledge sharing to drive innovation and accessibility in AI development.
  • Academic Credentials

  • Bachelor’s and / or Master’s Degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
  • Benefits offered are described : AMD benefits at a glance.

    AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and / or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

    AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.

    This posting is for an existing vacancy.

    #J-18808-Ljbffr

    Create a job alert for this search

    Software Development Engineer GPU Kernel Community Development • Markham, York Region, CA

    Similar jobs
    Software Development Engineer, VSG, Ring

    Software Development Engineer, VSG, Ring

    Amazon • Toronto
    Full-time
    Software Development Engineer, VSG, Ring.Ring is looking for a Software Development Engineer to join and help grow the Ring VSG (Virtual Security Guard) team. Ring's mission is to make neighborhoods...Show more
    Last updated: 16 days ago • Promoted
    Software Engineer, Acceleration Kernel Development

    Software Engineer, Acceleration Kernel Development

    Tenstorrent • Toronto
    Full-time +1
    Software Engineer, Acceleration Kernel Development.Software Engineer, Acceleration Kernel Development.Tenstorrent is leading the industry on cutting‑edge AI technology, revolutionizing performance ...Show more
    Last updated: 16 days ago • Promoted
    MTS Software Development Engineer

    MTS Software Development Engineer

    Net2Source (N2S) • Markham
    Full-time
    Be among the first 25 applicants.This range is provided by Net2Source (N2S).Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Direct message the j...Show more
    Last updated: 16 days ago • Promoted
    Mobile Software Engineer I (Android developer)

    Mobile Software Engineer I (Android developer)

    TD • Toronto
    Full-time
    This role is eligible for a discretionary variable compensation award that considers business and individual performance. TD is committed to providing fair and equitable compensation opportunities t...Show more
    Last updated: 2 days ago • Promoted
    Senior Neural Network Kernel Software Development Engineer

    Senior Neural Network Kernel Software Development Engineer

    Targeted Talent • Toronto, ON, Canada
    Full-time
    Senior Neural Network Kernel Software Development Engineer.Our client is making substantial investments in software to enhance the seamless deployment of neural networks on their hardware, streamli...Show more
    Last updated: 30+ days ago • Promoted
    Product Development Engineer - Liquid Cooling

    Product Development Engineer - Liquid Cooling

    Amphenol TCS • Markham, ON, Canada
    Full-time
    Job Title : Product Development Engineer – Liquid Cooling for Front-End I / O Connectors.Amphenol is one of the largest manufacturers of interconnect products in the world.The Company designs, m...Show more
    Last updated: 21 days ago • Promoted
    Android Platform Engineer — Design System & Tooling

    Android Platform Engineer — Design System & Tooling

    League • Toronto, Canada
    Full-time
    A leading healthcare technology company is seeking a Software Engineer, Android to enhance their design system and platform while collaborating with cross-functional teams.Responsibilities include ...Show more
    Last updated: 6 days ago • Promoted
    Software Development Engineer - AI-Driven Ad Tech

    Software Development Engineer - AI-Driven Ad Tech

    Amazon Development Centre Canada ULC • Toronto
    Full-time
    A leading technology company is seeking a Software Development Engineer in Toronto, ON, to innovate in ad integration using AI technologies. You will design large-scale systems, optimize data pipeli...Show more
    Last updated: 1 day ago • Promoted
    Software Development Engineer 2, Trust Platform

    Software Development Engineer 2, Trust Platform

    Remitly Inc. • Toronto, Canada
    Full-time
    Software Development Engineer 2, Trust Platform page is loaded## Software Development Engineer 2, Trust Platformlocations : . New Westminster, British Columbia, Canadatime type : .Posted Yesterdayjob re...Show more
    Last updated: 23 days ago • Promoted
    Software Development Engineer III / Senior Software Development Engineer - Full Stack

    Software Development Engineer III / Senior Software Development Engineer - Full Stack

    Workday, Inc. • Toronto, Canada
    Full-time
    Software Development Engineer III / Senior Software Development Engineer - Full Stack page is loaded## Software Development Engineer III / Senior Software Development Engineer - Full Stackremote ty...Show more
    Last updated: 23 days ago • Promoted
    Senior Android Engineer

    Senior Android Engineer

    Kunai • Toronto, Canada
    Full-time
    Kunai builds full-stack technology solutions for banks, credit and payment networks, infrastructure providers, and their customers. Together, we are changing the world’s relationship with financial ...Show more
    Last updated: 23 days ago • Promoted
    Mobile Engineer

    Mobile Engineer

    Akkodis • Toronto C6A, ON, Canada
    Remote
    Full-time
    Get AI-powered advice on this job and more exclusive features.Direct message the job poster from Akkodis.Akkodis is seeking an Application Developer for a contract position with a client in Toronto...Show more
    Last updated: 30+ days ago • Promoted
    Software Development Engineer - GPU Debugger

    Software Development Engineer - GPU Debugger

    AMD • Markham
    Full-time
    Software Development Engineer - GPU Debugger.Be among the first 25 applicants.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.WHAT YOU DO AT AMD...Show more
    Last updated: 16 days ago • Promoted
    Senior Android Engineer — Kotlin, Jetpack, Scale & UX

    Senior Android Engineer — Kotlin, Jetpack, Scale & UX

    Skylight • Toronto, Canada
    Full-time
    A leading tech company in Canada seeks a Senior or Staff Android Software Engineer to develop innovative features for their applications. The role involves collaborating with product teams, writing ...Show more
    Last updated: 23 days ago • Promoted
    Software Engineer (Delphi Development)

    Software Engineer (Delphi Development)

    Scotiabank • Toronto, Canada
    Full-time
    Select how often (in days) to receive an alert : Title : Software Engineer (Delphi Development).Requisition ID : 241567 Join a purpose driven winning team, committed to results, in an inclusive and hi...Show more
    Last updated: 30+ days ago • Promoted
    Hardware Product Development Manager - Defense / C5ISR - Curtiss-Wright Corporation

    Hardware Product Development Manager - Defense / C5ISR - Curtiss-Wright Corporation

    Curtiss-Wright Corporation • richmond hill, on, ca
    Full-time
    Hardware Product Development Manager - Onsite Position.We’re looking for highly motivated.Product Development Manager (Hardware). Engineers responsible for the development of.You plan and oversee th...Show more
    Last updated: 7 hours ago • Promoted • New!
    Software Development Engineer at Workday – Canada, ON, Toronto

    Software Development Engineer at Workday – Canada, ON, Toronto

    Victrays • Toronto
    Full-time
    Software Development Engineer at Workday – Canada, ON, Toronto.Your work days are brighter here.At Workday, it all began with a conversation over breakfast. When our founders met at a sunny Californ...Show more
    Last updated: 16 days ago • Promoted
    Software Development Engineer

    Software Development Engineer

    Tetra Trust Company • Toronto
    Full-time
    Tetra Unity is revolutionizing how financial institutions deploy and manage digital asset operations at scale.Backed by $10 million from financial powerhouses including Wealthsimple, Shopify, Natio...Show more
    Last updated: 6 days ago • Promoted