Talent.com
Principal Engineer - Gen AI training and inferencing
Principal Engineer - Gen AI training and inferencingAdvanced Micro Devices, Inc • MARKHAM, Ontario, Canada
Principal Engineer - Gen AI training and inferencing

Principal Engineer - Gen AI training and inferencing

Advanced Micro Devices, Inc • MARKHAM, Ontario, Canada
7 days ago
Job type
  • Full-time
Job description

WHAT YOU DO AT AMD CHANGES EVERYTHING At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you’ll discover the real differentiator is our culture. We push the limits of innovation to solve the world’s most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond. Together, we advance your career. THE ROLE : The AI Models and Applications team at AMD is looking for a specialized Principal level engineer who is passionate about enabling innovative and efficient Generative AI training / inferencing at scale. You will be part of a core team of incredibly talented specialists and work on scaling training and inference for the latest Generative AI models. THE PERSON : The ideal candidate has deep technical understanding of the latest generative AI applications like large language models (LLMs), large multimodal models (LMMs), image / video generation, has experience training models at scale and is passionate about innovating efficient approaches to enable distributed training and inference at scale on AMD devices. Why Join Us? Exciting Opportunities : As a Senior member on the team, you will be at the forefront of innovation, working with the latest Gen AI models and algorithms. You will have the opportunity to shape the future of AI model training and inference optimizations across a variety of applications. Talented Team : Join a team of highly skilled industry specialists who are passionate about pushing the boundaries of AI. Collaborate with like-minded professionals and learn from the best in the field. Cutting-edge Technology : Work with state-of-the-art GenAI algorithms and software enabling you to stay ahead of the curve and drive advancements in AI model training at Scale and deployment. Impactful Work : Your contributions will directly influence how cutting-edge gen AI models across the industry are efficiently trained at scale as well as inferencing deployed to serve millions of customers, making a significant difference in various industries and applications. KEY RESPONSIBILITIES : Propose and apply innovative techniques to support both training and inferencing including innovative transformer architectures, parallelism strategies to train on large clusters, low-precision training. Implement novel efficient architectures for Generative AI models for training and inference and showcase benefits on AMD Work with open-source framework and community (e.g., PyTorch, JAX, Hugging Face) to integrate AMD optimized models, libraries and publish training recipes. Collaborate with software and hardware team to E2E co-optimize performance on current and future AMD solutions. Publish and promote your work within AMD and at external venues. PREFERRED EXPERIENCE : Strong technical expertise in Gen AI model training and inference, and familiarity working with deep learning frameworks like PyTorch / JAX. Strong technical expertise in algorithmic innovation towards efficient Gen AI application for both training and inferencing. Expertise / publications in one of the areas preferred - efficient model architectures, optimized training, innovative parallelism strategies or low-precision training. Additional plus if publications include conferences such as NeuRIPS, CVPR, ECCV / ICCV, ICML, ICLR, etc. Experience productizing generative AI models and training foundation model at Scale Excellent written, verbal, and presentation skills, ability to coordinate internally and externally. Several years of experience in AI, deep learning and related software development. ACADEMIC CREDENTIALS : PhD or master’s degree or above; with major in CS, EE, Mathematics, or a related field. LOCATION : Markham, Ontario, Canada (Hybrid) Can also consider Calgary, Alberta, Canada #LI-MV1 #HYBRID Benefits offered are described : AMD benefits at a glance. AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and / or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process. AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here. This posting is for an existing vacancy.THE ROLE : The AI Models and Applications team at AMD is looking for a specialized Principal level engineer who is passionate about enabling innovative and efficient Generative AI training / inferencing at scale. You will be part of a core team of incredibly talented specialists and work on scaling training and inference for the latest Generative AI models. THE PERSON : The ideal candidate has deep technical understanding of the latest generative AI applications like large language models (LLMs), large multimodal models (LMMs), image / video generation, has experience training models at scale and is passionate about innovating efficient approaches to enable distributed training and inference at scale on AMD devices. Why Join Us? Exciting Opportunities : As a Senior member on the team, you will be at the forefront of innovation, working with the latest Gen AI models and algorithms. You will have the opportunity to shape the future of AI model training and inference optimizations across a variety of applications. Talented Team : Join a team of highly skilled industry specialists who are passionate about pushing the boundaries of AI. Collaborate with like-minded professionals and learn from the best in the field. Cutting-edge Technology : Work with state-of-the-art GenAI algorithms and software enabling you to stay ahead of the curve and drive advancements in AI model training at Scale and deployment. Impactful Work : Your contributions will directly influence how cutting-edge gen AI models across the industry are efficiently trained at scale as well as inferencing deployed to serve millions of customers, making a significant difference in various industries and applications. KEY RESPONSIBILITIES : Propose and apply innovative techniques to support both training and inferencing including innovative transformer architectures, parallelism strategies to train on large clusters, low-precision training. Implement novel efficient architectures for Generative AI models for training and inference and showcase benefits on AMD Work with open-source framework and community (e.g., PyTorch, JAX, Hugging Face) to integrate AMD optimized models, libraries and publish training recipes. Collaborate with software and hardware team to E2E co-optimize performance on current and future AMD solutions. Publish and promote your work within AMD and at external venues. PREFERRED EXPERIENCE : Strong technical expertise in Gen AI model training and inference, and familiarity working with deep learning frameworks like PyTorch / JAX. Strong technical expertise in algorithmic innovation towards efficient Gen AI application for both training and inferencing. Expertise / publications in one of the areas preferred - efficient model architectures, optimized training, innovative parallelism strategies or low-precision training. Additional plus if publications include conferences such as NeuRIPS, CVPR, ECCV / ICCV, ICML, ICLR, etc. Experience productizing generative AI models and training foundation model at Scale Excellent written, verbal, and presentation skills, ability to coordinate internally and externally. Several years of experience in AI, deep learning and related software development. ACADEMIC CREDENTIALS : PhD or master’s degree or above; with major in CS, EE, Mathematics, or a related field. LOCATION : Markham, Ontario, Canada (Hybrid) Can also consider Calgary, Alberta, Canada #LI-MV1 #HYBRID

Benefits offered are described : AMD benefits at a glance. AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and / or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process. AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here. This posting is for an existing vacancy.

Create a job alert for this search

Principal Engineer Gen AI training and inferencing • MARKHAM, Ontario, Canada

Similar jobs
Principal AI Platform Engineer

Principal AI Platform Engineer

PowerToFly • Toronto
Full-time
A leading technology company based in Toronto, Canada is seeking a Principal Software Engineer to design and implement AI features on their platform. The ideal candidate will have a solid background...Show more
Last updated: 17 days ago • Promoted
Principal Analytics Engineer

Principal Analytics Engineer

Latinxinai • Toronto
Full-time
Your work days are brighter here.We’re obsessed with making hard work pay off, for our people, our customers, and the world around us. As a Fortune 500 company and a leading AI platform for managing...Show more
Last updated: 14 days ago • Promoted
Gen AI Architect

Gen AI Architect

Smart IT Frame LLC • Toronto
Full-time
AI systems centered on Agentic AI, advanced RAG patterns, multimodal model integration, and secure orchestration frameworks. The architect will drive standards for multi-agent orchestration, tool ca...Show more
Last updated: 4 days ago • Promoted
Gen AI Developer

Gen AI Developer

Virtusa • Toronto
Full-time
GEN AI Developer with 3 years of Experience.Build and support high-impact data science and machine learning POCs using Python and modern ML libraries. Develop and iterate on AI and Generative AI sol...Show more
Last updated: 21 days ago • Promoted
Senior Principal Engineer - Cognitive Enhancement for Foundation Model Applications

Senior Principal Engineer - Cognitive Enhancement for Foundation Model Applications

Huawei Canada • Markham
Full-time +1
Senior Principal Engineer - Cognitive Enhancement for Foundation Model Applications.Huawei Canada has an immediate permanent opening for a Senior Principal Engineer. The Distributed Data Storage and...Show more
Last updated: 21 days ago • Promoted
Principal Engineer - Gen AI training and inferencing

Principal Engineer - Gen AI training and inferencing

Advanced Micro Devices • Markham
Full-time
WHAT YOU DO AT AMD CHANGES EVERYTHING.At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded syst...Show more
Last updated: 3 days ago • Promoted
GEN AI Engineer

GEN AI Engineer

Manulife • Toronto
Full-time
Design, build, and maintain data pipelines to ingest, curate, and index data for AI and Generative AI applications.Collaborate with Data Scientists to develop GenAI solutions that solve complex bus...Show more
Last updated: 17 days ago • Promoted
Staff PM, AI Platform — Build Next-Gen AI Foundations

Staff PM, AI Platform — Build Next-Gen AI Foundations

Affinity.co • Toronto
Full-time
A technology firm located in Toronto is searching for a Staff Product Manager for its AI Platform.In this pivotal role, you'll be responsible for leading the strategy and execution of core AI servi...Show more
Last updated: 3 days ago • Promoted
Principal AI Engineer

Principal AI Engineer

Dayforce US, Inc. • Toronto
Full-time
Dayforce is a global human capital management (HCM) company headquartered in Toronto, Ontario, and Minneapolis, Minnesota, with operations across North America, Europe, Middle East, Africa (EMEA), ...Show more
Last updated: 21 days ago • Promoted
Senior Principal Researcher - AI for Science

Senior Principal Researcher - AI for Science

Huawei Technologies Canada Co., Ltd. • Markham
Full-time +1
Huawei Canada has an immediate permanent opening for a Senior Principal Researcher - AI4Science.The Technology Planning and Cooperation Department promotes strategic innovation across all of Huawei...Show more
Last updated: 21 days ago • Promoted
Principal Engineer - Gen AI training and inferencing

Principal Engineer - Gen AI training and inferencing

AMD • Markham
Full-time
PRINCIPAL SOFTWARE DEVELOPMENT ENGINEER — The AI Models and Applications team at AMD is looking for a specialized Principal level engineer who is passionate about enabling innovative and efficient ...Show more
Last updated: 1 day ago • Promoted
Principal Analytics Engineer

Principal Analytics Engineer

Workday • Toronto
Full-time
Your work days are brighter here.We’re obsessed with making hard work pay off, for our people, our customers, and the world around us. As a Fortune 500 company and a leading AI platform for managing...Show more
Last updated: 4 days ago • Promoted
Principal Analytics Engineer

Principal Analytics Engineer

Workday, Inc. • Toronto
Full-time
Your work days are brighter here.We’re obsessed with making hard work pay off, for our people, our customers, and the world around us. As a Fortune 500 company and a leading AI platform for managing...Show more
Last updated: 14 days ago • Promoted
AI Agentic Platform Engineer (Contractual / FTE - Hybrid in Toronto)

AI Agentic Platform Engineer (Contractual / FTE - Hybrid in Toronto)

BDO Canada LLP • Toronto
Full-time
Putting people first, every day • •BDO is a firm built on a foundation of positive relationships with our people and our clients. Each day, our professionals provide exceptional service, helping clien...Show more
Last updated: 17 days ago • Promoted
GEN AI Engineer

GEN AI Engineer

Manulife Insurance Malaysia • Toronto
Full-time
Nous utilisons des • •pour fournir des statistiques qui nous aident à vous offrir la meilleure expérience sur note site.Vous y trouverez des renseignements sur les témoins, ou vous pouvez les désac...Show more
Last updated: 21 days ago • Promoted
Principal Machine Learning Engineer

Principal Machine Learning Engineer

Tubi, Inc. • Toronto
Full-time
Boldly built for every fandom, Tubi is a free streaming service that entertains over 100 million monthly active users.Tubi offers the world's largest collection of Hollywood movies and TV shows, th...Show more
Last updated: 21 days ago • Promoted
Gen AI Architect

Gen AI Architect

Wipro • Toronto
Full-time
Generative AI (Gen AI) : LLMs, prompt engineering, fine‑tuning, model deployment.Agentic AI : Experience in designing and deploying agent‑based AI systems for autonomous decision‑making.Python : Advan...Show more
Last updated: 21 days ago • Promoted
Principal Engineer, AI Compiler

Principal Engineer, AI Compiler

Tenstorrent • Toronto
Full-time +1
Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency. With AI redefining the computing paradigm, solutions mu...Show more
Last updated: 21 days ago • Promoted