Talent.com
Amazon Web Services (AWS)
Sr. Software Development Manager - Compiler, AWS Neuron, Annapurna LabsAmazon Web Services (AWS) • Toronto, ON, Canada
Sr. Software Development Manager - Compiler, AWS Neuron, Annapurna Labs

Sr. Software Development Manager - Compiler, AWS Neuron, Annapurna Labs

Amazon Web Services (AWS) • Toronto, ON, Canada
14 days ago
Salary
CA$357,800.00 yearly
Job type
  • Full-time
Job description

Overview

The Product: AWS Machine Learning accelerators are at the forefront of AWS innovation. The Inferentia chip delivers best‑in‑class ML inference performance at the lowest cost in the cloud. Trainium will deliver the best‑in‑class ML training performance with the most teraflops (TFLOPS) of compute power for ML in the cloud. This is enabled by a cutting‑edge software stack—the AWS Neuron Software Development Kit (SDK)—which includes an ML compiler, runtime and natively integrates into popular ML frameworks, such as PyTorch, TensorFlow and MxNet. The Neuron SDK optimizes performance of complex neural‑net models executed on AWS Inferentia and Trainium. AWS Neuron is used at scale with customers and partners like PyTorch, Epic Games, Snap, AirBnB, Autodesk, Amazon Alexa, Amazon Rekognition and other customers in various segments.

Responsibilities

  • Lead a team of compiler engineers in developing, deploying, and scaling a compiler targeting AWS Inferentia and Trainium.
  • Leverage vision and technical communication skills as a hands‑on partner to AWS ML services teams, contributing to pre‑silicon design, new product releases, optimizations, and features that meet customer needs.
  • Apply deep knowledge of resource management, scheduling, code generation, optimization and novel instruction architectures (CPU, NPU, GPU and emerging compute).
  • Drive software architecture efficiencies, implement automation, resolve root causes of defects, and build high‑impact solutions for a large customer base.
  • Participate in design discussions, code review, cross‑functional business decisions, and startup‑like development environment.

A Day in the Life

  • Design and code solutions that drive software architecture efficiencies.
  • Create metrics, implement automation, and improve bugs/defects.
  • Deliver high‑impact solutions to a large customer base.
  • Participate in design discussions, code review, and communicate with stakeholders.
  • Work cross‑functionally to influence business decisions with technical input.
  • Operate in a startup‑like environment, tackling the most important projects.

Basic Qualifications

  • 6+ years of engineering team management experience.
  • 8+ years of direct engineering work experience.
  • 6+ years of designing or architecting new and existing systems (design patterns, reliability and scaling).
  • Experience partnering with product or program management teams.
  • Demonstrated software engineering skills through relevant experience (internships, work, competitions, publications) and strong analytical, attention‑to‑detail and effective communication skills.

Preferred Qualifications

  • M.S. or Ph.D. in Computer Science or related technical field.
  • Experience with toolchains (LLVM, GCC) and code‑generation techniques for new hardware.
  • Knowledge of compiler internals from front end to runtime with emphasis on AI acceleration.

Location

Toronto, Canada – candidates must be currently located or willing to relocate.

Compensation

Base salary range: 214,200.00 – 357,800.00 CAD annually.

Equal Opportunity Statement

Amazon is an equal‑opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information.

#J-18808-Ljbffr
Create a job alert for this search

Sr. Software Development Manager - Compiler, AWS Neuron, Annapurna Labs • Toronto, ON, Canada

Similar jobs

Hybrid Software Development Manager Role

Themis Solutions Inc.toronto, on, Canada
Full-time

Clio is seeking a Software Development Manager to elevate engineering talent and technical innovation in legal AI.This hybrid role emphasizes collaboration, mentoring, and strategic growth.Your imp... Show more

 • Promoted

Remote Software Development Manager (React, C#, Azure)

Insight GlobalToronto, ON, CA
Remote
Full-time

A leading consulting firm is seeking experienced Software Development Managers to join a top HCM company in Canada.This fully remote role requires a strong background in software development, parti... Show more

 • Promoted

Manager 2, Software Development – Ai Tooling (Toronto) - C$165,000 - C$223,000 A Year

CgEast York, Canada
Full-time

Lead a team of 10-14 engineers building AI-powered developer tools, driving roadmap and execution for agentic workflows, and partnering with product development and leadership to enhance tax compli... Show more

 • Promoted

Software Development Manager - C$135,000 - C$150,000 A Year

U of T / Smith School of BusinessNorth York, Canada
Full-time

Leads technology initiatives, managing distributed teams, stakeholders, vendors, and budgets.Ensures successful delivery and operational readiness. Show more

 • Promoted

Sr. Manager, Software Development - C$160,000 - C$190,000 A Year

PropelToronto, Canada
Full-time

Lead high-performing teams building secure, scalable customer-facing web applications.Requires strong software engineering background, Agile experience, and leadership skills. Show more

 • Promoted

Software Development Manager, Alexa Audio - C$171,400 - C$286,200 A Year

Alexa AudioToronto, Canada
Full-time

Seeking a Software Development Manager to lead a team in developing innovative audio experiences for Alexa devices, focusing on features like Books & Classical Music and LLM-based interactions. Show more

 • Promoted

Software Development Manager, MADS

United States Digital Space LLCToronto, ON, CA
Full-time

The Measurement and Data Science (MADS) organization at Amazon Ads is looking for a Software Development Manager to lead an established engineering team in our Programmatic Reporting group.Advertis... Show more

 • Promoted

Senior Manager AI, Software Development Engineering

Thomson ReutersToronto, ON, CA
Full-time

Senior Manager AI, Software Development Engineering.Join Thomson Reuters to apply for the.Senior Manager AI, Software Development Engineering.Senior Manager AI, Software Development Engineering.Lea... Show more

 • Promoted

Manager, AI-Enabled Development

Dayforce US, Inc.Toronto, ON, CA
Full-time

Dayforce is a global human capital management (HCM) company headquartered in Toronto, Ontario, and Minneapolis, Minnesota, with operations across North America, Europe, Middle East, Africa (EMEA), ... Show more

 • Promoted

Sr Manager, Product Development

Quark ExpeditionsToronto, ON, CA
Full-time

Quark Expeditions is the leading polar expedition travel company headquartered in Toronto, Canada.We operate cruises to Antarctica and Arctic regions (Greenland, North Canada, Svalbard) on board of... Show more

 • Promoted

Software Development Manager, Ai Powered Search - C$176,000 - C$264,000 A Year

ClioEast York, Canada
Full-time

Manages software development teams, focusing on AI-powered search solutions.Requires strong technical leadership, people management, and a hands-on approach to coding and design. Show more

 • Promoted

Senior Manager Ai, Software Development Engineering

Thomson ReutersToronto, Canada
Full-time

Senior Manager AI, Software Development EngineeringJoin Thomson Reuters to apply for the Senior Manager AI, Software Development Engineering role.About the RoleIn this opportunity as Senior Manager... Show more

 • Promoted

Software Development Manager - $55.3 An Hour

PepperToronto County, Canada
Full-time

Manage software development operations, lead a team of engineers, and ensure high-quality code for global social commerce platforms. Show more

 • Promoted

Software Development Manager - C$145,000 - C$195,000 A Year

Loblaw DigitalToronto County, Canada
Full-time

Lead and grow a team of software engineers to deliver high-quality products and platforms, balancing technical execution, people leadership, and cross-functional collaboration.Drive best practices ... Show more

 • Promoted

Senior Manager, Software Development

Tangerine BankToronto, ON, CA
Full-time

Senior Manager, Software Development - Tangerine.Reporting to the Head of Engineering, Wealth, the Senior Manager of Engineering is responsible for providing leadership and direction on end‑to‑end ... Show more

 • Promoted

Software Development Manager

Themis Solutions Inc.Vancouver, Calgary, Toronto
Full-time

Clio is the global leader in legal AI technology, empowering legal professionals and law firms of every size to work smarter, faster, and more securely.This role is available to candidates across C... Show more

 • Promoted

Software Development Manager - $158,400 - $247,500 A Year

JaneEast York, Canada
Full-time

Hiring a Software Development Manager to lead two new focused teams (Invoicing and Purchasables) within Clinic Finances and Products.Responsibilities include fostering a healthy team environment, p... Show more

 • Promoted

Senior Software Development Manager, Front Doors & Ai - C$165,000 - C$223,000 A Year

Intuit Inc.East York, Canada
Full-time

Manage a software development team, design large-scale systems, and implement best practices. Show more

 • Promoted

Manager Software Development Investly

Fidelity CanadaToronto, ON, CA
Full-time

Current work authorization for Canada is required for all openings.You will be working on a flexible hybrid schedule as part of Fidelity’s dynamic working arrangement.The Manager, Software Developm... Show more

 • Promoted

Software Development Manager, Generative Ai - C$140,000 - C$205,700 A Year

AutodeskToronto, Canada
Full-time

Manages a full-stack engineering team integrating AI capabilities and agentic workflows into product experiences, focusing on data representations, developer tools, and client/server components.Tra... Show more