Huawei Canada has an immediate permanent opening for a Software Engineer.
About the team:
The Distributed Data Storage and Management Lab leads research in distributed data systems, aiming to develop next-generation cloud serverless products that encompass core infrastructure and databases. This lab addresses various data challenges, including cloud-native disaggregated databases, pay-by-query user models, and optimizing low-level data transfers via RDMA. Teams within this lab create advanced cloud serverless data infrastructure and implement cutting-edge networking technologies for Huawei's global AI infrastructure.
About the job:
Architect and develop frameworks and engines for next-generation serverless computing tailored to AI workloads (LLM training/inference, agent execution, RL training, etc.).
Analyze and optimize end-to-end AI system performance, including distributed scheduling, data flow, and memory utilization across large clusters.
Research and evaluate cutting-edge technologies in distributed computing, serverless infrastructure, reinforcement learning, and LLM-based AI agents.
Collaborate cross-functionally with research, product, and platform teams to transform conceptual AI agent or RL research into scalable production systems.
Contribute thought leadership through innovation, technical presentations, and patent generation.
Stay ahead of industry trends, assessing emerging tools and frameworks (e.g., Ray, SkyPilot, vLLM, DeepSpeed, Mojo, etc.) to inform team.
The total target annual compensation for this position ranges from $127,000 to $225,000 depending on education, experience, and demonstrated expertise.
About the ideal candidate:
PhD with research background in LLM systems, RL, AI agents, or distributed computing, or MS in Computer Science, Electrical Engineering, or related field with 3–4 years of AI industry experience.
Strong system design and software engineering skills, including experience with C++ or Python, concurrency, performance tuning, and large-scale distributed systems.
Proven expertise in one or more of the following areas:
o AI system architecture — LLM training/inference pipeline optimization, multi-agent orchestration, or reinforcement learning frameworks.
o Serverless / distributed infrastructure — autoscaling, resource scheduling, fault recovery, or cloud-native microservices.
Ability to lead complex technical projects, mentor peers, and deliver solutions with measurable impact.
Publications, open-source contributions, or patents in AI systems, RL, or distributed computing is an asset.
Familiarity with GPU cluster management, model parallelism, or memory-optimized inference (e.g., KVCache, offloading strategies) is an asset.
Demonstrated ability to bridge research and engineering, bringing experimental AI methods into production-grade systems is an asset.
Additional Information:
Huawei Canada is committed to a fair, inclusive, and accessible recruitment process. If you require accommodation during any stage of the hiring process, please let us know and we will work with you to meet your needs.
All applications for this position are reviewed directly by our hiring team, we do not use artificial intelligence tools to screen or select candidates.
AI Systems Engineer – Serverless Distributed Computing • Markham, ON, CA
We are seeking highly motivated and skilled systems engineers to join our team to help in developing an AI Platform that offers an efficient infrastructure for inference and training large scale mo...Show more
Drive the development of AI tools within system engineering processes as a Senior Engineer.Leverage your expertise in programming and predictive technologies to optimize engineering workflows while...Show more
Manulife is making a significant investment in Advanced Analytics and GenAI to transform how Finance, Treasury, and Actuarial teams make decisions! Our AI team builds practical, governed solutions ...Show more
A leading AI technology company is seeking a Software Engineer to design and optimize distributed infrastructure for AI agents.The ideal candidate will have strong backend programming skills and ex...Show more
A leading AI cloud platform company in Toronto is seeking a Solution Architect to deliver services regarding H2O Generative AI and Machine Learning products.This role requires a Bachelor's degree a...Show more
A leading cloud company in Vancouver is looking for a seasoned software developer to enhance productivity through best engineering practices.The role involves working on a wide range of technologie...Show more
Join as an Expert Software Engineer focused on building robust distributed systems.Leverage your skills in backend development and AI practices to support dynamic agent infrastructures across cutti...Show more
Agentic AI Systems Engineer/AI Solutions Engineer.Agentic AI Systems Engineer/AI Solutions Engineer.Direct message the job poster from ALTEN Canada.Talent Advisor | Engineering | Life Sciences | Te...Show more
Our client is a fast‑growing technology organization building next‑generation AI‑driven products.The team is focused on designing and scaling intelligent, autonomous systems that solve real‑world p...Show more
A leading technology company is seeking a Senior Systems Design Engineer to join their Data Center GPU team in Markham.This role involves driving scalable and automated solutions essential for prod...Show more
A leading technology services company in Toronto, Ontario, is seeking a Forward Deployed Engineer for Agentic AI.In this role, you'll design and implement innovative AI solutions that address busin...Show more
Enhance customer experience as a Technical Solutions Engineer.Provide expert support, troubleshoot issues, and optimize client configurations for seamless AI integration in housing and healthcare.I...Show more
Research Engineer - Decentralized AI Systems.Join to apply for the Research Engineer - Decentralized AI Systems role at Yotta Labs.Yotta Labs is pioneering the development of a Decentralized Operat...Show more
A leading AI technology company is seeking a Senior Backend Software Engineer to design and implement scalable backend services and infrastructure for an AI platform.Responsibilities include develo...Show more
A leading AI technology company in Toronto is seeking a Software Engineer to innovate in developing their massive AI supercomputers.Responsibilities include automating configuration of networking a...Show more
A leading tech company is seeking a Research Engineer specializing in decentralized AI systems.The role involves designing efficient workload orchestration for AI applications across a global netwo...Show more
Become an AI Systems Performance Engineer, specializing in kernel optimization and performance modeling.Drive efficiency in machine learning models and collaborate on innovative solutions in a dyna...Show more
A leading telecommunications company in Toronto seeks an AI Engineer to design and implement AI-powered applications.This role involves collaborating with senior engineers to build multi-step AI ag...Show more
