Job description
Huawei Canada has an immediate permanent opening for a Software Engineer.
About the team:
The Distributed Data Storage and Management Lab leads research in distributed data systems, aiming to develop next-generation cloud serverless products that encompass core infrastructure and databases. This lab addresses various data challenges, including cloud-native disaggregated databases, pay-by-query user models, and optimizing low-level data transfers via RDMA. Teams within this lab create advanced cloud serverless data infrastructure and implement cutting-edge networking technologies for Huawei's global AI infrastructure.
About the job:
Architect and develop frameworks and engines for next-generation serverless computing tailored to AI workloads (LLM training/inference, agent execution, RL training, etc.).
Analyze and optimize end-to-end AI system performance, including distributed scheduling, data flow, and memory utilization across large clusters.
Research and evaluate cutting-edge technologies in distributed computing, serverless infrastructure, reinforcement learning, and LLM-based AI agents.
Collaborate cross-functionally with research, product, and platform teams to transform conceptual AI agent or RL research into scalable production systems.
Contribute thought leadership through innovation, technical presentations, and patent generation.
Stay ahead of industry trends, assessing emerging tools and frameworks (e.g., Ray, SkyPilot, vLLM, DeepSpeed, Mojo, etc.) to inform team.
The total target annual compensation for this position ranges from $127,000 to $225,000 depending on education, experience, and demonstrated expertise.
Job requirements
About the ideal candidate:
PhD with research background in LLM systems, RL, AI agents, or distributed computing, or MS in Computer Science, Electrical Engineering, or related field with 3–4 years of AI industry experience.
Strong system design and software engineering skills, including experience with C++ or Python, concurrency, performance tuning, and large-scale distributed systems.
Proven expertise in one or more of the following areas:
o AI system architecture — LLM training/inference pipeline optimization, multi-agent orchestration, or reinforcement learning frameworks.
o Serverless / distributed infrastructure — autoscaling, resource scheduling, fault recovery, or cloud-native microservices.
Ability to lead complex technical projects, mentor peers, and deliver solutions with measurable impact.
Publications, open-source contributions, or patents in AI systems, RL, or distributed computing is an asset.
Familiarity with GPU cluster management, model parallelism, or memory-optimized inference (e.g., KVCache, offloading strategies) is an asset.
Demonstrated ability to bridge research and engineering, bringing experimental AI methods into production-grade systems is an asset.
Additional Information:
Huawei Canada is committed to a fair, inclusive, and accessible recruitment process. If you require accommodation during any stage of the hiring process, please let us know and we will work with you to meet your needs.
All applications for this position are reviewed directly by our hiring team, we do not use artificial intelligence tools to screen or select candidates.
AI Systems Engineer – Serverless Distributed Computing • Markham, Ontario, CA
Client: Enterprise class EMR provider.On behalf of our client, Affinity is seeking a DevOps Engineer to build and evolve the infrastructure behind its flagship EMR platform.You’ll own Kubernetes-ba... Show more
Huawei Canada has an immediate permanent opening for a Software Engineer.The Distributed Data Storage and Management Lab leads research in distributed data systems, aiming to develop next-generatio... Show more
About Us Betstamp is the future of sports betting.We were founded in 2020 to make sports betting easy and accessible to everyone, while also improving your odds of winning your bets.Our team is ded... Show more
Distinguished Engineer - AI Computing System.Huawei Canada has an immediate permanent opening for a.Distinguished Engineer - AI Computing System.Lead in training cluster software frameworks and tec... Show more
Client: Enterprise class EMR provider.On behalf of our client, Affinity is seeking a DevOps Engineer to build and evolve the infrastructure behind its flagship EMR platform.You’ll own Kubernetes-ba... Show more
Impact client relationships by developing AI-driven systems as a Forward Deployed Engineer.Utilize your technical skills in Python and cloud technology to bridge solutions directly in customer work... Show more
Advance AI technology as a Senior Backend Engineer.Focus on designing robust systems for AI applications, enhancing usability, flexibility, and performance in production settings.In this pivotal ro... Show more
Transform AI capabilities as a Senior Engineer in distributed systems.Focus on building secure, cloud-native platforms that enable enterprise-grade AI solutions using modern infrastructure practice... Show more
Become a Site Reliability Engineer to support cutting-edge AI technologies.Ensure system reliability and operational effectiveness utilizing your Linux and automation skills in a hybrid setup.In th... Show more
Empower AI solutions by managing data integration as a Data Engineer.Focus on designing systems that enable autonomous AI agents to interact seamlessly within enterprise frameworks.This key role de... Show more
We are looking for an experienced AI Engineer to develop Generative and Agentic AI solutions.Utilize large language models (LLMs) and orchestration frameworks to enhance enterprise AI capabilities.... Show more
Become a key player in AI technology as a Performance Engineer focused on enhancing software performance and system optimizations for ML applications.Work within an innovative Runtime Team to push ... Show more
A leading technology services company in Toronto, Ontario, is seeking a Forward Deployed Engineer for Agentic AI.In this role, you'll design and implement innovative AI solutions that address busin... Show more
Our client is a fast‑growing technology organization building next‑generation AI‑driven products.The team is focused on designing and scaling intelligent, autonomous systems that solve real‑world p... Show more
Generative AI Developer (Retail/CPG).Seeking a GenAI Developer with expertise in LLMs, RAG, and prompt engineering.Build scalable AI solutions using Python, LangChain, HuggingFace, and vector DBs l... Show more
Generative AI Developer (Retail/CPG).Seeking a GenAI Developer with expertise in LLMs, RAG, and prompt engineering.Build scalable AI solutions using Python, LangChain, HuggingFace, and vector DBs l... Show more
A leading tech company is seeking a Research Engineer specializing in decentralized AI systems.The role involves designing efficient workload orchestration for AI applications across a global netwo... Show more
We are currently seeking a Agentic AI Systems Developer - Remote to join our team in Toronto, Ontario (CA-ON), Canada (CA).You will design and build agentic AI systems for healthcare using the Neur... Show more
