Job description
Huawei Canada has an immediate permanent opening for a Software Engineer.
About the team:
The Distributed Data Storage and Management Lab leads research in distributed data systems, aiming to develop next-generation cloud serverless products that encompass core infrastructure and databases. This lab addresses various data challenges, including cloud-native disaggregated databases, pay-by-query user models, and optimizing low-level data transfers via RDMA. Teams within this lab create advanced cloud serverless data infrastructure and implement cutting-edge networking technologies for Huawei's global AI infrastructure.
About the job:
Architect and develop frameworks and engines for next-generation serverless computing tailored to AI workloads (LLM training/inference, agent execution, RL training, etc.).
Analyze and optimize end-to-end AI system performance, including distributed scheduling, data flow, and memory utilization across large clusters.
Research and evaluate cutting-edge technologies in distributed computing, serverless infrastructure, reinforcement learning, and LLM-based AI agents.
Collaborate cross-functionally with research, product, and platform teams to transform conceptual AI agent or RL research into scalable production systems.
Contribute thought leadership through innovation, technical presentations, and patent generation.
Stay ahead of industry trends, assessing emerging tools and frameworks (e.g., Ray, SkyPilot, vLLM, DeepSpeed, Mojo, etc.) to inform team.
The total target annual compensation for this position ranges from $127,000 to $225,000 depending on education, experience, and demonstrated expertise.
Job requirements
About the ideal candidate:
PhD with research background in LLM systems, RL, AI agents, or distributed computing, or MS in Computer Science, Electrical Engineering, or related field with 3–4 years of AI industry experience.
Strong system design and software engineering skills, including experience with C++ or Python, concurrency, performance tuning, and large-scale distributed systems.
Proven expertise in one or more of the following areas:
o AI system architecture — LLM training/inference pipeline optimization, multi-agent orchestration, or reinforcement learning frameworks.
o Serverless / distributed infrastructure — autoscaling, resource scheduling, fault recovery, or cloud-native microservices.
Ability to lead complex technical projects, mentor peers, and deliver solutions with measurable impact.
Publications, open-source contributions, or patents in AI systems, RL, or distributed computing is an asset.
Familiarity with GPU cluster management, model parallelism, or memory-optimized inference (e.g., KVCache, offloading strategies) is an asset.
Demonstrated ability to bridge research and engineering, bringing experimental AI methods into production-grade systems is an asset.
Additional Information:
Huawei Canada is committed to a fair, inclusive, and accessible recruitment process. If you require accommodation during any stage of the hiring process, please let us know and we will work with you to meet your needs.
All applications for this position are reviewed directly by our hiring team, we do not use artificial intelligence tools to screen or select candidates.
AI Systems Engineer – Serverless Distributed Computing • Markham, Ontario, CA
We are seeking highly motivated and skilled systems engineers to join our team to help in developing an AI Platform that offers an efficient infrastructure for inference and training large scale mo... Show more
Be part of Autodesk's evolution with the role of Senior Software Engineer in the hybrid model.Focus on building scalable AI-driven data systems based in the San Francisco Bay Area.As a key member o... Show more
Get AI-powered advice on this job and more exclusive features.We’re building an AI intelligence infrastructure embedded inside a B2B platform used by consumer brands to manage creative work, assets... Show more
Elevate your career as an AI Solutions Engineer at Connor, Clark & Lunn Financial Group.Focus on building AI systems that enhance client interactions and operational efficiency.This role calls for ... Show more
Make a difference with Speechify as a Software Engineer in our Data-focused AI team.Contribute to scalable and efficient data collection for our award-winning text-to-speech products, all in a remo... Show more
Elevate your career as an AI Solutions Engineer with a remote role for a California-based client.Focus on designing and launching innovative AI initiatives that drive business success.We're buildin... Show more
We are currently seeking a Agentic AI Systems Developer - Remote to join our team in Toronto, Ontario (CA-ON), Canada (CA).You will design and build agentic AI systems for healthcare using the Neur... Show more
Role: GenAI Engineer with a Data Engineering background and experienced in building Generative AI solutions in Cloud environment.Job Posting Description: GenAI engineer –.Looking for a GenAI Engine... Show more
A leading AI solutions company in Toronto is seeking a highly technical Solutions Engineer to manage customer relationships and ensure seamless AI integration into enterprise environments.This role... Show more
Shape the future of quantum computing as a Quantum AI Systems Developer.Utilize your AI skills to elevate R&D capabilities and build innovative tool stacks.This role is essential for integrating ge... Show more
The AI Accelerator team sits at the center of Morningstar’s Generative AI strategy for the Direct Platform.We build and scale core systems such as the Morningstar MCP Server, MCP Gateway, and Morni... Show more
Socure is building the identity trust infrastructure for the digital economy — verifying 100% of good identities in real time and stopping fraud before it starts.The mission is big, the problems ar... Show more
Betstamp is the future of sports betting.We were founded in 2020 to make sports betting easy and accessible to everyone, while also improving your odds of winning your bets.Our team is dedicated to... Show more
Join Gatekeeper to empower compliance-driven organizations as a Solutions Engineer specializing in customer success.This fully remote role allows you to help clients leverage innovative AI features... Show more
Lead the development of advanced AI inference systems as a Principal Engineer.Design and implement robust platforms for agentic functionality across multiple data modalities.In this pivotal role, y... Show more
AI engine that powers how the company scales.This cross‑functional role sits across Sales, RevOps, Growth, BizOps, and more, and is responsible for designing and implementing the systems, workflows... Show more
A global water solutions company is seeking an Applications Engineer to enhance system performance and reliability.This hands-on role involves leading technical activities, optimizing system operat... Show more
We are currently seeking a Agentic AI Systems Developer - Remote to join our team in Toronto, Ontario (CA-ON), Canada (CA).You will design and build agentic AI systems for healthcare using the Neur... Show more
Ecopia Tech is hiring a Backend Engineer in Toronto, offering a hybrid work environment.Contribute to advanced AI solutions using geospatial data.As part of our platform team, the Backend Engineer ... Show more
A North American software provider is seeking a Senior Developer to design and build AI-native systems that impact business outcomes.The role emphasizes collaborative system design and engineering ... Show more
){kind=logo}
