Job description
Huawei Canada has an immediate permanent opening for a Senior Engineer.
About the team:
Established in 2014, the Distributed Scheduling and Data Engine Lab is Huawei Cloud's technical innovation center in Canada. The lab focuses on researching and developing advanced cloud technologies, supporting the productization and iterative optimization of its technical achievements. Current research areas include cloud native databases, intelligent SQL engine, AI/Agent infrastructure and LLM/Agent Evaluation Technology. The lab fosters a robust technical environment, allowing collaboration with industry experts to create a highly competitive cloud platform.
About the job:
Join a cutting-edge team building next-generation infrastructure for AI and agentic workloads, sitting at the intersection of research, systems engineering, and product innovation
Track and analyze the latest trends in LLMs, agentic AI, and multi-step agent workflows to inform infrastructure direction
Investigate and address infrastructure bottlenecks across GPU/NPU utilization, data movement, memory hierarchy, and distributed execution
Design system-level architectures for agent execution frameworks, multi-model orchestration, and large-scale inference systems
Evaluate AI/agent workload requirements on cloud and hybrid infrastructure, balancing trade-offs across cost, performance, and scalability
Deep dive into the full infrastructure stack — from distributed schedulers and inference pipelines to caching and data access patterns
Collaborate closely with engineering and product teams to prototype and deliver production-ready solutions grounded in research
Translate emerging AI trends and workload patterns into scalable, impactful infrastructure designs
The targeted annual total compensation for this position ranges from $127,000 to $225,000 depending on education, experience, and demonstrated expertise.
Job requirements
About the Ideal Candidate：
Solid foundation in distributed systems, cloud infrastructure, or systems engineering, with hands-on experience building or operating large-scale systems
Proficiency with Kubernetes, cluster scheduling, or equivalent orchestration platforms in production environments
Practical experience with AI/ML systems — whether in training pipelines, inference infrastructure, or both
Strong programming skills in low-level or systems-oriented languages such as Go or C++
Familiarity with LLM serving frameworks (e.g., vLLM, SGLang, Triton, Ray) and an understanding of how they interact with underlying hardware
Experience with GPU or accelerator optimization, and a grasp of how hardware constraints shape system design decisions
A research-oriented mindset — comfortable reading papers, running experiments, and prototyping ideas to validate architectural decisions
Sharp analytical and problem-solving skills, with the ability to model workloads, identify performance bottlenecks, and propose principled solutions
Additional Information：
Huawei Canada is committed to a fair, inclusive, and accessible recruitment process. If you require accommodation during any stage of the hiring process, please let us know and we will work with you to meet your needs.
All applications for this position are reviewed directly by our hiring team, we do not use artificial intelligence tools to screen or select candidates.
Senior Engineer-Cloud AI Infrastructure • Markham, Ontario, CA
A leading recruitment agency is seeking a Senior Information Architect / Data Engineer for a remote position.The role involves leading the architecture of a cloud data platform, requiring extensive... Show more
A leading book retailer in Ontario is seeking a Senior Platform & Cloud Operations Engineer to enhance their digital infrastructure.The role focuses on implementing cloud and SaaS solutions, ensuri... Show more
AWS Infrastructure Deployment: Experience deploying a full range of AWS resources, including: Networking foundations Security boundaries Connectivity requirements CI/CD & GitLab: Hands-on productio... Show more
Do you have 7+ years of experience in design, development, implementation and maintenance of large complex CRM systems such as Dynamics or other COTS CRM systems? Do you have hands‑on experience wi... Show more
Engineering Group, Engineering Group >.LLM Serving Engineer (Cloud AI Engineering).Qualcomm is utilizing its traditional strengths in digital wireless technologies to play a central role in the evo... Show more
Location: Downtown TorontoHybrid: 4 days in office Ready to build what powers the next generation of AI? We’re looking for a Staff LLMOps Engineer to lead the design, deployment, and optimi... Show more
An innovative startup at the forefront of the GenAI revolution is seeking a Senior Infrastructure Engineer to join their dynamic team in Toronto.This role involves leading the design and developmen... Show more
A financial services firm in York Region is seeking a Solution Integration Architect.This role involves designing and implementing integration solutions using Azure and AWS, ensuring alignment with... Show more
We are the #1 global music publisher, advancing the artistry of the world’s greatest songwriters and composers for over 25 years.We keep songwriters at the forefront of everything we do, and design... Show more
Cloud Engineer - Media & Entertainmen Workflows At GPL Technologies, our mission is to provide powerful, reliable, and innovative technology services and leadership to creative companies by combini... Show more
Azure environment into our own Azure tenant.This engagement will require strong architectural judgment, hands‑on technical execution, and the ability to operate effectively with partial documentati... Show more
A leading technology company in Toronto is seeking a Senior Software Developer to work on cloud and AI projects.The ideal candidate will have extensive experience with cloud services like Azure and... Show more
Azure environment into our own Azure tenant.This engagement will require strong architectural judgment, hands‑on technical execution, and the ability to operate effectively with partial documentati... Show more
Cloud Solutions Architect needed to develop end-to-end cloud solutions for an insurance company.Requires 7+ years experience with Azure and AWS.Salary range is CAD 95,000 - 145,000. Show more
A leading technology firm in Toronto is seeking an experienced architect to design AI-enabled applications and guide cloud modernization efforts.You will work with diverse teams, leveraging tools l... Show more
Senior AI Software Engineer needed to lead AI product development and integration within a cloud environment. Show more
Design , deploy, and maintain hybrid infrastructure environments across public cloud platforms such as Azure, Amazon Web Services (AWS), Linux solutions, Software as a Service (SaaS), Commercial Of... Show more
Huawei Canada has an immediate permanent opening for a Senior Engineer.Established in 2014, the Distributed Scheduling and Data Engine Lab is Huawei Cloud's technical innovation center in Canada.Th... Show more
Toronto, ON (Hybrid – 2-3 days onsite per week).AWS Services: IAM, SageMaker, S3.Infrastructure as Code (IaC): AWS CDK to provision SageMaker resources, Lambda functions, Step Functions.MLOPs, Cont... Show more
This range is provided by Mindlance.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Direct message the job poster from Mindlance.Hiring: Cloud S... Show more
