Location: Downtown Toronto
Hybrid: 4 days in office
Ready to build what powers the next generation of AI?
We’re looking for a Staff LLMOps Engineer to lead the design, deployment, and optimization of large language model (LLM) infrastructure on the cloud.
You’ll be the driving force behind taking trained models from lab to production—scaling efficiently across multi-GPU clusters and pushing the boundaries of inference performance for enterprise-grade AI applications.
If you thrive at the intersection of AI, cloud engineering, and systems optimization, this is your chance to shape the future of large-scale model serving in a high-impact environment.
Architect and operationalize LLM deployment pipelines on AWS and Kubernetes/EKS.
Build and scale multi-GPU inference infrastructure for low latency, high availability, and cost efficiency.
Optimize inference using frameworks like vLLM, SGLang, and DeepSpeed-Inference.
Implement advanced serving techniques: continuous batching, speculative decoding, KV-cache management, and distributed scheduling.
Collaborate with AI researchers to convert model training outputs into production-grade APIs and services.
Establish observability and monitoring for latency, throughput, GPU utilization, and failure recovery.
Automate provisioning, scaling, and upgrades using Terraform and CI/CD pipelines.
Ensure compliance, security, and efficiency in multi-tenant LLM hosting for enterprise clients.
6+ years in DevOps, ML infrastructure, or cloud platform engineering.
2+ years of direct experience deploying and optimizing LLMs or large-scale ML models.
Expertise with GPU-accelerated inference and distributed serving environments.
Deep familiarity with cloud-native architectures (AWS, GCP, Azure) and Kubernetes.
Strong foundation in Python, Bash, and IaC (Terraform).
Experience integrating monitoring tools (Prometheus, Grafana, Datadog) for performance visibility.
Passion for building robust, scalable, and secure AI systems.
Lead and own mission-critical AI infrastructure at a fast-scaling startup.
Work alongside world-class engineers, data scientists, and innovators.
Competitive salary + meaningful equity in a company redefining applied AI.
A culture built on innovation, technical depth, and impact—your work truly matters.
#J-18808-LjbffrSenior LLMOps Engineer -Cloud / AI Infrastructure • Toronto, ON, Canada
A leading engineering and consulting firm in Ontario seeks an AI Engineer to develop and deploy AI solutions.The ideal candidate will have extensive software engineering experience and skills in Ge... Show more
Individually we are people, but together we are Aviva.Individually these are just words, but together they are our Values – Care, Commitment, Community, and Confidence.At Aviva Canada, we put peopl... Show more
Elevate your role as a Genesys Cloud Consultant with Connex Telecommunications in Richmond Hill, Ontario.Manage contact center platforms, optimize routing, and enhance customer service outcomes.In ... Show more
A leading information management company is seeking a Senior Site Reliability Engineer to ensure the reliability of their customer-facing SaaS platforms.You will work on distributed systems using t... Show more
Engineering Group, Engineering Group >.LLM Serving Engineer (Cloud AI Engineering).Qualcomm is utilizing its traditional strengths in digital wireless technologies to play a central role in the evo... Show more
A leading book retailer in Ontario is seeking a Senior Platform & Cloud Operations Engineer to enhance their digital infrastructure.The role focuses on implementing cloud and SaaS solutions, ensuri... Show more
A leading technology firm in Toronto is seeking an experienced architect to design AI-enabled applications and guide cloud modernization efforts.You will work with diverse teams, leveraging tools l... Show more
A leading communications group in Toronto is seeking a Senior DevOps Engineer to design and operate cloud-native platforms.You will support AI/ML workloads and ensure scalable solutions.This role r... Show more
A leading financial institution in Toronto is seeking a Senior Solutions Architect to design and implement secure, scalable solutions focusing on Anti Money Laundering.You will collaborate with bus... Show more
Seeking an LLM Serving Engineer to build and optimize scalable LLM inference platforms using advanced techniques and collaborate with customers on AI solutions. Show more
A leading HR Tech company is seeking a Senior LLMOps to design and manage the infrastructure for a conversational AI platform.This remote role focuses on ensuring ML systems are scalable and effici... Show more
A leading technology organization is seeking a DevOps Engineer to manage cloud infrastructure and enhance system operations.You will work across multiple business units, ensuring operational excell... Show more
The Nationwide Group (TNG) is a pioneer in designing and developing outsourced financial services software, exclusively focused on creating comprehensive and customizable solutions for the real est... Show more
A cloud-native services company is seeking a Machine Learning Architect to join its Cloud Native Applications team.This role requires expertise in ML system design and AWS solutions.You will work c... Show more
A leading wealth management organization in Toronto is seeking a highly skilled Azure Systems Administrator to design and optimize their Azure cloud infrastructure.This role emphasizes collaboratio... Show more
Ready to build what powers the next generation of AI?.You’ll be the driving force behind taking trained models from lab to production—scaling efficiently across multi-GPU clusters and pushing the b... Show more
This range is provided by Mindlance.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Direct message the job poster from Mindlance.Hiring: Cloud S... Show more
Lead the charge in machine learning operations as a Senior MLOps Engineer at Sun Life.This dynamic role focuses on AWS frameworks and advanced analytics, perfect for tech-savvy leaders.The Enterpri... Show more
About the job RQ08858 - DevOPS/Cloud Engineer - Senior.Provide expertise in AWS cloud platform.Provide design, build and support for cloud environments to create solutions for Public Health domain.... Show more
Elevate your career as a Senior Software Engineer by working on innovative cloud-based AI-driven solutions for a high-profile Data Analytics platform.Be part of a team that processes vast financial... Show more
