Talent.com
Cresta
Senior Software Engineer, Backend (AI Agent Runtime)Cresta • Toronto, ON, Canada
Senior Software Engineer, Backend (AI Agent Runtime)

Senior Software Engineer, Backend (AI Agent Runtime)

Cresta • Toronto, ON, Canada
30+ days ago
Job type
  • Full-time
Job description

Cresta is on a mission to turn every customer conversation into a competitive advantage by unlocking the true potential of the contact center. Our platform combines the best of AI and human intelligence to help contact centers discover customer insights and behavioral best practices, automate conversations and inefficient processes, and empower every team member to work smarter and faster. Born from the prestigious Stanford AI lab, Cresta’s co‑founder and chairman is Sebastian Thrun, the genius behind Google X, Waymo, Udacity, and more. Our leadership also includes CEO Ping Wu, the co‑founder of Google Contact Center AI and Vertex AI platform, and co‑founder Tim Shi, an early member of Open AI.

Join us on this thrilling journey to revolutionize the workforce with AI. The future of work is here, and it’s at Cresta.

About The Role

  • Own model serving: Design, build, and maintain low‑latency, highly‑available serving stacks for in‑house ML model serving and integrating with LLM serving partners.
  • Automate training pipelines: Orchestrate data prep, training, evaluation, and registry workflows on Kubernetes with solid MLOps practices.
  • Optimize at scale: Profile and tune throughput, memory, and cost; introduce caching, sharding, batching, and GPU/CPU autoscaling where it pays off.
  • Build platform primitives: Create reusable SDKs, templates, and CLI tools that let research and product teams ship models independently and safely.
  • Raise the bar: Instrument deep observability (tracing, metrics, alerts), drive blameless post‑mortems, and mentor engineers on production ML best practices.

What We’re Looking For

  • 5+ years writing production software; 2+ years focused on ML platform or infra.
  • Expert Python (async, typing, packaging, performance).
  • Working Golang knowledge for systems components.
  • Proven experience with one or more serving frameworks (e.g., vLLM, Triton, TorchServe).
  • Kubernetes and cloud‑native ops.
  • Solid grasp of distributed systems, networking, and container security.
  • Culture of rigorous testing, code review, and continuous delivery.

Nice‑to‑haves

  • Hands‑on with large language models or real‑time streaming inference.
  • Terraform, Helm, or similar IaC tooling.
  • Experience in speech or conversational AI domains.

Perks & Benefits

  • We offer Cresta employees a variety of medical, dental, and vision plans, designed to fit you and your family’s needs.
  • Paid parental leave to support you and your family.
  • Monthly Health & Wellness allowance.
  • Work‑from‑home office stipend to help you succeed in a remote environment.
  • Lunch reimbursement for in‑office employees.
  • PTO: 3 weeks in Canada.

Compensation for this position includes a base salary, equity, and a variety of benefits. Actual base salaries will be based on candidate‑specific factors, including experience, skillset, and location, and local minimum pay requirements as applicable. We are actively hiring for this role in the US and Canada. Your recruiter can provide further details.

We have noticed a rise in recruiting impersonations across the industry, where scammers attempt to access candidates’ personal and financial information through fake interviews and offers. All Cresta recruiting email communications will always come from the @cresta.ai domain. Any outreach claiming to be from Cresta via other sources should be ignored. If you are uncertain whether you have been contacted by an official Cresta employee, reach out to recruiting@cresta.ai.

#J-18808-Ljbffr
Create a job alert for this search

Senior Software Engineer, Backend (AI Agent Runtime) • Toronto, ON, Canada

Similar jobs

Senior Backend Engineer - AI, IoT, Healthcare (Remote)

Norbert HealthToronto, ON, CA
Remote
Full-time

A healthcare robotics firm based in Montreal seeks a Senior Backend Engineer to own their backend systems.Responsibilities include architecting a unified backend, managing AWS infrastructure, and d... Show more

 • Promoted

Senior Software Engineer, Ai (Agents) - C$145,000 - C$183,000 A Year

KlueToronto County, Canada
Full-time

Senior Software Engineer to build and optimize LLM-powered agents at scale.Shape AI agent architecture, evaluation frameworks, and optimize backend systems for cost, performance, and reliability. Show more

 • Promoted

Senior Software Engineer - Ai Platform & Experiences - $154,500 - $224,540 A Year

CaptivateIQToronto County, Canada
Full-time

Seeking a Senior Software Engineer to build AI-powered platform capabilities and user experiences from the ground up, translating emerging technology into real product value. Show more

 • Promoted

Senior Backend Engineer - Ai-Powered Saas Platform - C$140,000 - C$210,000 A Year

AI platform companyNorth York, Canada
Full-time

Seeking a Backend Software Engineer to enhance an AI-driven contract management platform, requiring strong API development skills with Python. Show more

 • Promoted

Ai Platform Engineer — Backend & Orchestration - C$100,000 - C$130,000 A Year

RSInsightNorth York, Canada
Full-time

Software Engineer for an AI team, focusing on backend services and AI agent runtimes.Requires 2+ years of backend/full-stack experience and REST API knowledge. Show more

 • Promoted

Senior Software Engineer - Ai (Materia Ai) - C$100,000 - C$145,000 A Year

MateriaNorth York, Canada
Full-time

Seeking a Senior Software Engineer to design, implement, and optimize backend systems for AI-powered tax and accounting platforms.Responsibilities include building scalable services, integrating wi... Show more

 • Promoted

Senior Backend Engineer – AI App Builder

DataRobotToronto, ON, CA
Full-time

A leading AI technology company in Toronto is seeking a Senior Software Engineer to enhance the application building experience on their platform.The role involves collaboration with various teams ... Show more

 • Promoted

Senior Backend Engineer with AI Focus

Drive CapitalToronto, ON, CA
Full-time

Join Yolando as a Senior Backend Engineer, specializing in AI Search Optimization.Use your expertise in FastAPI and PostgreSQL to innovate and lead.As a leader in technology, you will take ownershi... Show more

 • Promoted

Senior Software Engineer - Ai-First Vehicle Platform - Up To $200,000 A Year

Ai-First Vehicle PlatformToronto County, Canada
Full-time

Seeking an experienced developer to design and ship core systems end-to-end, solve complex problems, and work closely with founders in an AI-first vehicle platform. Show more

 • Promoted

Senior Software Engineer, Backend (AI Agent Runtime)

CrestaToronto, ON, CA
Full-time

Cresta is on a mission to turn every customer conversation into a competitive advantage by unlocking the true potential of the contact center.Our platform combines the best of AI and human intellig... Show more

 • Promoted

Ai Platform Engineer — Backend & Orchestration - C$100,000 - C$130,000 A Year

RSInsight AIToronto County, Canada
Full-time

Seeking a Software Engineer for an AI team to design and maintain backend services and develop AI agent runtimes.Requires 2+ years of backend/full-stack experience and knowledge of REST APIs. Show more

 • Promoted

Senior Software Engineer, Ai Applications - C$125,000 - C$145,000 A Year

Safe FleetToronto County, Canada
Full-time

Seeking a Senior Software Engineer, AI Applications to design and build scalable AI-powered applications using Generative AI platforms and integrating AI agents, RAG architectures, and workflow aut... Show more

 • Promoted

Senior Software Engineer, Ai

ToastToronto, Canada
Full-time

Job DescriptionToast is recruiting on behalf of this company for a Senior Software Engineer, AI to join their Engineering team in Toronto.They are looking for an experienced backend engineer who is... Show more

 • Promoted

Senior Software Engineer: SaaS & AI Backend

Kaseya Limitedtoronto, on, Canada
Full-time

Join Kaseya as a Senior Software Engineer to influence backend design for SaaS products enriched with AI and data capabilities.This role requires hands-on engineering to build robust backend system... Show more

 • Promoted

Senior Software Engineer, AI

Toasttoronto, on, Canada
Full-time

Toast is recruiting on behalf of this company for a Senior Software Engineer, AI to join their Engineering team in Toronto.They are looking for an experienced backend engineer who is excited to bui... Show more

 • Promoted

Senior Software Engineer - Ai (Materia Ai) - C$100,000 - C$145,000 A Year

Materia AiEast York, Canada
Full-time

Senior Software Engineer will design and implement backend services using Python, FastAPI, and PostgreSQL for AI-native products, including LLM integration and high-traffic APIs. Show more

 • Promoted

Senior Software Engineer, Backend (Ai Agent Runtime)

CrestaToronto, Canada
Full-time

Cresta is on a mission to turn every customer conversation into a competitive advantage by unlocking the true potential of the contact center.Our platform combines the best of AI and human intellig... Show more

 • Promoted

Senior AI Backend Engineer – Hybrid Role

Thomson ReutersToronto, ON, CA
Full-time

A global leader in information services is looking for a Senior Software Engineer to join their AI-driven team in Toronto.This role involves designing backend services for innovative AI solutions f... Show more

 • Promoted

Senior AI Engineer - Backend-Driven Agentic (Remote)

BayOne SolutionsToronto, ON, CA
Remote
Full-time

A technology firm is hiring a Senior Full Stack Engineer (Backend-Leaning) with a strong focus on backend services and AI applications.The ideal candidate will have experience in building agent-bas... Show more

 • Promoted

Senior Software Engineer - Ai-First Vehicle Platform - Up To $200,000 A Year

Leading Tech CompanyNorth York, Canada
Full-time

Experienced Software Engineer to design and ship core systems end-to-end for an AI-first vehicle platform, solving complex problems in an ambiguous environment. Show more