Talent.com
Baseten
OS / K8s Systems EngineerBaseten • Montreal (administrative region), QC, Canada
OS / K8s Systems Engineer

OS / K8s Systems Engineer

Baseten • Montreal (administrative region), QC, Canada
20 days ago
Salary
CA$165,000.00 yearly
Job type
  • Full-time
Job description

About Baseten

Baseten powers mission‑critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting‑edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.

The Role

As an OS / K8s Systems Engineer at Baseten, you’ll build the automation and systems that turn raw GPU hardware into production‑ready compute. From provisioning to orchestration, you’ll own the software layer that makes our infrastructure reproducible, scalable, and reliable across data centers. This is a senior, hands‑on role focused on building systems not operating them. You’ll work close to the metal designing OS images, building provisioning pipelines, and automating cluster bring‑up from scratch. Your work will define how quickly we can turn new capacity into usable compute.

Example Initiatives

  • Zero‑to‑cluster automation: Build workflows that take new hardware from unprovisioned to fully operational cluster.
  • Provisioning systems: Design PXE‑based or equivalent systems for imaging and lifecycle management.
  • Reproducible infrastructure: Ensure clusters deploy consistently across data centers.

Responsibilities

  • Own the end‑to‑end automation of cluster bring‑up and lifecycle management.
  • Build and maintain OS images, provisioning systems, and configuration pipelines.
  • Deploy and operate cluster orchestration platforms (Kubernetes, Slurm, or similar).
  • Design systems for reproducibility across sites and hardware generations.
  • Automate upgrades, rollouts, and failure recovery.
  • Optimize system performance, including GPU utilization and networking.
  • Partner with hardware and network teams to validate and improve system behavior.

Requirements

  • Experience building and operating automated infrastructure systems.
  • Strong programming skills (e.g., Python, Go, or similar).
  • Deep familiarity with Linux systems, including boot processes, drivers, and performance.
  • Experience with provisioning systems (PXE, imaging, configuration management).
  • Experience with Kubernetes.
  • Strong debugging skills across system layers (hardware → OS → network).
  • Experience working with GPU or high‑performance workloads is a plus.

Benefits

  • Competitive compensation, including meaningful equity.
  • 100% coverage of medical, dental, and vision insurance for employee and dependents.
  • Flexible PTO policy including company‑wide Winter Break (our offices are closed from Christmas Eve to New Year's Day).
  • Paid parental leave.
  • Fertility and family‑building stipend through Carrot.
  • Company‑facilitated 401(k).
  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now

Embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward‑thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status. We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

Compensation Range: $165K - $330K

#J-18808-Ljbffr
Create a job alert for this search

OS / K8s Systems Engineer • Montreal (administrative region), QC, Canada

Similar jobs

SRE-DevSecOps Engineer

High Tech GenesisMontreal (administrative region), QC, CA
Full-time

Allowed Staffing Countries: Canada, Costa Rica, Mexico or Brazil, (Remote).High Tech Genesis is seeking a 3-month contractor who can hit the ground running to support our SaaS platform on AWS.Kuber... Show more

 • Promoted

Unix System Administrator

Randstad EnterpriseMontreal
Full-time

The Unix Operations team is responsible for implementing and managing the Linux infrastructure.The group is involved in evaluation, certification, integration, and maintenance of various products, ... Show more

 • Promoted

Senior Electronics Engineer at dormakaba

dormakabamontreal (administrative region), qc, Canada
Full-time

Lead the forefront of electronic hardware design at dormakaba in Montreal as a Senior Electronics Engineer.Drive the next wave of innovation in access control technology through proven expertise.Th... Show more

 • Promoted

Fly-By-Wire Systems Engineer at Bombardier

Accord Technologies IncMontreal (administrative region), QC, CA
Full-time

Enhance flight safety and performance as a Senior Fly-By-Wire Systems Engineer at Bombardier in Montreal, Quebec.Your proficiency in system specifications will be vital in aircraft projects.In this... Show more

 • Promoted

Remote Platform Engineer — Cloud & Kubernetes Ops

PlanetMontreal (administrative region), QC, CA
Remote
Full-time

A leading global space and data company is seeking a Software Engineer in Platform Operations.This full-time remote role prioritizes building and operating cloud infrastructure supporting engineeri... Show more

 • Promoted

Solutions Engineer Drones & UAV (DJI Enterprise)

SF Marketing IncDorval, QC, CA
Full-time

Solutions Engineer Drones & UAV (DJI Enterprise).SFM provides an equitable, inclusive, and growth-focused environment for our staff.We're committed to providing a positive workplace where every ind... Show more

 • Promoted

OS / K8s Systems Engineer

Basetenmontreal (administrative region), qc, Canada
Full-time

Baseten powers mission‑critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer.By uniting applied AI research, flexible infr... Show more

 • Promoted

Innovative Platform Engineer Combines DevOps and Linux Expertise

Hunter Bondmontreal (administrative region), qc, Canada
Full-time

Unlock your potential as a Platform Engineer in a hybrid workspace! Design and implement cutting-edge automated solutions for a low latency environment using Docker, Ansible, and CI/CD.This positio... Show more

 • Promoted

AI Infrastructure Engineer - Systems Focus

Delos Datamontreal (administrative region), qc, Canada
Full-time

Shape the future of AI as a System Software Engineer at a cutting-edge startup.Your expertise in C++ and Python will be key in refining our AI data center technologies.In this innovative role, you ... Show more

 • Promoted

Backend Engineer, Thinking Systems

GovernGPTMontreal (administrative region), QC, CA
Full-time

We’re a YC-backed, profitable startup that’s building agents to automate the most manual, critical function of managing multi‑billion dollar investments—fundraising.Every day, Tier 1 funds rely on ... Show more

 • Promoted

Senior Platform / DevOps Engineer

HaiLaMontreal (administrative region), QC, CA
Full-time

HaiLa is building ultra-low power radio communications solutions that will eliminate the need for batteries in wireless communication devices by offering a product that is hyper power efficient tha... Show more

 • Promoted

Weir Marine Systems Engineer Opportunity

The Weir Group PLCMontreal (administrative region), QC, CA
Full-time

Contribute to the future of Canada’s naval capabilities as a Systems Engineer with Weir Marine Engineering.This role includes opportunities for hybrid work, combining both on-site and remote respon... Show more

 • Promoted

Consulting Systems Engineer

HPE Aruba NetworkingMontreal (administrative region), QC, CA
Full-time

This role has been designated as ‘Remote/Teleworker’, which means you will primarily work from home.Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and ... Show more

 • Promoted

Train Systems Engineer: Architecture, Testing & Collaboration

3M ConsultancyMontreal West, QC, CA
Full-time

A leading engineering consultancy in Montreal West is seeking an experienced engineer to design train architectures and oversee system requirements.You will collaborate with multidisciplinary teams... Show more

 • Promoted

Satellite Systems Platform Engineer

Aversan Inc.montreal (administrative region), qc, Canada
Full-time

Aversan delivers leading-edge and reliable safety-critical electronics and software systems to the aerospace, defence, and space industries.We are currently seeking a qualified.Satellite Systems Pl... Show more

 • Promoted

AMR Systems Engineer

DematicMontreal (administrative region), QC, CA
Full-time

The Autonomous Mobile Robot (AMR) Systems Engineer develops the design and implementation of systems that integrate AMR hardware and associated software.The role involves working closely with colle... Show more

 • Promoted

Systems Engineer-EN

CAEMontreal (administrative region), QC, CA
Permanent

Our engineers are the technical visionaries behind our innovative solutions.Globally recognized for delivering cutting‑edge systems, you’ll tackle complex challenges, collaborate across functions, ... Show more

 • Promoted

Avionics Systems Engineer

SogeclairMontreal (administrative region), QC, CA
Full-time

Define and manage avionics system requirements to ensure safety, certification, and aircraft integration.Coordinate suppliers and cross‑functional teams to ensure seamless integration of avionics s... Show more

 • Promoted

Lasso Informatics Infrastructure Engineer

Lasso InformaticsMontreal (administrative region), QC, CA
Full-time

Join Lasso Informatics as a Senior Cloud Infrastructure Engineer to innovate data management solutions in cloud environments.Oversee AWS and GCP infrastructures with a focus on security and scalabi... Show more

 • Promoted

Senior DevOps Engineer for Cloud Systems at Gameloft

Gameloft MontrealMontreal
Full-time

Join Gameloft as a Senior DevOps Engineer to enhance our cloud systems supporting innovative gaming.Focus on scalability and user experience improvements.In this senior role within Gameloft’s Cloud... Show more