Talent.com
Performance Engineer - Inference
Performance Engineer - InferenceCerebras Systems Inc. • Toronto C6A, ON, Canada
Performance Engineer - Inference

Performance Engineer - Inference

Cerebras Systems Inc. • Toronto C6A, ON, Canada
4 days ago
Job type
  • Full-time
Job description

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. Our novel wafer-scale architecture provides the AI compute power of dozens of GPUs on a single chip, with the programming simplicity of a single device. This approach allows Cerebras to deliver industry-leading training and inference speeds and empowers machine learning users to effortlessly run large-scale ML applications, without the hassle of managing hundreds of GPUs or TPUs.

Cerebras' current customers include global corporations across multiple industries, national labs, and top-tier healthcare systems. In January, we announced a multi-year, multi-million-dollar partnership with Mayo Clinic, underscoring our commitment to transforming AI applications across various fields. In August, we launched Cerebras Inference, the fastest Generative AI inference solution in the world, over 10 times faster than GPU-based hyperscale cloud inference services.

About The Role

Engineers on the inference performance team operate at the intersection of hardware and software, driving end-to-end model inference speed and throughput. Their work spans low-level kernel performance debugging and optimization, system-level performance analysis, performance modeling and estimation, and the development of tooling for performanceprojection and diagnostics.

Responsibilities

  • Build performance models (kernel-level, end-to-end) to estimate the performance of state of the art and customer ML models.
  • Optimize and debug our kernel micro code and compiler algorithms to elevate ML model inference speed, throughput and compute utilization on the Cerebras WSE.
  • Debug and understand runtime performance on the system and cluster.
  • Develop tools and infrastructure to help visualize performance data collected from the Wafer Scale Engine and our compute cluster.

Requirements

  • Bachelors / Masters / PhD in Electrical Engineering or Computer Science.
  • Strong background in computer architecture.
  • Exposure to and understanding of low-level deep learning / LLM math.
  • Strong analytical and problem-solving mindset.
  • 3+ years of experience in a relevant domain (Computer Architecture, CPU / GPU Performance, Kernel Optimization, HPC).
  • Experience working on CPU / GPU simulators.
  • Exposure to performance profiling and debug on any system pipeline.
  • Comfort with C++ and Python.
  • Why Join Cerebras

    People who are serious about software make their own hardware. At Cerebras we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras :

  • Build a breakthrough AI platform beyond the constraints of the GPU.
  • Publish and open source their cutting-edge AI research.
  • Work on one of the fastest AI supercomputers in the world.
  • Enjoy job stability with startup vitality.
  • Our simple, non-corporate work culture that respects individual beliefs.
  • Apply today and become part of the forefront of groundbreaking advancements in AI!

    Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

    This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.

    #J-18808-Ljbffr

    Create a job alert for this search

    Performance Engineer Inference • Toronto C6A, ON, Canada

    Similar jobs
    Lead Performance Engineer — Hybrid Toronto

    Lead Performance Engineer — Hybrid Toronto

    Informatica Corp. • Toronto
    Full-time
    A technology company is seeking a Lead Performance Engineer who will manage performance testing initiatives and identify bottlenecks in systems. The candidate will utilize load testing tools, SQL an...Show more
    Last updated: 4 hours ago • Promoted • New!
    Machine Learning Engineer, Recommendations

    Machine Learning Engineer, Recommendations

    Lyft • Toronto C6A, ON, Canada
    Remote
    Full-time
    At Lyft, our purpose is to serve and connect.We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. With over half a billion rides...Show more
    Last updated: 4 days ago • Promoted
    Senior Display Co-Processor Performance Engineer

    Senior Display Co-Processor Performance Engineer

    Qualcomm • Markham
    Full-time
    A leading technology firm in Markham is seeking an experienced engineer for a role focused on CPU architecture improvements. You will analyze performance characteristics and collaborate with archite...Show more
    Last updated: 14 days ago • Promoted
    Machine Learning Engineer (AI detection, Toronto)

    Machine Learning Engineer (AI detection, Toronto)

    GPTZero • Toronto C6A, ON, Canada
    Remote
    Full-time
    GPTZero is on a mission to restore trust and transparency on the internet.As the leading AI detection platform, we empower educators, students, journalists, marketers, and writers to navigate the e...Show more
    Last updated: 21 days ago • Promoted
    Principal GenAI Engineer : Scale Training & Inference

    Principal GenAI Engineer : Scale Training & Inference

    Advanced Micro Devices • Markham
    Full-time
    A major technology company is seeking a Principal Software Development Engineer based in Markham, Ontario.The ideal candidate will enhance Generative AI training and inference at scale, collaborate...Show more
    Last updated: 4 hours ago • Promoted • New!
    Director, Performance Analytics (Hybrid)

    Director, Performance Analytics (Hybrid)

    CPP Investments | Investissements RPC • Toronto C6A, ON, Canada
    Remote
    Full-time
    A global investment organization in Toronto is seeking a Director, Performance to enhance performance measurement and attribution capabilities. The role involves leading a team, driving automated so...Show more
    Last updated: 12 hours ago • Promoted • New!
    Mid-Senior Performance Engineer – Resiliency & DR Testing

    Mid-Senior Performance Engineer – Resiliency & DR Testing

    Tata Consultancy Services • Toronto
    Full-time
    A leading IT consulting firm is looking for a Performance Engineer to join their team in Toronto.The ideal candidate will have strong experience in LoadRunner or JMeter, excellent skills in resilie...Show more
    Last updated: 4 hours ago • Promoted • New!
    Director, Performance & Analytics (Hybrid)

    Director, Performance & Analytics (Hybrid)

    Canada Pension Plan Investment Board • Toronto C6A, ON, Canada
    Full-time
    A leading investment organization in Toronto is seeking a Director of Performance to oversee the performance measurement and analysis for a globally diversified portfolio.The ideal candidate will h...Show more
    Last updated: 2 days ago • Promoted
    Performance Engineering Lead

    Performance Engineering Lead

    TD Bank • Toronto C6A, ON, Canada
    Full-time
    Work Location : • •Toronto, Ontario, Canada • •Hours : • •37.Line of Business : • •Technology Solutions • •Pay Details : • •$76,800 - $115,200 CADTD is committed to providing fair and equitable compensation opport...Show more
    Last updated: 21 days ago • Promoted
    Senior Principal Research Engineer

    Senior Principal Research Engineer

    Autodesk, Inc. • Toronto C6A, ON, Canada
    Remote
    Full-time
    Job Requisition ID # • •25WD94222 • • • •Learn More • • • • • •About Autodesk • •Welcome to Autodesk! Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the...Show more
    Last updated: 30+ days ago • Promoted
    Principal Solutions Engineer - Risk Analytics

    Principal Solutions Engineer - Risk Analytics

    SimCorp • Toronto C6A, ON, Canada
    Remote
    Full-time
    Principal Solutions Engineer - Risk Analytics.Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features. Join some of the most innovative thinkers in FinTech as ...Show more
    Last updated: 18 days ago • Promoted
    Performance Engineer - Inference

    Performance Engineer - Inference

    Cerebras • Toronto
    Full-time
    Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs.Our novel wafer-scale architecture provides the AI compute power of dozens of GPUs on a single chip, with the programm...Show more
    Last updated: 4 hours ago • Promoted • New!
    Senior Full-Stack Engineer — AI‑Driven Platform

    Senior Full-Stack Engineer — AI‑Driven Platform

    Sagard Holdings Inc. • Toronto C6A, ON, Canada
    Full-time
    A leading investment management firm in Toronto is hiring a Senior Full Stack Engineer to join their AI team.This role focuses on designing, building, and evolving internal products and platform ca...Show more
    Last updated: 5 days ago • Promoted
    Performance Engineer - Inference

    Performance Engineer - Inference

    Cerebras Systems Inc. • Toronto
    Full-time
    Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs.Our novel wafer-scale architecture provides the AI compute power of dozens of GPUs on a single chip, with the programm...Show more
    Last updated: 4 hours ago • Promoted • New!
    Application Performance Engineer (Dynatrace)

    Application Performance Engineer (Dynatrace)

    Scotiabank • Toronto, Canada
    Full-time
    Application Performance Engineer (Dynatrace) Requisition ID : 245155.The Team Global Banking and Markets Engineering (GBME) is the fast‑moving, award‑winning technology engine that powers Scotiabank...Show more
    Last updated: 7 days ago • Promoted
    Performance Engineer - Inference

    Performance Engineer - Inference

    Cerebras Systems • Toronto
    Full-time
    Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs.Our novel wafer-scale architecture provides the AI compute power of dozens of GPUs on a single chip, with the programm...Show more
    Last updated: 4 hours ago • Promoted • New!
    ML Performance Architect for Neuron

    ML Performance Architect for Neuron

    Amazon Web Services (AWS) • Toronto
    Full-time
    A leading cloud computing provider is looking for a Sr.ML Performance Engineer to join their Annapurna Labs team.The role involves optimizing machine learning performance on AWS accelerators and re...Show more
    Last updated: 4 hours ago • Promoted • New!
    Display SoC Power & Performance Engineer

    Display SoC Power & Performance Engineer

    Nutanix • Markham
    Full-time
    A leading technology company in Markham is seeking an experienced engineer to join the system architecture team.The role focuses on developing performance models for a high-performance display proc...Show more
    Last updated: 14 days ago • Promoted