Talent.com
Performance Engineer - Inference
Performance Engineer - InferenceCerebras Systems Inc. • Toronto C6A, ON, Canada
Performance Engineer - Inference

Performance Engineer - Inference

Cerebras Systems Inc. • Toronto C6A, ON, Canada
6 days ago
Job type
  • Full-time
Job description

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. Our novel wafer-scale architecture provides the AI compute power of dozens of GPUs on a single chip, with the programming simplicity of a single device. This approach allows Cerebras to deliver industry-leading training and inference speeds and empowers machine learning users to effortlessly run large-scale ML applications, without the hassle of managing hundreds of GPUs or TPUs.

Cerebras' current customers include global corporations across multiple industries, national labs, and top-tier healthcare systems. In January, we announced a multi-year, multi-million-dollar partnership with Mayo Clinic, underscoring our commitment to transforming AI applications across various fields. In August, we launched Cerebras Inference, the fastest Generative AI inference solution in the world, over 10 times faster than GPU-based hyperscale cloud inference services.

About The Role

Engineers on the inference performance team operate at the intersection of hardware and software, driving end-to-end model inference speed and throughput. Their work spans low-level kernel performance debugging and optimization, system-level performance analysis, performance modeling and estimation, and the development of tooling for performanceprojection and diagnostics.

Responsibilities

  • Build performance models (kernel-level, end-to-end) to estimate the performance of state of the art and customer ML models.
  • Optimize and debug our kernel micro code and compiler algorithms to elevate ML model inference speed, throughput and compute utilization on the Cerebras WSE.
  • Debug and understand runtime performance on the system and cluster.
  • Develop tools and infrastructure to help visualize performance data collected from the Wafer Scale Engine and our compute cluster.

Requirements

  • Bachelors / Masters / PhD in Electrical Engineering or Computer Science.
  • Strong background in computer architecture.
  • Exposure to and understanding of low-level deep learning / LLM math.
  • Strong analytical and problem-solving mindset.
  • 3+ years of experience in a relevant domain (Computer Architecture, CPU / GPU Performance, Kernel Optimization, HPC).
  • Experience working on CPU / GPU simulators.
  • Exposure to performance profiling and debug on any system pipeline.
  • Comfort with C++ and Python.
  • Why Join Cerebras

    People who are serious about software make their own hardware. At Cerebras we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras :

  • Build a breakthrough AI platform beyond the constraints of the GPU.
  • Publish and open source their cutting-edge AI research.
  • Work on one of the fastest AI supercomputers in the world.
  • Enjoy job stability with startup vitality.
  • Our simple, non-corporate work culture that respects individual beliefs.
  • Apply today and become part of the forefront of groundbreaking advancements in AI!

    Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

    This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.

    #J-18808-Ljbffr

    Create a job alert for this search

    Performance Engineer Inference • Toronto C6A, ON, Canada

    Similar jobs
    Lead Performance Engineer — Hybrid Toronto

    Lead Performance Engineer — Hybrid Toronto

    Informatica Corp. • Toronto
    Full-time
    A technology company is seeking a Lead Performance Engineer who will manage performance testing initiatives and identify bottlenecks in systems. The candidate will utilize load testing tools, SQL an...Show more
    Last updated: 2 days ago • Promoted
    Senior Principal Verification Engineer

    Senior Principal Verification Engineer

    Cadence Design Systems • Toronto, Canada
    Full-time
    Senior Principal Verification Engineer page is loaded## Senior Principal Verification Engineerlocations : .Posted Todayjob requisition id : . R50472## • •At Cadence, we hire and develop leaders and innov...Show more
    Last updated: 9 days ago • Promoted
    Machine Learning Engineer, Recommendations

    Machine Learning Engineer, Recommendations

    Lyft • Toronto C6A, ON, Canada
    Remote
    Full-time
    At Lyft, our purpose is to serve and connect.We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. With over half a billion rides...Show more
    Last updated: 6 days ago • Promoted
    Sr. ML Performance Engineer, AWS Neuron, Annapurna Labs

    Sr. ML Performance Engineer, AWS Neuron, Annapurna Labs

    Amazon Web Services (AWS) • Toronto C6A, ON, Canada
    Full-time
    ML Performance Engineer, AWS Neuron, Annapurna Labs — Amazon Web Services (AWS).The Annapurna Labs team at AWS builds AWS Neuron, the software development kit used to accelerate deep learning and G...Show more
    Last updated: 30+ days ago • Promoted
    Senior Display Co-Processor Performance Engineer

    Senior Display Co-Processor Performance Engineer

    Qualcomm • Markham
    Full-time
    A leading technology firm in Markham is seeking an experienced engineer for a role focused on CPU architecture improvements. You will analyze performance characteristics and collaborate with archite...Show more
    Last updated: 16 days ago • Promoted
    Performance Engineer - Inference

    Performance Engineer - Inference

    Cerebras Systems • Toronto C6A, ON, Canada
    Full-time
    Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs.Our novel wafer-scale architecture provides the AI compute power of dozens of GPUs on a single chip, with the programm...Show more
    Last updated: 7 days ago • Promoted
    Principal GenAI Engineer : Scale Training & Inference

    Principal GenAI Engineer : Scale Training & Inference

    Advanced Micro Devices • Markham
    Full-time
    A major technology company is seeking a Principal Software Development Engineer based in Markham, Ontario.The ideal candidate will enhance Generative AI training and inference at scale, collaborate...Show more
    Last updated: 2 days ago • Promoted
    Director of Analytics, Performance Intelligence

    Director of Analytics, Performance Intelligence

    Edelman DXI • Toronto C6A, ON, Canada
    Remote
    Full-time
    Director of Analytics, Performance Intelligence page is loaded## Director of Analytics, Performance Intelligenceremote type : Hybridlocations : Toronto, Ontario, Canadatime type : Full timeposte...Show more
    Last updated: 11 days ago • Promoted
    Mid-Senior Performance Engineer – Resiliency & DR Testing

    Mid-Senior Performance Engineer – Resiliency & DR Testing

    Tata Consultancy Services • Toronto
    Full-time
    A leading IT consulting firm is looking for a Performance Engineer to join their team in Toronto.The ideal candidate will have strong experience in LoadRunner or JMeter, excellent skills in resilie...Show more
    Last updated: 2 days ago • Promoted
    Performance Engineering Lead

    Performance Engineering Lead

    TD Bank • Toronto C6A, ON, Canada
    Full-time
    Work Location : • •Toronto, Ontario, Canada • •Hours : • •37.Line of Business : • •Technology Solutions • •Pay Details : • •$76,800 - $115,200 CADTD is committed to providing fair and equitable compensation opport...Show more
    Last updated: 23 days ago • Promoted
    Principal Solutions Engineer - Risk Analytics

    Principal Solutions Engineer - Risk Analytics

    SimCorp • Toronto C6A, ON, Canada
    Remote
    Full-time
    Principal Solutions Engineer - Risk Analytics.Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features. Join some of the most innovative thinkers in FinTech as ...Show more
    Last updated: 20 days ago • Promoted
    Senior Xcode Performance Engineer

    Senior Xcode Performance Engineer

    Apple • Toronto, Canada
    Full-time
    A leading technology company in Vancouver is seeking an experienced Senior Systems Engineer to enhance the performance of their developer tools. This role requires collaboration with engineering tea...Show more
    Last updated: 11 hours ago • Promoted • New!
    Performance Engineer : Drive Scalable, High-Performance Apps

    Performance Engineer : Drive Scalable, High-Performance Apps

    Highbrow LLC • Toronto C6A, ON, Canada
    Remote
    Full-time
    A technology consulting firm located in Toronto is seeking a Performance Engineer to develop and execute performance test strategies. The ideal candidate will have 2-5 years of experience in perform...Show more
    Last updated: 30+ days ago • Promoted
    Performance Engineer - Inference

    Performance Engineer - Inference

    Cerebras • Toronto
    Full-time
    Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs.Our novel wafer-scale architecture provides the AI compute power of dozens of GPUs on a single chip, with the programm...Show more
    Last updated: 2 days ago • Promoted
    Senior Full-Stack Engineer — AI‑Driven Platform

    Senior Full-Stack Engineer — AI‑Driven Platform

    Sagard Holdings Inc. • Toronto C6A, ON, Canada
    Full-time
    A leading investment management firm in Toronto is hiring a Senior Full Stack Engineer to join their AI team.This role focuses on designing, building, and evolving internal products and platform ca...Show more
    Last updated: 7 days ago • Promoted
    Application Performance Engineer (Dynatrace)

    Application Performance Engineer (Dynatrace)

    Scotiabank • Toronto, Canada
    Full-time
    Application Performance Engineer (Dynatrace) Posted : 2 days ago | Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture. Overview Global Banking and M...Show more
    Last updated: 9 days ago • Promoted
    AI Platform Systems Engineer — GPU Training & Inference

    AI Platform Systems Engineer — GPU Training & Inference

    NVIDIA • Toronto
    Full-time
    A leading technology company in Toronto is seeking skilled systems engineers to develop an AI platform focused on high-performance inference and training of AI models. The ideal candidate will have ...Show more
    Last updated: 2 days ago • Promoted
    Display SoC Power & Performance Engineer

    Display SoC Power & Performance Engineer

    Nutanix • Markham
    Full-time
    A leading technology company in Markham is seeking an experienced engineer to join the system architecture team.The role focuses on developing performance models for a high-performance display proc...Show more
    Last updated: 16 days ago • Promoted