Talent.com
Remote ML Technical Quality Assurance Lead - AI Trainer
Remote ML Technical Quality Assurance Lead - AI TrainerSuperAnnotate • Waterloo, Ontario, CA
Remote ML Technical Quality Assurance Lead - AI Trainer

Remote ML Technical Quality Assurance Lead - AI Trainer

SuperAnnotate • Waterloo, Ontario, CA
18 days ago
Job type
  • Full-time
  • Remote
Job description

re you ready to take on a pivotal role in ensuring the highest standards in AI training? We are looking for a MLTechnical Quality Assurance Lead to help ensure consistently high standards in our AI data training projects. This role combines the opportunity to work with modern machine learning systems with the responsibility of maintaining high-quality Python and ML content, making it a strong fit for people who are passionate about both technology and precision.

You will play a crucial role in guaranteeing the technical quality and consistency of ML-related training data, code, and evaluations, ultimately contributing to the success of our projects.

Key Responsibilities :

  • Technical quality review : Review Python / ML tasks and code submissions (scripts, notebooks, experiments) for correctness, clarity, model design, and alignment with project guidelines; provide clear and constructive feedback and escalate critical issues when needed.
  • Communication : Keep trainers and QAs updated on Discord about new items, ML-related clarifications, or project changes, and respond to their technical and process questions in a timely and professional manner.
  • Activation management : Monitor trainer / QA activity and proactively communicate with inactive contributors to understand blockers and encourage re-engagement.
  • Documentation : Create, maintain, and improve technical documentation such as ML coding guidelines, experiment checklists, best-practice examples, trackers, FAQs, honeypots, and related documents.
  • Onboarding & training : Schedule, organize, and run onboarding and training calls with trainers / QAs to walk them through ML quality standards, common issues, and review expectations.

Your Profile :

  • Academic / professional background : Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, Statistics, or a related field
  • Python & ML experience : Solid professional experience with Python for machine learning, including end-to-end workflows (data preparation, model training, evaluation, and deployment or experimentation).
  • ML stack : Strong hands-on experience with NumPy, pandas, scikit-learn, and at least one deep learning framework such as PyTorch or TensorFlow.
  • Analytical & problem-solving skills : Exceptional ability to understand and evaluate ML code, experiments, and metrics, quickly identify issues, and propose clear improvements.
  • Written communication : Excellent written communication skills in English, able to explain technical feedback, reasoning, and recommendations clearly to a distributed team.
  • Managing ambiguity : Comfortable working with incomplete or evolving ML specifications and able to clarify complex technical requirements effectively.
  • Leadership mindset : Comfortable working independently, giving feedback, and keeping the trainer / QA community engaged, aligned with standards, and supported.
  • Create a job alert for this search

    Quality Assurance Lead • Waterloo, Ontario, CA

    Similar jobs
    Machine Learning Engineer

    Machine Learning Engineer

    Hifyre • Waterloo, Ontario, Canada
    Full-time
    Hifyre provides market intelligence for the cannabis industry, analyzing retail data to help.Our models power product recommendations, sales forecasting, and market analysis for both internal opera...Show more
    Last updated: 3 days ago • Promoted
    Application Lead Seedcare Institute

    Application Lead Seedcare Institute

    Syngenta Crop Protection • Plattsville, ON, Canada
    Temporary
    As a world market leader in crop protection, we help farmers to counter these threats and ensure enough safe, nutritious, affordable food for all –while minimizing the use of land and other a...Show more
    Last updated: 20 days ago • Promoted
    Senior Quality Engineer

    Senior Quality Engineer

    Targeted Talent • Waterloo, ON, Canada
    Permanent
    We are looking for an experienced.This is a permanent position that is remote to start with later relocation to.Our client is a global enterprise company with a product that you've likely used....Show more
    Last updated: 30+ days ago • Promoted
    Market Risk Senior Developer SME

    Market Risk Senior Developer SME

    Comptech Associates • Waterloo, Ontario, Canada
    Full-time
    Job Title : NYB - Market Risk Senior Developer SME (MX, Other).Location : Remote (MX, Latam, Canada (EST working hours).Technical / Functional Expert in Market Risk - Application Development serves a...Show more
    Last updated: 3 days ago • Promoted
    Pricing & Automation Analyst

    Pricing & Automation Analyst

    GiftCash • Waterloo, Ontario, Canada
    Full-time
    GiftCash is growing fast — and we’re looking for a Pricing & Automation Analyst who’s analytical, curious, and excited about building the future of automated, AI-driven operations.If you love worki...Show more
    Last updated: 2 days ago • Promoted
    Engineer Reinforcement Learning

    Engineer Reinforcement Learning

    Huawei Technologies Canada Co., Ltd. • Waterloo, ON, CA
    Temporary
    Huawei Canada has an immediate a 12-month contract opening for an Engineer.The Intelligent Complex Systems Team, currently a part of the Waterloo Research Centre, examines recent advancements in ar...Show more
    Last updated: 30+ days ago
    Customer Success Engineer

    Customer Success Engineer

    BioIntelligence Technologies • Waterloo, Ontario, Canada
    Full-time
    BioIntelligence Technologies started with a simple goal : accelerate access to greener chemicals for families, friends, citizens, and the planet. Today, biotech accounts for 20% of all molecules and ...Show more
    Last updated: 3 days ago • Promoted
    Insurance document reviewer

    Insurance document reviewer

    Great Value Hiring • Waterloo, Ontario, Canada
    Full-time
    Insurance document reviewer [$80-$105 / hr].Insurance experts to review specialized content related to health insurance, reimbursement structures, and lifelong condition support.Review and validate i...Show more
    Last updated: 3 days ago • Promoted
    Project Manager

    Project Manager

    AutoCruitment • Waterloo, Ontario, Canada
    Full-time
    Within a clinical trial, recruiting patients to participate is frequently the most difficult and time-consuming activity. AutoCruitment has developed a targeted, direct-to-patient online marketing p...Show more
    Last updated: 3 days ago • Promoted
    Subscription Management Functional Consultant - Quality IT Resourcing

    Subscription Management Functional Consultant - Quality IT Resourcing

    Quality IT Resourcing • waterloo, on, ca
    Full-time
    Subscription Management Functional Consultant.Experience : 5+ years in Subscription module.Provide Oracle functional skills / support for Subscription Management, Order Management, and Inventory Manag...Show more
    Last updated: 7 hours ago • Promoted • New!
    •Information Risk Analyst (First Line of Defense) (WTL, ON)

    •Information Risk Analyst (First Line of Defense) (WTL, ON)

    Recrute Action • Waterloo, ON, ca
    Full-time +2
    Quick Apply
    Information Risk Analyst (First Line of Defense).Step into a high-impact, hybrid role at the forefront of cloud security, AI governance, and information risk within the insurance sector.Leverage yo...Show more
    Last updated: 3 days ago
    Technical Project Manager

    Technical Project Manager

    Voltera • Waterloo, ON, Canada
    Full-time
    Voltera is a rapidly scaling technology company that has been driving change in the additive electronics industry since 2013. Our tools help the worlds most innovative minds solve previously unsolva...Show more
    Last updated: 30+ days ago • Promoted
    Manager, Data & Analytics (Decision Sciences) - eLocal

    Manager, Data & Analytics (Decision Sciences) - eLocal

    eLocal • waterloo, on, ca
    Full-time
    Manager, Data & Analytics (Decision Sciences).Remote (Applicants must reside in one of the following Canadian provinces : Alberta, British Columbia, Nova Scotia, or Ontario).Local, part of Brookfiel...Show more
    Last updated: 13 hours ago • Promoted • New!
    Senior Clinical Data Manager

    Senior Clinical Data Manager

    Warman O'Brien • Waterloo, Ontario, Canada
    Permanent
    Senior Lead Clinical Data Manager | CRO - FSP |.Are you ready to take your Clinical Data Management expertise to the next level? Join us as a Senior Lead Clinical Data Manager and play a pivotal ro...Show more
    Last updated: 3 days ago • Promoted
    Senior Lead Clinical Data Manager

    Senior Lead Clinical Data Manager

    Warman O'Brien • Waterloo, Ontario, Canada
    Permanent
    Senior Lead Clinical Data Manager – Top CRO – Fully Remote – Permanent.My client is a global CRO who have revolutionized the field of data science and are rapidly expanding their data management te...Show more
    Last updated: 3 days ago • Promoted
    Palantir Data Engineer - Quality IT Resourcing

    Palantir Data Engineer - Quality IT Resourcing

    Quality IT Resourcing • waterloo, on, ca
    Full-time
    Palantir Data Engineer / Analytics Specialist.There is a growing global demand for professionals with deep expertise in Palantir platforms, particularly within government, defense, and large enterp...Show more
    Last updated: 1 day ago • Promoted
    Senior Automation Engineer - Qualitest

    Senior Automation Engineer - Qualitest

    Qualitest • waterloo, on, ca
    Full-time
    Qualitest looking for a Senior Automation Engineer with strong technical expertise and leadership qualities.The ideal candidate should be a self-starter who can quickly contribute, lead automation ...Show more
    Last updated: 5 hours ago • Promoted • New!
    Quality Coordinator

    Quality Coordinator

    Barton Malow Canada • Woodstock, ON, Canada
    Full-time
    Hourly Contract (12-18 months).Senior Manager, Safety + Quality.Barton Malow Canada is an Industrial Contractor with clients across Canada and is part of the Barton Malow family of companies.Our se...Show more
    Last updated: 30+ days ago • Promoted