Talent.com
Remote ML Technical Quality Assurance Lead - AI Trainer
Remote ML Technical Quality Assurance Lead - AI TrainerSuperAnnotate • Woodstock, Ontario, CA
Remote ML Technical Quality Assurance Lead - AI Trainer

Remote ML Technical Quality Assurance Lead - AI Trainer

SuperAnnotate • Woodstock, Ontario, CA
6 days ago
Job type
  • Full-time
  • Remote
Job description

re you ready to take on a pivotal role in ensuring the highest standards in AI training? We are looking for a MLTechnical Quality Assurance Lead to help ensure consistently high standards in our AI data training projects. This role combines the opportunity to work with modern machine learning systems with the responsibility of maintaining high-quality Python and ML content, making it a strong fit for people who are passionate about both technology and precision.

You will play a crucial role in guaranteeing the technical quality and consistency of ML-related training data, code, and evaluations, ultimately contributing to the success of our projects.

Key Responsibilities :

  • Technical quality review : Review Python / ML tasks and code submissions (scripts, notebooks, experiments) for correctness, clarity, model design, and alignment with project guidelines; provide clear and constructive feedback and escalate critical issues when needed.
  • Communication : Keep trainers and QAs updated on Discord about new items, ML-related clarifications, or project changes, and respond to their technical and process questions in a timely and professional manner.
  • Activation management : Monitor trainer / QA activity and proactively communicate with inactive contributors to understand blockers and encourage re-engagement.
  • Documentation : Create, maintain, and improve technical documentation such as ML coding guidelines, experiment checklists, best-practice examples, trackers, FAQs, honeypots, and related documents.
  • Onboarding & training : Schedule, organize, and run onboarding and training calls with trainers / QAs to walk them through ML quality standards, common issues, and review expectations.

Your Profile :

  • Academic / professional background : Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, Statistics, or a related field
  • Python & ML experience : Solid professional experience with Python for machine learning, including end-to-end workflows (data preparation, model training, evaluation, and deployment or experimentation).
  • ML stack : Strong hands-on experience with NumPy, pandas, scikit-learn, and at least one deep learning framework such as PyTorch or TensorFlow.
  • Analytical & problem-solving skills : Exceptional ability to understand and evaluate ML code, experiments, and metrics, quickly identify issues, and propose clear improvements.
  • Written communication : Excellent written communication skills in English, able to explain technical feedback, reasoning, and recommendations clearly to a distributed team.
  • Managing ambiguity : Comfortable working with incomplete or evolving ML specifications and able to clarify complex technical requirements effectively.
  • Leadership mindset : Comfortable working independently, giving feedback, and keeping the trainer / QA community engaged, aligned with standards, and supported.
  • Create a job alert for this search

    Quality Assurance Lead • Woodstock, Ontario, CA

    Similar jobs
    Senior Software Engineer, AI Model Serving - Waterloo, Canada

    Senior Software Engineer, AI Model Serving - Waterloo, Canada

    Speechify • Waterloo, ON, Canada
    Full-time
    The mission of Speechify is to make sure that reading is never a barrier to learning.Over 50 million people use Speechify's text-to-speech products to turn whatever they're reading – ...Show more
    Last updated: 20 days ago • Promoted
    1 - QA Automation Lead

    1 - QA Automation Lead

    Targeted Talent • Waterloo, ON, Canada
    Permanent
    We are looking for an experienced.Senior Quality Automation Engineer.This is a permanent position that is remote to start with later relocation to. Our client is a global enterprise company with a p...Show more
    Last updated: 30+ days ago • Promoted
    Senior Quality Engineer

    Senior Quality Engineer

    Targeted Talent • Waterloo, ON, Canada
    Permanent
    We are looking for an experienced.This is a permanent position that is remote to start with later relocation to.Our client is a global enterprise company with a product that you've likely used....Show more
    Last updated: 30+ days ago • Promoted
    AI Vision Fullstack Developer

    AI Vision Fullstack Developer

    Ironbelly Studios • Waterloo, Ontario, CA
    Full-time
    Quick Apply
    Ironbelly Studios is comprised of a talented, passionate and dedicated number of game developers from all corners of the globe. Our focus is on creating high quality entertainment experiences as wel...Show more
    Last updated: 30+ days ago
    QA Automation Engineer

    QA Automation Engineer

    Targeted Talent • Waterloo, ON, Canada
    Permanent
    We are looking for an experienced.This is a permanent position that is remote to start with later relocation to.Our client is a global enterprise company with a product that you've likely used....Show more
    Last updated: 30+ days ago • Promoted
    Engineer Reinforcement Learning

    Engineer Reinforcement Learning

    Huawei Technologies Canada Co., Ltd. • Waterloo, ON, CA
    Temporary
    Huawei Canada has an immediate a 12-month contract opening for an Engineer.The Intelligent Complex Systems Team, currently a part of the Waterloo Research Centre, examines recent advancements in ar...Show more
    Last updated: 30+ days ago
    AI Engineer - Knowledge Modeling, Extraction and Retrieval

    AI Engineer - Knowledge Modeling, Extraction and Retrieval

    AlphaPoint • Waterloo, ON, CA
    Full-time
    Quick Apply
    About Us AlphaPoint’s AI Labs’ team of engineers and AI scientists is solving complex business problems by bridging the gap between transformative breakthroughs in AI technology and inc...Show more
    Last updated: 30+ days ago
    AI Software Lead

    AI Software Lead

    Ironbelly Studios • Waterloo, Ontario, CA
    Full-time
    Quick Apply
    Ironbelly Studios is comprised of a talented, passionate and dedicated number of game developers from all corners of the globe. Our focus is on creating high quality entertainment experiences as wel...Show more
    Last updated: 27 days ago
    AI Hardware Lead

    AI Hardware Lead

    Ironbelly Studios • Waterloo, Ontario, CA
    Full-time
    Quick Apply
    Ironbelly Studios is comprised of a talented, passionate and dedicated number of game developers from all corners of the globe. Our focus is on creating high quality entertainment experiences as wel...Show more
    Last updated: 30+ days ago
    AI Controls Engineer

    AI Controls Engineer

    Ironbelly Studios • Waterloo, Ontario, CA
    Full-time
    Quick Apply
    Ironbelly Studios is comprised of a talented, passionate and dedicated number of game developers from all corners of the globe. Our focus is on creating high quality entertainment experiences as wel...Show more
    Last updated: 30+ days ago
    Trigonometry Private Tutoring Jobs Norwich

    Trigonometry Private Tutoring Jobs Norwich

    Superprof • Norwich, Canada
    Full-time +1
    Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi...Show more
    Last updated: 30+ days ago • Promoted
    Trigonometry Private Tutoring Jobs Plattsville

    Trigonometry Private Tutoring Jobs Plattsville

    Superprof • Plattsville, Canada
    Full-time +1
    Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi...Show more
    Last updated: 30+ days ago • Promoted
    AI Product Customer Success Engineer

    AI Product Customer Success Engineer

    Ironbelly Studios • Waterloo, Ontario, CA
    Full-time
    Quick Apply
    Ironbelly Studios is comprised of a talented, passionate and dedicated number of game developers from all corners of the globe. Our focus is on creating high quality entertainment experiences as wel...Show more
    Last updated: 30+ days ago
    Senior QE Engineer

    Senior QE Engineer

    Targeted Talent • Waterloo, ON, Canada
    Permanent
    We are looking for an experienced.This is a permanent position that is remote to start with later relocation to.Our client is a global enterprise company with a product that you've likely used....Show more
    Last updated: 30+ days ago • Promoted
    Trigonometry Private Tutoring Jobs New Hamburg

    Trigonometry Private Tutoring Jobs New Hamburg

    Superprof • New Hamburg, Canada
    Full-time +1
    Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi...Show more
    Last updated: 30+ days ago • Promoted
    Trigonometry Private Tutoring Jobs Baden

    Trigonometry Private Tutoring Jobs Baden

    Superprof • Baden, Canada
    Full-time +1
    Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi...Show more
    Last updated: 30+ days ago • Promoted
    Geometry Private Tutoring Jobs New Hamburg

    Geometry Private Tutoring Jobs New Hamburg

    Superprof • New Hamburg, Canada
    Full-time +1
    Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi...Show more
    Last updated: 30+ days ago • Promoted
    QA Automation Lead

    QA Automation Lead

    Targeted Talent • Waterloo, ON, Canada
    Permanent
    We are looking for an experienced.Senior Quality Automation Lead.This is a permanent position that is remote to start with later relocation to. Our client is a global enterprise company with a produ...Show more
    Last updated: 30+ days ago • Promoted