Talent.com
Remote ML Technical Quality Assurance Lead - AI Trainer
Remote ML Technical Quality Assurance Lead - AI TrainerSuperAnnotate • Oak Bay, British Columbia, CA
Remote ML Technical Quality Assurance Lead - AI Trainer

Remote ML Technical Quality Assurance Lead - AI Trainer

SuperAnnotate • Oak Bay, British Columbia, CA
15 days ago
Job type
  • Full-time
  • Remote
Job description

re you ready to take on a pivotal role in ensuring the highest standards in AI training? We are looking for a MLTechnical Quality Assurance Lead to help ensure consistently high standards in our AI data training projects. This role combines the opportunity to work with modern machine learning systems with the responsibility of maintaining high-quality Python and ML content, making it a strong fit for people who are passionate about both technology and precision.

You will play a crucial role in guaranteeing the technical quality and consistency of ML-related training data, code, and evaluations, ultimately contributing to the success of our projects.

Key Responsibilities :

  • Technical quality review : Review Python / ML tasks and code submissions (scripts, notebooks, experiments) for correctness, clarity, model design, and alignment with project guidelines; provide clear and constructive feedback and escalate critical issues when needed.
  • Communication : Keep trainers and QAs updated on Discord about new items, ML-related clarifications, or project changes, and respond to their technical and process questions in a timely and professional manner.
  • Activation management : Monitor trainer / QA activity and proactively communicate with inactive contributors to understand blockers and encourage re-engagement.
  • Documentation : Create, maintain, and improve technical documentation such as ML coding guidelines, experiment checklists, best-practice examples, trackers, FAQs, honeypots, and related documents.
  • Onboarding & training : Schedule, organize, and run onboarding and training calls with trainers / QAs to walk them through ML quality standards, common issues, and review expectations.

Your Profile :

  • Academic / professional background : Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, Statistics, or a related field
  • Python & ML experience : Solid professional experience with Python for machine learning, including end-to-end workflows (data preparation, model training, evaluation, and deployment or experimentation).
  • ML stack : Strong hands-on experience with NumPy, pandas, scikit-learn, and at least one deep learning framework such as PyTorch or TensorFlow.
  • Analytical & problem-solving skills : Exceptional ability to understand and evaluate ML code, experiments, and metrics, quickly identify issues, and propose clear improvements.
  • Written communication : Excellent written communication skills in English, able to explain technical feedback, reasoning, and recommendations clearly to a distributed team.
  • Managing ambiguity : Comfortable working with incomplete or evolving ML specifications and able to clarify complex technical requirements effectively.
  • Leadership mindset : Comfortable working independently, giving feedback, and keeping the trainer / QA community engaged, aligned with standards, and supported.
  • Create a job alert for this search

    Quality Assurance Lead • Oak Bay, British Columbia, CA

    Similar jobs
    Project Manager

    Project Manager

    Ryzuk Geotechnical • Victoria, BC, Canada
    Full-time
    We are seeking a Geotechnical Engineer or Geoscientist (Project Manager level) who is motivated by technical excellence, mentorship, and collaborative project delivery!. Ryzuk Geotechnical and Mater...Show more
    Last updated: 21 days ago • Promoted
    Clinical Project Manager

    Clinical Project Manager

    Upsilon Global • Victoria, British Columbia, Canada
    Temporary
    Freelance CPM - Canada - Vaccines / Infectious Diseases.Upsilon Global are seeking an experienced Freelance Clinical Project Manager who's also happy to perform monitoring visits in a hybrid role for...Show more
    Last updated: 23 hours ago • Promoted
    Geometry Private Tutoring Jobs Brentwood Bay

    Geometry Private Tutoring Jobs Brentwood Bay

    Superprof • Brentwood Bay, Canada
    Full-time +1
    Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi...Show more
    Last updated: 30+ days ago • Promoted
    Physics Private Tutoring Jobs Brentwood Bay

    Physics Private Tutoring Jobs Brentwood Bay

    Superprof • Brentwood Bay, Canada
    Full-time +1
    Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi...Show more
    Last updated: 30+ days ago • Promoted
    Camera Development Engineer

    Camera Development Engineer

    Blue Robotics, Inc. • Victoria, BC, Canada
    Full-time
    At Blue Robotics, we enable the field of marine robotics with affordable components and systems.What does this really mean? We design cool tech for use underwater that allows tons of people and org...Show more
    Last updated: 30+ days ago • Promoted
    Customer Success Lead

    Customer Success Lead

    Targeted Talent • Victoria, BC, Canada
    Full-time
    The Customer Success Lead will oversee and assist customer success employees in the performance of their job duties such as responding to customer inquiries and resolving issues or complaints.Help ...Show more
    Last updated: 30+ days ago • Promoted
    Forensic Engineer SME

    Forensic Engineer SME

    Mitigateway • Victoria, British Columbia, Canada
    Full-time
    We believe that by embedding expert forensic reasoning into scalable AI, we can transform the way risk is understood and adjudicated in property insurance losses. We build enterprise-grade generativ...Show more
    Last updated: 1 day ago • Promoted
    Project Manager, BCLS (Victoria, BC)

    Project Manager, BCLS (Victoria, BC)

    GeoVerra • Victoria, BC, Canada
    Full-time
    Ready to take the lead on exciting surveying projects? Does taking charge of surveying projects, mentoring talented teams and partnering with clients to shape the future of land development excites...Show more
    Last updated: 1 day ago • Promoted
    Jr. Reports Developer (Vancouver Island residents ONLY)

    Jr. Reports Developer (Vancouver Island residents ONLY)

    Plexxis Software • Victoria, BC, Canada
    Full-time
    All successful candidates are required to reside within commuting distance of our Langford / Victoria office location.Plexxis does not offer remote work opportunities. As part of the Plexxis developme...Show more
    Last updated: 30+ days ago • Promoted
    TECH Specialist

    TECH Specialist

    London Drugs • Colwood
    Full-time
    Now hiring for TECH Specialist.Are you passionate about learning? Do your friends and family members always ask you for tech advice? Are you up-to-date with the latest Computer, Audio / Video and Pho...Show more
    Last updated: 5 days ago • Promoted
    Trigonometry Private Tutoring Jobs Brentwood Bay

    Trigonometry Private Tutoring Jobs Brentwood Bay

    Superprof • Brentwood Bay, Canada
    Full-time +1
    Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi...Show more
    Last updated: 30+ days ago • Promoted
    Remote Medical General Expert - Ai Trainer

    Remote Medical General Expert - Ai Trainer

    SuperAnnotate • Oak Bay, Canada
    Remote
    Full-time
    In this hourly, remote contractor role, you will review AI-generated medical responses and / or generate expert healthcare content, evaluating reasoning quality and step-by-step clinical problem-solv...Show more
    Last updated: 2 days ago • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Hifyre • Victoria, British Columbia, Canada
    Full-time
    Hifyre provides market intelligence for the cannabis industry, analyzing retail data to help.Our models power product recommendations, sales forecasting, and market analysis for both internal opera...Show more
    Last updated: 1 day ago • Promoted
    Assistant Department Manager Photo Lab

    Assistant Department Manager Photo Lab

    London Drugs Limited • Victoria, BC, Canada
    Part-time
    Youll experience them all at London Drugs.As one of Canadas fastest-growing and most successful retail chains, we know what it takes to build a satisfying career. We are seeking innovative, customer...Show more
    Last updated: 9 hours ago • Promoted • New!
    Senior Lead Clinical Data Manager

    Senior Lead Clinical Data Manager

    Warman O'Brien • Victoria, British Columbia, Canada
    Permanent
    Senior Lead Clinical Data Manager – Top CRO – Fully Remote – Permanent.My client is a global CRO who have revolutionized the field of data science and are rapidly expanding their data management te...Show more
    Last updated: 21 hours ago • Promoted • New!
    Clinical Trial Manager

    Clinical Trial Manager

    Upsilon Global • Victoria, British Columbia, Canada
    Temporary
    Freelance CTM / LCRA - Canada - Vaccines / Infectious Diseases.Upsilon Global are seeking an experienced Freelance Clinical Trial Manager / Lead CRA who's also happy to perform monitoring visits in a h...Show more
    Last updated: 21 hours ago • Promoted • New!
    TECH Specialist

    TECH Specialist

    London Drugs Limited • Victoria, BC, Canada
    Full-time
    Now hiring for TECH Specialist.Are you passionate about learning? Do your friends and family members always ask you for tech advice? Are you up-to-date with the latest Computer, Audio / Video and Pho...Show more
    Last updated: 7 days ago • Promoted
    Xactimate Estimator and Compliance Technician

    Xactimate Estimator and Compliance Technician

    ServiceMaster Restore of Victoria • Victoria, BC, Canada
    Full-time
    Reporting to the General Manager, The Xactimate Estimator and Compliance Technician will assist Project Managers in completing timely estimates and maintaining the Status and compliance requirement...Show more
    Last updated: 30+ days ago • Promoted