Talent.com
Remote ML Technical Quality Assurance Lead - AI Trainer
Remote ML Technical Quality Assurance Lead - AI TrainerSuperAnnotate • St. Thomas, Ontario, CA
Remote ML Technical Quality Assurance Lead - AI Trainer

Remote ML Technical Quality Assurance Lead - AI Trainer

SuperAnnotate • St. Thomas, Ontario, CA
18 days ago
Job type
  • Full-time
  • Remote
Job description

re you ready to take on a pivotal role in ensuring the highest standards in AI training? We are looking for a MLTechnical Quality Assurance Lead to help ensure consistently high standards in our AI data training projects. This role combines the opportunity to work with modern machine learning systems with the responsibility of maintaining high-quality Python and ML content, making it a strong fit for people who are passionate about both technology and precision.

You will play a crucial role in guaranteeing the technical quality and consistency of ML-related training data, code, and evaluations, ultimately contributing to the success of our projects.

Key Responsibilities :

  • Technical quality review : Review Python / ML tasks and code submissions (scripts, notebooks, experiments) for correctness, clarity, model design, and alignment with project guidelines; provide clear and constructive feedback and escalate critical issues when needed.
  • Communication : Keep trainers and QAs updated on Discord about new items, ML-related clarifications, or project changes, and respond to their technical and process questions in a timely and professional manner.
  • Activation management : Monitor trainer / QA activity and proactively communicate with inactive contributors to understand blockers and encourage re-engagement.
  • Documentation : Create, maintain, and improve technical documentation such as ML coding guidelines, experiment checklists, best-practice examples, trackers, FAQs, honeypots, and related documents.
  • Onboarding & training : Schedule, organize, and run onboarding and training calls with trainers / QAs to walk them through ML quality standards, common issues, and review expectations.

Your Profile :

  • Academic / professional background : Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, Statistics, or a related field
  • Python & ML experience : Solid professional experience with Python for machine learning, including end-to-end workflows (data preparation, model training, evaluation, and deployment or experimentation).
  • ML stack : Strong hands-on experience with NumPy, pandas, scikit-learn, and at least one deep learning framework such as PyTorch or TensorFlow.
  • Analytical & problem-solving skills : Exceptional ability to understand and evaluate ML code, experiments, and metrics, quickly identify issues, and propose clear improvements.
  • Written communication : Excellent written communication skills in English, able to explain technical feedback, reasoning, and recommendations clearly to a distributed team.
  • Managing ambiguity : Comfortable working with incomplete or evolving ML specifications and able to clarify complex technical requirements effectively.
  • Leadership mindset : Comfortable working independently, giving feedback, and keeping the trainer / QA community engaged, aligned with standards, and supported.
  • Create a job alert for this search

    Quality Assurance Lead • St. Thomas, Ontario, CA

    Similar jobs
    Machine Learning Engineer

    Machine Learning Engineer

    Hifyre • London, Ontario, Canada
    Full-time
    Hifyre provides market intelligence for the cannabis industry, analyzing retail data to help.Our models power product recommendations, sales forecasting, and market analysis for both internal opera...Show more
    Last updated: 3 days ago • Promoted
    Subscription Management Functional Consultant - Quality IT Resourcing

    Subscription Management Functional Consultant - Quality IT Resourcing

    Quality IT Resourcing • london, on, ca
    Full-time
    Subscription Management Functional Consultant.Experience : 5+ years in Subscription module.Provide Oracle functional skills / support for Subscription Management, Order Management, and Inventory Manag...Show more
    Last updated: 1 day ago • Promoted
    Enterprise Security Architect - CQ Search Group Ltd.

    Enterprise Security Architect - CQ Search Group Ltd.

    CQ Search Group Ltd. • london, on, ca
    Temporary
    We are seeking a highly experienced.Identity & Access Management, Privileged Access Management (PAM), and enterprise-level identity modernization. CyberArk, SailPoint, Azure Privileged Identity Mana...Show more
    Last updated: 3 hours ago • Promoted • New!
    Market Risk Senior Developer SME

    Market Risk Senior Developer SME

    Comptech Associates • London, Ontario, Canada
    Full-time
    Job Title : NYB - Market Risk Senior Developer SME (MX, Other).Location : Remote (MX, Latam, Canada (EST working hours).Technical / Functional Expert in Market Risk - Application Development serves a...Show more
    Last updated: 4 days ago • Promoted
    Test Engineer

    Test Engineer

    Actalent • London, ON, Canada
    Full-time
    Test Engineering works directly within Engineering to execute tests to validate internal and external customer design requirements. We are looking for a contractor who is a good communicator and pro...Show more
    Last updated: 5 days ago • Promoted
    Forensic Engineer SME

    Forensic Engineer SME

    Mitigateway • London, Ontario, Canada
    Full-time
    We believe that by embedding expert forensic reasoning into scalable AI, we can transform the way risk is understood and adjudicated in property insurance losses. We build enterprise-grade generativ...Show more
    Last updated: 3 days ago • Promoted
    Flight Test Instrumentation Manager

    Flight Test Instrumentation Manager

    ITPS (Canada) LTD • London, ON, Canada
    Full-time +1
    Employer : ITPS (Canada) Limited.Position : Flight Test Instrumentation Manager.Terms of Employment : Full-time / Permanent. Employment Address : 2410 Blair Blvd.Eligible for discretionary bonuses and / o...Show more
    Last updated: 30+ days ago • Promoted
    Pricing & Automation Analyst

    Pricing & Automation Analyst

    GiftCash • London, Ontario, Canada
    Full-time
    GiftCash is growing fast — and we’re looking for a Pricing & Automation Analyst who’s analytical, curious, and excited about building the future of automated, AI-driven operations.If you love worki...Show more
    Last updated: 3 days ago • Promoted
    Tactical Instructor - Pilot

    Tactical Instructor - Pilot

    ITPS (Canada) LTD • London, ON, Canada
    Full-time +1
    Blair Blvd, London, Ontario N5V 3Z9.Eligible for discretionary bonuses and / or salary increases in accordance with company policy. Company contributory medical top-up scheme / group health and dental ...Show more
    Last updated: 30+ days ago • Promoted
    Director of Data Strategy, Analytics, and Quality

    Director of Data Strategy, Analytics, and Quality

    Vanier • London, ON, Canada
    Full-time
    Vanier Childrens Mental Wellness is proud to be recognized across Southwestern Ontario as a trusted leader in childrens mental health. We are the Lead Agency for Child and Youth Mental Health System...Show more
    Last updated: 30+ days ago • Promoted
    Product Information Management Analyst

    Product Information Management Analyst

    LBMX • London, ON, Canada
    Full-time
    We are seeking anProduct Information Management Analyst.LBMX is a dynamic and growing software solutions company with an international perspective, located in London, Ontario.As we continue our gro...Show more
    Last updated: 3 days ago • Promoted
    Azure Data Platform Architect : AI, Automation & Scale

    Azure Data Platform Architect : AI, Automation & Scale

    PowerCo • St. Thomas
    Full-time
    A leading renewable energy company in St.Thomas, Ontario is seeking a Senior Expert in Azure Cloud Transformation.You'll design and implement data platforms and integrate AI into business processes...Show more
    Last updated: 11 days ago • Promoted
    Senior Lead Clinical Data Manager

    Senior Lead Clinical Data Manager

    Warman O'Brien • London, Ontario, Canada
    Permanent
    Senior Lead Clinical Data Manager – Top CRO – Fully Remote – Permanent.My client is a global CRO who have revolutionized the field of data science and are rapidly expanding their data management te...Show more
    Last updated: 3 days ago • Promoted
    Palantir Data Engineer - Quality IT Resourcing

    Palantir Data Engineer - Quality IT Resourcing

    Quality IT Resourcing • london, on, ca
    Full-time
    Palantir Data Engineer / Analytics Specialist.There is a growing global demand for professionals with deep expertise in Palantir platforms, particularly within government, defense, and large enterp...Show more
    Last updated: 2 days ago • Promoted
    Senior Clinical Data Manager

    Senior Clinical Data Manager

    Warman O'Brien • London, Ontario, Canada
    Permanent
    Senior Lead Clinical Data Manager | CRO - FSP |.Are you ready to take your Clinical Data Management expertise to the next level? Join us as a Senior Lead Clinical Data Manager and play a pivotal ro...Show more
    Last updated: 4 days ago • Promoted
    Quality Inspectors - Automotive Inspection

    Quality Inspectors - Automotive Inspection

    TRIGO Global Quality Solutions • Saint Thomas, ON, Canada
    Full-time
    TRIGO Global Quality Solutions has several immediate openings in St.Overall Purpose of the Quality Inspector.Provide Quality services and support for all missions assigned to a manufacturing or war...Show more
    Last updated: 30+ days ago • Promoted
    Customer Success Engineer

    Customer Success Engineer

    BioIntelligence Technologies • London, Ontario, Canada
    Full-time
    BioIntelligence Technologies started with a simple goal : accelerate access to greener chemicals for families, friends, citizens, and the planet. Today, biotech accounts for 20% of all molecules and ...Show more
    Last updated: 4 days ago • Promoted
    Energy Modeling Manager

    Energy Modeling Manager

    MasterTech • London, ON, Canada
    Full-time
    Calling all Energy Modeling Managers residing in London or Kitchener ON with previous experience in high-capacity residential properties! The ideal Energy Modeling Team Lead should be well versed i...Show more
    Last updated: 2 days ago • Promoted