Talent.com
Remote ML Technical Quality Assurance Lead - AI Trainer
Remote ML Technical Quality Assurance Lead - AI TrainerSuperAnnotate • Willowdale, Ontario, CA
Remote ML Technical Quality Assurance Lead - AI Trainer

Remote ML Technical Quality Assurance Lead - AI Trainer

SuperAnnotate • Willowdale, Ontario, CA
20 days ago
Job type
  • Full-time
  • Remote
Job description

re you ready to take on a pivotal role in ensuring the highest standards in AI training? We are looking for a MLTechnical Quality Assurance Lead to help ensure consistently high standards in our AI data training projects. This role combines the opportunity to work with modern machine learning systems with the responsibility of maintaining high-quality Python and ML content, making it a strong fit for people who are passionate about both technology and precision.

You will play a crucial role in guaranteeing the technical quality and consistency of ML-related training data, code, and evaluations, ultimately contributing to the success of our projects.

Key Responsibilities :

  • Technical quality review : Review Python / ML tasks and code submissions (scripts, notebooks, experiments) for correctness, clarity, model design, and alignment with project guidelines; provide clear and constructive feedback and escalate critical issues when needed.
  • Communication : Keep trainers and QAs updated on Discord about new items, ML-related clarifications, or project changes, and respond to their technical and process questions in a timely and professional manner.
  • Activation management : Monitor trainer / QA activity and proactively communicate with inactive contributors to understand blockers and encourage re-engagement.
  • Documentation : Create, maintain, and improve technical documentation such as ML coding guidelines, experiment checklists, best-practice examples, trackers, FAQs, honeypots, and related documents.
  • Onboarding & training : Schedule, organize, and run onboarding and training calls with trainers / QAs to walk them through ML quality standards, common issues, and review expectations.

Your Profile :

  • Academic / professional background : Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, Statistics, or a related field
  • Python & ML experience : Solid professional experience with Python for machine learning, including end-to-end workflows (data preparation, model training, evaluation, and deployment or experimentation).
  • ML stack : Strong hands-on experience with NumPy, pandas, scikit-learn, and at least one deep learning framework such as PyTorch or TensorFlow.
  • Analytical & problem-solving skills : Exceptional ability to understand and evaluate ML code, experiments, and metrics, quickly identify issues, and propose clear improvements.
  • Written communication : Excellent written communication skills in English, able to explain technical feedback, reasoning, and recommendations clearly to a distributed team.
  • Managing ambiguity : Comfortable working with incomplete or evolving ML specifications and able to clarify complex technical requirements effectively.
  • Leadership mindset : Comfortable working independently, giving feedback, and keeping the trainer / QA community engaged, aligned with standards, and supported.
  • Create a job alert for this search

    Quality Assurance Lead • Willowdale, Ontario, CA

    Similar jobs
    Ai / Ml Product Lead – Payments Platform

    Ai / Ml Product Lead – Payments Platform

    Alan • Toronto, Canada, CA
    Full-time
    AI / ML Product Lead needed to oversee product development from ideation to launch for a finance solutions company.Show more
    Last updated: 14 hours ago • Promoted • New!
    Hybrid AI QA Lead for Content Migration

    Hybrid AI QA Lead for Content Migration

    TRSS • Toronto
    Full-time
    A legal technology solutions provider based in Toronto is offering an opportunity to lead AI quality strategy in a flexible hybrid environment. The role involves developing quality frameworks for co...Show more
    Last updated: 13 days ago • Promoted
    Remote ML Technical Quality Assurance Lead - AI Trainer

    Remote ML Technical Quality Assurance Lead - AI Trainer

    SuperAnnotate • Markham, Ontario, CA
    Remote
    Full-time
    AI training? We are looking for a MLTechnical Quality Assurance Lead to help ensure consistently high standards in our AI data training projects. This role combines the opportunity to work with mode...Show more
    Last updated: 20 days ago
    Quality Assurance Associate

    Quality Assurance Associate

    Amico • Richmond Hill, ON, Canada
    Full-time
    Would you like to work for a global company that is dedicated to personal career growth? Amico Corporation is a leading manufacturer of Medical Equipment with 6 manufacturing facilities employing o...Show more
    Last updated: 30+ days ago • Promoted
    Product Line Manager, Digital M&S AI Solutions

    Product Line Manager, Digital M&S AI Solutions

    Sanofi • Toronto, ON, Canada
    Full-time
    Product Line Manager, Digital M&S AI Solutions.Digital M&S Data & Analytics.Toronto, Canada (hybrid schedule).We are an AI- enabled, R&D driven biopharma company, chasing the miracl...Show more
    Last updated: 11 hours ago • Promoted • New!
    Senior AI / ML Engineer

    Senior AI / ML Engineer

    LTV.ai • Toronto C6A, ON, Canada
    Full-time
    AI‑powered ambassadors to deliver hyper‑personalized Email and SMS interactions at an unprecedented scale.Our platform enables brands to communicate with their audience in a natural and contextuall...Show more
    Last updated: 30+ days ago • Promoted
    Team Member

    Team Member

    Tim Hortons • L0R 2E0, ON, Canada
    Full-time
    When you join our team, you're stepping into an opportunity to invest in yourself and well being.Our stores provide amazing experiences for our employees by offering mentorships, flexible sched...Show more
    Last updated: 30+ days ago • Promoted
    MRI Operations Lead Technologist

    MRI Operations Lead Technologist

    Schroeder Ambulatory Centre • Richmond Hill, ON, Canada
    Full-time
    Overview and Purpose of the Role.Reporting to the Manager, Diagnostic Imaging, this role will provide advanced technical expertise in MRI and serve as a key resource for staff within the department...Show more
    Last updated: 30+ days ago • Promoted
    Customer Success Engineer - BioIntelligence Technologies

    Customer Success Engineer - BioIntelligence Technologies

    BioIntelligence Technologies • markham, on, ca
    Full-time
    BioIntelligence Technologies started with a simple goal : accelerate access to greener chemicals for families, friends, citizens, and the planet. Today, biotech accounts for 20% of all molecules and ...Show more
    Last updated: 16 days ago • Promoted
    Quality Assurance Lead — Agile, Automation & API Testing

    Quality Assurance Lead — Agile, Automation & API Testing

    Electric Mind Inc. • Toronto
    Full-time
    A leading technology consulting firm in Toronto is seeking a QA Engineer to join their collaborative team.You will identify issues, develop test plans, and automate testing in an Agile environment....Show more
    Last updated: 1 day ago • Promoted
    Technical Product Manager, AI Platform

    Technical Product Manager, AI Platform

    myBlueprint • Toronto, ON, Canada
    Full-time
    Blueprint is a leading developer of K-12 EdTech tools used by over 1 million students across Canada.We create best-in-class digital portfolios and career / life planning tools to support student succ...Show more
    Last updated: 30+ days ago • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Hifyre • richmond hill, on, ca
    Full-time
    Hifyre provides market intelligence for the cannabis industry, analyzing retail data to help.Our models power product recommendations, sales forecasting, and market analysis for both internal opera...Show more
    Last updated: 16 days ago • Promoted
    Senior ML Engineer for Healthcare AI & LLM Apps

    Senior ML Engineer for Healthcare AI & LLM Apps

    Fullscript • Toronto, ON, Canada
    Full-time
    A leading health technology company is seeking a Senior Machine Learning Engineer to enhance AI-driven services for clinicians and patients. You will be responsible for developing and implementing L...Show more
    Last updated: 11 days ago • Promoted
    AI / ML Product Lead – Payments Platform

    AI / ML Product Lead – Payments Platform

    Versapay • Toronto
    Full-time
    A tech company specializing in finance solutions seeks an experienced AI / ML Product Manager to oversee product development from ideation through launch. The ideal candidate must have 5-7 years of pr...Show more
    Last updated: 9 days ago • Promoted
    ML-Driven Product Manager, Data & AI

    ML-Driven Product Manager, Data & AI

    Bell Canada • Toronto
    Full-time
    A leading telecommunications provider in Toronto is seeking a Product Manager specialized in Data Engineering and Artificial Intelligence. The successful candidate will manage product lifecycles, co...Show more
    Last updated: 1 day ago • Promoted
    Quality Assurance Lead

    Quality Assurance Lead

    Foresters Financial • Toronto
    Full-time
    Get AI-powered advice on this job and more exclusive features.Purpose of role : Reporting to the Quality Assurance Manager, the Quality Assurance (QA) Lead will be responsible for the planning, moni...Show more
    Last updated: 11 days ago • Promoted
    AI & Data Product Manager : Lead ML Solutions

    AI & Data Product Manager : Lead ML Solutions

    Bell • Toronto C6A, ON, Canada
    Remote
    Full-time
    A leading telecommunications provider is hiring for a Management position in Toronto.The role involves product management of AI / ML product lines, driving product vision and collaborating with techn...Show more
    Last updated: 1 day ago • Promoted
    AI Architect

    AI Architect

    GEI Consultants • Markham, ON, Canada
    Full-time
    The AI Architect is responsible for designing and leading AI-based solutions and services to select the optimal architecture for GEI’s priority digital and AI initiatives.This role owns the e...Show more
    Last updated: 18 days ago • Promoted