Talent.com
Remote ML Technical Quality Assurance Lead - AI Trainer
Remote ML Technical Quality Assurance Lead - AI TrainerSuperAnnotate • Willowdale, Ontario, CA
Remote ML Technical Quality Assurance Lead - AI Trainer

Remote ML Technical Quality Assurance Lead - AI Trainer

SuperAnnotate • Willowdale, Ontario, CA
19 days ago
Job type
  • Full-time
  • Remote
Job description

re you ready to take on a pivotal role in ensuring the highest standards in AI training? We are looking for a MLTechnical Quality Assurance Lead to help ensure consistently high standards in our AI data training projects. This role combines the opportunity to work with modern machine learning systems with the responsibility of maintaining high-quality Python and ML content, making it a strong fit for people who are passionate about both technology and precision.

You will play a crucial role in guaranteeing the technical quality and consistency of ML-related training data, code, and evaluations, ultimately contributing to the success of our projects.

Key Responsibilities :

  • Technical quality review : Review Python / ML tasks and code submissions (scripts, notebooks, experiments) for correctness, clarity, model design, and alignment with project guidelines; provide clear and constructive feedback and escalate critical issues when needed.
  • Communication : Keep trainers and QAs updated on Discord about new items, ML-related clarifications, or project changes, and respond to their technical and process questions in a timely and professional manner.
  • Activation management : Monitor trainer / QA activity and proactively communicate with inactive contributors to understand blockers and encourage re-engagement.
  • Documentation : Create, maintain, and improve technical documentation such as ML coding guidelines, experiment checklists, best-practice examples, trackers, FAQs, honeypots, and related documents.
  • Onboarding & training : Schedule, organize, and run onboarding and training calls with trainers / QAs to walk them through ML quality standards, common issues, and review expectations.

Your Profile :

  • Academic / professional background : Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, Statistics, or a related field
  • Python & ML experience : Solid professional experience with Python for machine learning, including end-to-end workflows (data preparation, model training, evaluation, and deployment or experimentation).
  • ML stack : Strong hands-on experience with NumPy, pandas, scikit-learn, and at least one deep learning framework such as PyTorch or TensorFlow.
  • Analytical & problem-solving skills : Exceptional ability to understand and evaluate ML code, experiments, and metrics, quickly identify issues, and propose clear improvements.
  • Written communication : Excellent written communication skills in English, able to explain technical feedback, reasoning, and recommendations clearly to a distributed team.
  • Managing ambiguity : Comfortable working with incomplete or evolving ML specifications and able to clarify complex technical requirements effectively.
  • Leadership mindset : Comfortable working independently, giving feedback, and keeping the trainer / QA community engaged, aligned with standards, and supported.
  • Create a job alert for this search

    Quality Assurance Lead • Willowdale, Ontario, CA

    Similar jobs
    QA Automation Engineer - SaaS Testing & AI / ML

    QA Automation Engineer - SaaS Testing & AI / ML

    Askuity • Toronto
    Full-time
    A retail analytics software company in Toronto is seeking a Quality Assurance Automation Engineer to ensure the delivery of high-quality SaaS products. As part of the Product Development team, you w...Show more
    Last updated: 7 days ago • Promoted
    Hybrid AI QA Lead for Content Migration

    Hybrid AI QA Lead for Content Migration

    TRSS • Toronto
    Full-time
    A legal technology solutions provider based in Toronto is offering an opportunity to lead AI quality strategy in a flexible hybrid environment. The role involves developing quality frameworks for co...Show more
    Last updated: 12 days ago • Promoted
    AI & Data Product Manager : Lead ML Solutions

    AI & Data Product Manager : Lead ML Solutions

    Bell • Toronto
    Full-time
    A leading telecommunications provider is hiring for a Management position in Toronto.The role involves product management of AI / ML product lines, driving product vision and collaborating with techn...Show more
    Last updated: 6 hours ago • Promoted • New!
    Senior AI / ML Developer - LLMs & Autonomous Agents

    Senior AI / ML Developer - LLMs & Autonomous Agents

    CGI • Toronto
    Full-time
    A leading IT consultancy in Toronto is seeking a Senior Consultant, Talent Acquisition Partner, specializing in AI / ML development. This role involves building AI agents, integrating Large Language M...Show more
    Last updated: 10 days ago • Promoted
    Remote ML Engineer & AI Data Trainer

    Remote ML Engineer & AI Data Trainer

    Alignerr • Toronto, ON, Canada
    Full-time
    A leading AI solutions provider is seeking a Remote Machine Learning Engineer - AI Data Trainer to draft organized logs for AI reasoning processes. Candidates should possess expertise in Machine Lea...Show more
    Last updated: 10 hours ago • Promoted • New!
    Senior AML Tech Lead – AI / ML Compliance Solutions

    Senior AML Tech Lead – AI / ML Compliance Solutions

    RBC • Toronto
    Full-time
    A leading financial institution in Toronto is seeking a team manager for application development in Anti-Money Laundering (AML) functions. The role involves overseeing a team, defining technical sol...Show more
    Last updated: 1 day ago • Promoted
    Security Consultant II (AI / ML Penetration Tester)

    Security Consultant II (AI / ML Penetration Tester)

    NetSPI Canada Ltd • Toronto, ON, Canada
    Full-time
    This is a remote position, and candidates must be located in Ontario, CA.NetSPI® pioneered Penetration Testing as a Service (PTaaS) and leads the industry in modern pentesting.Combining world-c...Show more
    Last updated: 30+ days ago • Promoted
    ML Team Lead, AI & GenAI Solutions

    ML Team Lead, AI & GenAI Solutions

    Bloomberg • Toronto
    Full-time
    A global finance and technology provider based in Toronto is seeking a skilled Machine Learning Team Lead to guide engineers in ML / NLP applications. The role involves collaborating with stakeholders...Show more
    Last updated: 12 days ago • Promoted
    Quality Engineer II, AI Platform | Test Automation Lead

    Quality Engineer II, AI Platform | Test Automation Lead

    TD • Toronto
    Full-time
    A major financial institution in Toronto is looking for a Quality Engineer II for their AI Platform team.The candidate will focus on test automation with a strong emphasis on Python and Java progra...Show more
    Last updated: 12 days ago • Promoted
    Senior ML Engineer – Listing Quality (Hybrid)

    Senior ML Engineer – Listing Quality (Hybrid)

    Startops • Toronto
    Full-time
    A technology-driven marketplace is seeking a Senior Data Scientist / Machine Learning Engineer to leverage machine learning for improving product listings. In this role, you will design high-perform...Show more
    Last updated: 12 days ago • Promoted
    Senior QE Lead - AI Platform Quality & Automation

    Senior QE Lead - AI Platform Quality & Automation

    TD Securities • Toronto
    Full-time
    A leading investment bank in Toronto is seeking a Quality Engineer III to ensure high-quality software delivery.Responsibilities include test strategy development, automation, and leading cross-fun...Show more
    Last updated: 12 days ago • Promoted
    Senior AI / ML Engineer (Remote)

    Senior AI / ML Engineer (Remote)

    vidIQ • Toronto, AB, CA
    Remote
    Full-time
    IQ builds software to help YouTube creators achieve their goals.Our mission is to advance the creator's journey with actionable data-driven insights and AI-powered tools. We are dedicated to our val...Show more
    Last updated: 30+ days ago
    AI Tech Lead : Conversational AI & ML for FinTech

    AI Tech Lead : Conversational AI & ML for FinTech

    Mashreq Bank • Toronto
    Full-time
    A leading financial institution is seeking an AI Tech Lead to spearhead projects involving AI and chatbots.The ideal candidate should have over 10 years of software development experience, with a s...Show more
    Last updated: 12 days ago • Promoted
    Senior ML Scientist - Listing Quality & AI

    Senior ML Scientist - Listing Quality & AI

    Faire • Toronto
    Full-time
    An innovative tech company in Toronto is seeking a Listing Quality Lead to drive their data science vision and enhance product listing quality using machine learning and AI.The ideal candidate will...Show more
    Last updated: 6 hours ago • Promoted • New!
    Quality Assurance Lead — Agile, Automation & API Testing

    Quality Assurance Lead — Agile, Automation & API Testing

    Electric Mind Inc. • Toronto
    Full-time
    A leading technology consulting firm in Toronto is seeking a QA Engineer to join their collaborative team.You will identify issues, develop test plans, and automate testing in an Agile environment....Show more
    Last updated: 6 hours ago • Promoted • New!
    LLM Engineer

    LLM Engineer

    Mindlance • Toronto
    Full-time
    Direct message the job poster from Mindlance.Hiring : LLM Engineers in Toronto! Be part of a fast-scaling team building Smarter, Next-Generation AI Agents alongside World-Leading AI Labs.Location : T...Show more
    Last updated: 2 days ago • Promoted
    AI / ML Product Lead – Payments Platform

    AI / ML Product Lead – Payments Platform

    Versapay • Toronto
    Full-time
    A tech company specializing in finance solutions seeks an experienced AI / ML Product Manager to oversee product development from ideation through launch. The ideal candidate must have 5-7 years of pr...Show more
    Last updated: 8 days ago • Promoted
    ML-Driven Product Manager, Data & AI

    ML-Driven Product Manager, Data & AI

    Bell Canada • Toronto
    Full-time
    A leading telecommunications provider in Toronto is seeking a Product Manager specialized in Data Engineering and Artificial Intelligence. The successful candidate will manage product lifecycles, co...Show more
    Last updated: 6 hours ago • Promoted • New!