Talent.com
Remote ML Technical Quality Assurance Lead - AI Trainer
Remote ML Technical Quality Assurance Lead - AI TrainerSuperAnnotate • North York, Ontario, CA
Remote ML Technical Quality Assurance Lead - AI Trainer

Remote ML Technical Quality Assurance Lead - AI Trainer

SuperAnnotate • North York, Ontario, CA
17 days ago
Job type
  • Full-time
  • Remote
Job description

re you ready to take on a pivotal role in ensuring the highest standards in AI training? We are looking for a MLTechnical Quality Assurance Lead to help ensure consistently high standards in our AI data training projects. This role combines the opportunity to work with modern machine learning systems with the responsibility of maintaining high-quality Python and ML content, making it a strong fit for people who are passionate about both technology and precision.

You will play a crucial role in guaranteeing the technical quality and consistency of ML-related training data, code, and evaluations, ultimately contributing to the success of our projects.

Key Responsibilities :

  • Technical quality review : Review Python / ML tasks and code submissions (scripts, notebooks, experiments) for correctness, clarity, model design, and alignment with project guidelines; provide clear and constructive feedback and escalate critical issues when needed.
  • Communication : Keep trainers and QAs updated on Discord about new items, ML-related clarifications, or project changes, and respond to their technical and process questions in a timely and professional manner.
  • Activation management : Monitor trainer / QA activity and proactively communicate with inactive contributors to understand blockers and encourage re-engagement.
  • Documentation : Create, maintain, and improve technical documentation such as ML coding guidelines, experiment checklists, best-practice examples, trackers, FAQs, honeypots, and related documents.
  • Onboarding & training : Schedule, organize, and run onboarding and training calls with trainers / QAs to walk them through ML quality standards, common issues, and review expectations.

Your Profile :

  • Academic / professional background : Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, Statistics, or a related field
  • Python & ML experience : Solid professional experience with Python for machine learning, including end-to-end workflows (data preparation, model training, evaluation, and deployment or experimentation).
  • ML stack : Strong hands-on experience with NumPy, pandas, scikit-learn, and at least one deep learning framework such as PyTorch or TensorFlow.
  • Analytical & problem-solving skills : Exceptional ability to understand and evaluate ML code, experiments, and metrics, quickly identify issues, and propose clear improvements.
  • Written communication : Excellent written communication skills in English, able to explain technical feedback, reasoning, and recommendations clearly to a distributed team.
  • Managing ambiguity : Comfortable working with incomplete or evolving ML specifications and able to clarify complex technical requirements effectively.
  • Leadership mindset : Comfortable working independently, giving feedback, and keeping the trainer / QA community engaged, aligned with standards, and supported.
  • Create a job alert for this search

    Quality Assurance Lead • North York, Ontario, CA

    Similar jobs
    QA Automation Engineer - SaaS Testing & AI / ML

    QA Automation Engineer - SaaS Testing & AI / ML

    Askuity • Toronto
    Full-time
    A retail analytics software company in Toronto is seeking a Quality Assurance Automation Engineer to ensure the delivery of high-quality SaaS products. As part of the Product Development team, you w...Show more
    Last updated: 5 days ago • Promoted
    Hybrid AI QA Lead for Content Migration

    Hybrid AI QA Lead for Content Migration

    TRSS • Toronto
    Full-time
    A legal technology solutions provider based in Toronto is offering an opportunity to lead AI quality strategy in a flexible hybrid environment. The role involves developing quality frameworks for co...Show more
    Last updated: 10 days ago • Promoted
    Senior AI / ML Developer - LLMs & Autonomous Agents

    Senior AI / ML Developer - LLMs & Autonomous Agents

    CGI • Toronto
    Full-time
    A leading IT consultancy in Toronto is seeking a Senior Consultant, Talent Acquisition Partner, specializing in AI / ML development. This role involves building AI agents, integrating Large Language M...Show more
    Last updated: 8 days ago • Promoted
    AI / ML Engineer

    AI / ML Engineer

    Vanguard Canada • Toronto
    Full-time
    Vanguard is seeking a talented and motivated AI / ML Engineer to join our team in building agentic systems for IT operations and resilience checking. This role is ideal for early‑career professionals ...Show more
    Last updated: 30+ days ago • Promoted
    ML Engineer : AI Detection & Info Integrity (Hybrid, Equity)

    ML Engineer : AI Detection & Info Integrity (Hybrid, Equity)

    GPTZero • Toronto C6A, ON, Canada
    Remote
    Full-time
    A pioneering AI detection firm in Toronto is looking for a Machine Learning Engineer to help build the next-generation platform for verifying information. The ideal candidate has 4+ years of experie...Show more
    Last updated: 2 days ago • Promoted
    ML Team Lead, AI & GenAI Solutions

    ML Team Lead, AI & GenAI Solutions

    Bloomberg • Toronto
    Full-time
    A global finance and technology provider based in Toronto is seeking a skilled Machine Learning Team Lead to guide engineers in ML / NLP applications. The role involves collaborating with stakeholders...Show more
    Last updated: 10 days ago • Promoted
    Quality Engineer II, AI Platform | Test Automation Lead

    Quality Engineer II, AI Platform | Test Automation Lead

    TD • Toronto
    Full-time
    A major financial institution in Toronto is looking for a Quality Engineer II for their AI Platform team.The candidate will focus on test automation with a strong emphasis on Python and Java progra...Show more
    Last updated: 10 days ago • Promoted
    Senior ML Engineer – Listing Quality (Hybrid)

    Senior ML Engineer – Listing Quality (Hybrid)

    Startops • Toronto
    Full-time
    A technology-driven marketplace is seeking a Senior Data Scientist / Machine Learning Engineer to leverage machine learning for improving product listings. In this role, you will design high-perform...Show more
    Last updated: 10 days ago • Promoted
    Senior QE Lead - AI Platform Quality & Automation

    Senior QE Lead - AI Platform Quality & Automation

    TD Securities • Toronto
    Full-time
    A leading investment bank in Toronto is seeking a Quality Engineer III to ensure high-quality software delivery.Responsibilities include test strategy development, automation, and leading cross-fun...Show more
    Last updated: 10 days ago • Promoted
    Director, Ratings AI

    Director, Ratings AI

    Python Software Foundation • Toronto C6A, ON, Canada
    Remote
    Full-time
    The Fitch Ratings AI team is currently seeking a Director of AI Prototyping based out of our Toronto office.The prospective candidate will be joining our innovative Ratings AI team, which focuses o...Show more
    Last updated: 2 days ago • Promoted
    Senior AI / ML Engineer (Remote)

    Senior AI / ML Engineer (Remote)

    vidIQ • Toronto, AB, CA
    Remote
    Full-time
    IQ builds software to help YouTube creators achieve their goals.Our mission is to advance the creator's journey with actionable data-driven insights and AI-powered tools. We are dedicated to our val...Show more
    Last updated: 30+ days ago
    AI Tech Lead : Conversational AI & ML for FinTech

    AI Tech Lead : Conversational AI & ML for FinTech

    Mashreq Bank • Toronto
    Full-time
    A leading financial institution is seeking an AI Tech Lead to spearhead projects involving AI and chatbots.The ideal candidate should have over 10 years of software development experience, with a s...Show more
    Last updated: 10 days ago • Promoted
    Senior AI / ML Engineer

    Senior AI / ML Engineer

    LTV.ai • Toronto
    Full-time
    AI‑powered ambassadors to deliver hyper‑personalized Email and SMS interactions at an unprecedented scale.Our platform enables brands to communicate with their audience in a natural and contextuall...Show more
    Last updated: 29 days ago • Promoted
    Remote Medical General Expert - Ai Trainer

    Remote Medical General Expert - Ai Trainer

    SuperAnnotate • Toronto, Canada, CA
    Remote
    Full-time
    In this hourly, remote contractor role, you will review AI-generated medical responses and / or generate expert healthcare content, evaluating reasoning quality and step-by-step clinical problem-solv...Show more
    Last updated: 4 days ago • Promoted
    LLM Engineer

    LLM Engineer

    Mindlance • Toronto
    Full-time
    Direct message the job poster from Mindlance.Hiring : LLM Engineers in Toronto! Be part of a fast-scaling team building Smarter, Next-Generation AI Agents alongside World-Leading AI Labs.Location : T...Show more
    Last updated: 5 hours ago • Promoted • New!
    AI / ML Product Lead – Payments Platform

    AI / ML Product Lead – Payments Platform

    Versapay • Toronto
    Full-time
    A tech company specializing in finance solutions seeks an experienced AI / ML Product Manager to oversee product development from ideation through launch. The ideal candidate must have 5-7 years of pr...Show more
    Last updated: 6 days ago • Promoted
    Senior ML Scientist, Listing Quality & AI Impact

    Senior ML Scientist, Listing Quality & AI Impact

    Faire • Toronto
    Full-time
    Faire is an online wholesale marketplace built on the belief that the future is local — independent retailers around the globe are doing more revenue than Walmart and Amazon combined, but individua...Show more
    Last updated: 30+ days ago • Promoted
    Quality Assurance Lead

    Quality Assurance Lead

    Foresters Financial • Toronto
    Full-time
    Get AI-powered advice on this job and more exclusive features.Purpose of role : Reporting to the Quality Assurance Manager, the Quality Assurance (QA) Lead will be responsible for the planning, moni...Show more
    Last updated: 8 days ago • Promoted