Talent.com
Remote ML Technical Quality Assurance Lead - AI Trainer
Remote ML Technical Quality Assurance Lead - AI TrainerSuperAnnotate • Scarborough, Ontario, CA
Remote ML Technical Quality Assurance Lead - AI Trainer

Remote ML Technical Quality Assurance Lead - AI Trainer

SuperAnnotate • Scarborough, Ontario, CA
14 days ago
Job type
  • Full-time
  • Remote
Job description

re you ready to take on a pivotal role in ensuring the highest standards in AI training? We are looking for a MLTechnical Quality Assurance Lead to help ensure consistently high standards in our AI data training projects. This role combines the opportunity to work with modern machine learning systems with the responsibility of maintaining high-quality Python and ML content, making it a strong fit for people who are passionate about both technology and precision.

You will play a crucial role in guaranteeing the technical quality and consistency of ML-related training data, code, and evaluations, ultimately contributing to the success of our projects.

Key Responsibilities :

  • Technical quality review : Review Python / ML tasks and code submissions (scripts, notebooks, experiments) for correctness, clarity, model design, and alignment with project guidelines; provide clear and constructive feedback and escalate critical issues when needed.
  • Communication : Keep trainers and QAs updated on Discord about new items, ML-related clarifications, or project changes, and respond to their technical and process questions in a timely and professional manner.
  • Activation management : Monitor trainer / QA activity and proactively communicate with inactive contributors to understand blockers and encourage re-engagement.
  • Documentation : Create, maintain, and improve technical documentation such as ML coding guidelines, experiment checklists, best-practice examples, trackers, FAQs, honeypots, and related documents.
  • Onboarding & training : Schedule, organize, and run onboarding and training calls with trainers / QAs to walk them through ML quality standards, common issues, and review expectations.

Your Profile :

  • Academic / professional background : Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, Statistics, or a related field
  • Python & ML experience : Solid professional experience with Python for machine learning, including end-to-end workflows (data preparation, model training, evaluation, and deployment or experimentation).
  • ML stack : Strong hands-on experience with NumPy, pandas, scikit-learn, and at least one deep learning framework such as PyTorch or TensorFlow.
  • Analytical & problem-solving skills : Exceptional ability to understand and evaluate ML code, experiments, and metrics, quickly identify issues, and propose clear improvements.
  • Written communication : Excellent written communication skills in English, able to explain technical feedback, reasoning, and recommendations clearly to a distributed team.
  • Managing ambiguity : Comfortable working with incomplete or evolving ML specifications and able to clarify complex technical requirements effectively.
  • Leadership mindset : Comfortable working independently, giving feedback, and keeping the trainer / QA community engaged, aligned with standards, and supported.
  • Create a job alert for this search

    Quality Assurance Lead • Scarborough, Ontario, CA

    Similar jobs
    ML Engineer : AI Reasoning Data Trainer (Remote)

    ML Engineer : AI Reasoning Data Trainer (Remote)

    Alignerr • Toronto, ON, Canada
    Full-time
    A tech-driven AI company is seeking a Machine Learning Engineer - AI Data Trainer.This remote role offers competitive hourly pay of $50–$70 and flexible hours between 10 to 40 per week.Responsibili...Show more
    Last updated: 5 days ago • Promoted
    QA Automation Engineer - SaaS Testing & AI / ML

    QA Automation Engineer - SaaS Testing & AI / ML

    Askuity • Toronto
    Full-time
    A retail analytics software company in Toronto is seeking a Quality Assurance Automation Engineer to ensure the delivery of high-quality SaaS products. As part of the Product Development team, you w...Show more
    Last updated: 2 days ago • Promoted
    Hybrid AI QA Lead for Content Migration

    Hybrid AI QA Lead for Content Migration

    TRSS • Toronto
    Full-time
    A legal technology solutions provider based in Toronto is offering an opportunity to lead AI quality strategy in a flexible hybrid environment. The role involves developing quality frameworks for co...Show more
    Last updated: 7 days ago • Promoted
    AI / ML Engineer

    AI / ML Engineer

    Vanguard Canada • Toronto
    Full-time
    Vanguard is seeking a talented and motivated AI / ML Engineer to join our team in building agentic systems for IT operations and resilience checking. This role is ideal for early‑career professionals ...Show more
    Last updated: 28 days ago • Promoted
    Lead AI QA Engineer - Quality Strategy & Delivery

    Lead AI QA Engineer - Quality Strategy & Delivery

    Refinitiv • Toronto
    Full-time
    A leading legal tech firm in Toronto is looking for a lead software engineer to join their team.You will help shape AI products used across the legal industry, focusing on quality strategies and te...Show more
    Last updated: 7 days ago • Promoted
    ML Engineer - Generative AI & LLMs (Remote)

    ML Engineer - Generative AI & LLMs (Remote)

    Ample Insight Inc. • Toronto, ON, Canada
    Remote
    Full-time
    You will join a world-class team of engineers and data scientists from Facebook, Uber, Amazon and Google.We are a fast growing consulting firm based in Toronto with clients ranging from leading sta...Show more
    Last updated: 30+ days ago • Promoted
    Lead Quality Assurance Engineer

    Lead Quality Assurance Engineer

    Integriti • Toronto
    Full-time
    Talent Acquisition Associate @Integriti | Connecting leading experts with Fortune 500 clients.Contract-to-Hire | Initial Duration : 3 to 6 Months. We are seeking an experienced Lead QA Engineer (Test...Show more
    Last updated: 29 days ago • Promoted
    ML Team Lead, AI & GenAI Solutions

    ML Team Lead, AI & GenAI Solutions

    Bloomberg • Toronto
    Full-time
    A global finance and technology provider based in Toronto is seeking a skilled Machine Learning Team Lead to guide engineers in ML / NLP applications. The role involves collaborating with stakeholders...Show more
    Last updated: 7 days ago • Promoted
    Quality Assurance Developer

    Quality Assurance Developer

    OpenText • Richmond Hill
    Full-time
    OpenText is a global leader in information management, where innovation, creativity, and collaboration are the key components of our corporate culture. As a member of our team, you will have the opp...Show more
    Last updated: 28 days ago • Promoted
    AML Quality Assurance Manager – Hybrid Leadership

    AML Quality Assurance Manager – Hybrid Leadership

    Equitable Group • Toronto
    Full-time
    A leading financial institution in Toronto is seeking an Associate Manager in AML Quality Assurance to oversee compliance processes. You'll leverage your expertise in Anti-Money Laundering regulatio...Show more
    Last updated: 7 days ago • Promoted
    Senior QE Lead - AI Platform Quality & Automation

    Senior QE Lead - AI Platform Quality & Automation

    TD Securities • Toronto
    Full-time
    A leading investment bank in Toronto is seeking a Quality Engineer III to ensure high-quality software delivery.Responsibilities include test strategy development, automation, and leading cross-fun...Show more
    Last updated: 7 days ago • Promoted
    AI Tech Lead : Conversational AI & ML for FinTech

    AI Tech Lead : Conversational AI & ML for FinTech

    Mashreq Bank • Toronto
    Full-time
    A leading financial institution is seeking an AI Tech Lead to spearhead projects involving AI and chatbots.The ideal candidate should have over 10 years of software development experience, with a s...Show more
    Last updated: 7 days ago • Promoted
    Senior AI / ML Engineer (Remote)

    Senior AI / ML Engineer (Remote)

    vidIQ • Toronto, AB, CA
    Remote
    Full-time
    IQ builds software to help YouTube creators achieve their goals.Our mission is to advance the creator's journey with actionable data-driven insights and AI-powered tools. We are dedicated to our val...Show more
    Last updated: 30+ days ago
    Senior AI / ML Engineer

    Senior AI / ML Engineer

    LTV.ai • Toronto
    Full-time
    AI‑powered ambassadors to deliver hyper‑personalized Email and SMS interactions at an unprecedented scale.Our platform enables brands to communicate with their audience in a natural and contextuall...Show more
    Last updated: 26 days ago • Promoted
    AI / ML Product Lead – Payments Platform

    AI / ML Product Lead – Payments Platform

    Versapay • Toronto
    Full-time
    A tech company specializing in finance solutions seeks an experienced AI / ML Product Manager to oversee product development from ideation through launch. The ideal candidate must have 5-7 years of pr...Show more
    Last updated: 3 days ago • Promoted
    Senior ML Scientist, Listing Quality & AI Impact

    Senior ML Scientist, Listing Quality & AI Impact

    Faire • Toronto
    Full-time
    Faire is an online wholesale marketplace built on the belief that the future is local — independent retailers around the globe are doing more revenue than Walmart and Amazon combined, but individua...Show more
    Last updated: 28 days ago • Promoted
    Quality Assurance Lead

    Quality Assurance Lead

    Foresters Financial • Toronto
    Full-time
    Get AI-powered advice on this job and more exclusive features.Purpose of role : Reporting to the Quality Assurance Manager, the Quality Assurance (QA) Lead will be responsible for the planning, moni...Show more
    Last updated: 5 days ago • Promoted
    Associate Manager, AML Quality Assurance

    Associate Manager, AML Quality Assurance

    Queer Tech • Toronto
    Full-time +1
    Being a traditional bank just isn’t our thing, so we challenge ourselves to get creative in providing innovative banking solutions for Canadians. How do we get there? With a talented team of inquisi...Show more
    Last updated: 7 days ago • Promoted