Talent.com
Remote ML Technical Quality Assurance Lead - AI Trainer
Remote ML Technical Quality Assurance Lead - AI TrainerSuperAnnotate • Scarborough, Ontario, CA
Remote ML Technical Quality Assurance Lead - AI Trainer

Remote ML Technical Quality Assurance Lead - AI Trainer

SuperAnnotate • Scarborough, Ontario, CA
18 days ago
Job type
  • Full-time
  • Remote
Job description

re you ready to take on a pivotal role in ensuring the highest standards in AI training? We are looking for a MLTechnical Quality Assurance Lead to help ensure consistently high standards in our AI data training projects. This role combines the opportunity to work with modern machine learning systems with the responsibility of maintaining high-quality Python and ML content, making it a strong fit for people who are passionate about both technology and precision.

You will play a crucial role in guaranteeing the technical quality and consistency of ML-related training data, code, and evaluations, ultimately contributing to the success of our projects.

Key Responsibilities :

  • Technical quality review : Review Python / ML tasks and code submissions (scripts, notebooks, experiments) for correctness, clarity, model design, and alignment with project guidelines; provide clear and constructive feedback and escalate critical issues when needed.
  • Communication : Keep trainers and QAs updated on Discord about new items, ML-related clarifications, or project changes, and respond to their technical and process questions in a timely and professional manner.
  • Activation management : Monitor trainer / QA activity and proactively communicate with inactive contributors to understand blockers and encourage re-engagement.
  • Documentation : Create, maintain, and improve technical documentation such as ML coding guidelines, experiment checklists, best-practice examples, trackers, FAQs, honeypots, and related documents.
  • Onboarding & training : Schedule, organize, and run onboarding and training calls with trainers / QAs to walk them through ML quality standards, common issues, and review expectations.

Your Profile :

  • Academic / professional background : Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, Statistics, or a related field
  • Python & ML experience : Solid professional experience with Python for machine learning, including end-to-end workflows (data preparation, model training, evaluation, and deployment or experimentation).
  • ML stack : Strong hands-on experience with NumPy, pandas, scikit-learn, and at least one deep learning framework such as PyTorch or TensorFlow.
  • Analytical & problem-solving skills : Exceptional ability to understand and evaluate ML code, experiments, and metrics, quickly identify issues, and propose clear improvements.
  • Written communication : Excellent written communication skills in English, able to explain technical feedback, reasoning, and recommendations clearly to a distributed team.
  • Managing ambiguity : Comfortable working with incomplete or evolving ML specifications and able to clarify complex technical requirements effectively.
  • Leadership mindset : Comfortable working independently, giving feedback, and keeping the trainer / QA community engaged, aligned with standards, and supported.
  • Create a job alert for this search

    Quality Assurance Lead • Scarborough, Ontario, CA

    Similar jobs
    ML Engineer : AI Reasoning Data Trainer (Remote)

    ML Engineer : AI Reasoning Data Trainer (Remote)

    Alignerr • Toronto, ON, Canada
    Full-time
    A tech-driven AI company is seeking a Machine Learning Engineer - AI Data Trainer.This remote role offers competitive hourly pay of $50–$70 and flexible hours between 10 to 40 per week.Responsibili...Show more
    Last updated: 9 days ago • Promoted
    QA Automation Engineer - SaaS Testing & AI / ML

    QA Automation Engineer - SaaS Testing & AI / ML

    Askuity • Toronto
    Full-time
    A retail analytics software company in Toronto is seeking a Quality Assurance Automation Engineer to ensure the delivery of high-quality SaaS products. As part of the Product Development team, you w...Show more
    Last updated: 6 days ago • Promoted
    Senior AML Tech Lead – AI / ML Compliance Solutions

    Senior AML Tech Lead – AI / ML Compliance Solutions

    RBC • Toronto
    Full-time
    A leading financial institution in Toronto is seeking a team manager for application development in Anti-Money Laundering (AML) functions. The role involves overseeing a team, defining technical sol...Show more
    Last updated: 16 hours ago • Promoted • New!
    Lead Quality Assurance Analyst

    Lead Quality Assurance Analyst

    Sapiens International • Toronto
    Full-time
    Lead Quality Assurance Analyst.Title : Lead Quality Assurance Analyst (Bilingual English-French).Sapiens is seeking a dynamic and experienced. Lead Quality Assurance Analyst (Bilingual English-French...Show more
    Last updated: 30+ days ago • Promoted
    Senior AI / ML Developer

    Senior AI / ML Developer

    Compunnel, Inc. • Toronto
    Full-time
    We are seeking an experienced AI / ML Senior Developer to design, develop, and validate machine learning solutions for U. The ideal candidate will bring hands-on experience in Python and SQL, a strong...Show more
    Last updated: 30+ days ago • Promoted
    ML Engineer : AI Detection & Info Integrity (Hybrid, Equity)

    ML Engineer : AI Detection & Info Integrity (Hybrid, Equity)

    GPTZero • Toronto
    Full-time
    A pioneering AI detection firm in Toronto is looking for a Machine Learning Engineer to help build the next-generation platform for verifying information. The ideal candidate has 4+ years of experie...Show more
    Last updated: 3 days ago • Promoted
    ML Team Lead, AI & GenAI Solutions

    ML Team Lead, AI & GenAI Solutions

    Bloomberg • Toronto
    Full-time
    A global finance and technology provider based in Toronto is seeking a skilled Machine Learning Team Lead to guide engineers in ML / NLP applications. The role involves collaborating with stakeholders...Show more
    Last updated: 11 days ago • Promoted
    Quality Assurance Lead

    Quality Assurance Lead

    Foresters Financial Services, Inc. • Toronto C6A, ON, Canada
    Remote
    Full-time
    Career Opportunity## Role TitleQuality Assurance Lead## Purpose of roleReporting to the Quality Assurance Manager, the Quality Assurance (QA) Lead will be responsible for the planning, monitoring a...Show more
    Last updated: 7 days ago • Promoted
    Quality Engineer II, AI Platform | Test Automation Lead

    Quality Engineer II, AI Platform | Test Automation Lead

    TD • Toronto
    Full-time
    A major financial institution in Toronto is looking for a Quality Engineer II for their AI Platform team.The candidate will focus on test automation with a strong emphasis on Python and Java progra...Show more
    Last updated: 11 days ago • Promoted
    Senior ML Engineer – Listing Quality (Hybrid)

    Senior ML Engineer – Listing Quality (Hybrid)

    Startops • Toronto
    Full-time
    A technology-driven marketplace is seeking a Senior Data Scientist / Machine Learning Engineer to leverage machine learning for improving product listings. In this role, you will design high-perform...Show more
    Last updated: 11 days ago • Promoted
    Senior QE Lead - AI Platform Quality & Automation

    Senior QE Lead - AI Platform Quality & Automation

    TD Securities • Toronto
    Full-time
    A leading investment bank in Toronto is seeking a Quality Engineer III to ensure high-quality software delivery.Responsibilities include test strategy development, automation, and leading cross-fun...Show more
    Last updated: 11 days ago • Promoted
    Senior AI / ML Engineer (Remote)

    Senior AI / ML Engineer (Remote)

    vidIQ • Toronto, AB, CA
    Remote
    Full-time
    IQ builds software to help YouTube creators achieve their goals.Our mission is to advance the creator's journey with actionable data-driven insights and AI-powered tools. We are dedicated to our val...Show more
    Last updated: 30+ days ago
    AI Tech Lead : Conversational AI & ML for FinTech

    AI Tech Lead : Conversational AI & ML for FinTech

    Mashreq Bank • Toronto
    Full-time
    A leading financial institution is seeking an AI Tech Lead to spearhead projects involving AI and chatbots.The ideal candidate should have over 10 years of software development experience, with a s...Show more
    Last updated: 11 days ago • Promoted
    Senior ML Engineer for Healthcare AI & LLM Apps

    Senior ML Engineer for Healthcare AI & LLM Apps

    Fullscript • Toronto, ON, Canada
    Full-time
    A leading health technology company is seeking a Senior Machine Learning Engineer to enhance AI-driven services for clinicians and patients. You will be responsible for developing and implementing L...Show more
    Last updated: 9 days ago • Promoted
    Senior TPM — AI / ML Platform Leadership

    Senior TPM — AI / ML Platform Leadership

    Autodesk • Toronto
    Full-time
    A leading design software company in Toronto is seeking a Senior Technical Program Manager to oversee Data and AI / ML platform development. This role involves driving enterprise-level programs, ensur...Show more
    Last updated: 30+ days ago • Promoted
    AI / ML Product Lead – Payments Platform

    AI / ML Product Lead – Payments Platform

    Versapay • Toronto
    Full-time
    A tech company specializing in finance solutions seeks an experienced AI / ML Product Manager to oversee product development from ideation through launch. The ideal candidate must have 5-7 years of pr...Show more
    Last updated: 7 days ago • Promoted
    Senior ML Scientist, Listing Quality & AI Impact

    Senior ML Scientist, Listing Quality & AI Impact

    Faire • Toronto
    Full-time
    Faire is an online wholesale marketplace built on the belief that the future is local — independent retailers around the globe are doing more revenue than Walmart and Amazon combined, but individua...Show more
    Last updated: 30+ days ago • Promoted
    Quality Assurance Lead

    Quality Assurance Lead

    Foresters Financial • Toronto
    Full-time
    Get AI-powered advice on this job and more exclusive features.Purpose of role : Reporting to the Quality Assurance Manager, the Quality Assurance (QA) Lead will be responsible for the planning, moni...Show more
    Last updated: 9 days ago • Promoted