Talent.com
Remote ML Technical Quality Assurance Lead - AI Trainer
Remote ML Technical Quality Assurance Lead - AI TrainerSuperAnnotate • St. Catharines, Ontario, CA
No longer accepting applications
Remote ML Technical Quality Assurance Lead - AI Trainer

Remote ML Technical Quality Assurance Lead - AI Trainer

SuperAnnotate • St. Catharines, Ontario, CA
24 days ago
Job type
  • Full-time
  • Remote
Job description

re you ready to take on a pivotal role in ensuring the highest standards in AI training? We are looking for a MLTechnical Quality Assurance Lead to help ensure consistently high standards in our AI data training projects. This role combines the opportunity to work with modern machine learning systems with the responsibility of maintaining high-quality Python and ML content, making it a strong fit for people who are passionate about both technology and precision.

You will play a crucial role in guaranteeing the technical quality and consistency of ML-related training data, code, and evaluations, ultimately contributing to the success of our projects.

Key Responsibilities :

  • Technical quality review : Review Python / ML tasks and code submissions (scripts, notebooks, experiments) for correctness, clarity, model design, and alignment with project guidelines; provide clear and constructive feedback and escalate critical issues when needed.
  • Communication : Keep trainers and QAs updated on Discord about new items, ML-related clarifications, or project changes, and respond to their technical and process questions in a timely and professional manner.
  • Activation management : Monitor trainer / QA activity and proactively communicate with inactive contributors to understand blockers and encourage re-engagement.
  • Documentation : Create, maintain, and improve technical documentation such as ML coding guidelines, experiment checklists, best-practice examples, trackers, FAQs, honeypots, and related documents.
  • Onboarding & training : Schedule, organize, and run onboarding and training calls with trainers / QAs to walk them through ML quality standards, common issues, and review expectations.

Your Profile :

  • Academic / professional background : Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, Statistics, or a related field
  • Python & ML experience : Solid professional experience with Python for machine learning, including end-to-end workflows (data preparation, model training, evaluation, and deployment or experimentation).
  • ML stack : Strong hands-on experience with NumPy, pandas, scikit-learn, and at least one deep learning framework such as PyTorch or TensorFlow.
  • Analytical & problem-solving skills : Exceptional ability to understand and evaluate ML code, experiments, and metrics, quickly identify issues, and propose clear improvements.
  • Written communication : Excellent written communication skills in English, able to explain technical feedback, reasoning, and recommendations clearly to a distributed team.
  • Managing ambiguity : Comfortable working with incomplete or evolving ML specifications and able to clarify complex technical requirements effectively.
  • Leadership mindset : Comfortable working independently, giving feedback, and keeping the trainer / QA community engaged, aligned with standards, and supported.
  • Create a job alert for this search

    Quality Assurance Lead • St. Catharines, Ontario, CA

    Similar jobs
    Senior Product Manager (B2B SaaS / Healthcare AI) - Ubie

    Senior Product Manager (B2B SaaS / Healthcare AI) - Ubie

    Ubie • st catharines, on, ca
    Full-time
    Are you an experienced Product Manager looking to build the future of AI-driven healthcare?.B2B SaaS solutions for healthcare providers and payers. In this role, you will operate in an.AI to transfo...Show more
    Last updated: 9 hours ago • Promoted • New!
    Remote C# Software Engineer - AI Trainer

    Remote C# Software Engineer - AI Trainer

    SuperAnnotate • St. Catharines, Ontario, CA
    Remote
    Full-time
    This is an hourly-paid, fully remote contractor role where you will review AI-generated responses and / or generate C# / . NET engineering content, evaluating reasoning quality and step-by-step problem-...Show more
    Last updated: 17 hours ago • New!
    Senior Product Manager (B2B SaaS / Healthcare AI)

    Senior Product Manager (B2B SaaS / Healthcare AI)

    Ubie • st catharines, on, ca
    Full-time
    Are you an experienced Product Manager looking to build the future of AI-driven healthcare?.B2B SaaS solutions for healthcare providers and payers. In this role, you will operate in an.AI to transfo...Show more
    Last updated: 9 hours ago • Promoted • New!
    Trigonometry Private Tutoring Jobs St. Catharines

    Trigonometry Private Tutoring Jobs St. Catharines

    Superprof • St. Catharines, Canada
    Full-time +1
    Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi...Show more
    Last updated: 30+ days ago • Promoted
    Senior Electrical Engineer (AI Consulting) - Aligned Labs

    Senior Electrical Engineer (AI Consulting) - Aligned Labs

    Aligned Labs • st catharines, on, ca
    Part-time
    We are looking to expand our team of expert consultants with 25.Senior Electrical Engineering Experts.Projects start at $100-130 USD / hour with top-performing experts on our platform earning $200+...Show more
    Last updated: 9 hours ago • Promoted • New!
    Agentic AI Developer

    Agentic AI Developer

    NLB Services • st catharines, on, ca
    Full-time
    Strong programming experience in Python (required); JavaScript / TypeScript a plus.AI workflows using frameworks such as LangChain, LangGraph, AutoGen, CrewAI, or Semantic Kernel.ReAct, Plan-and-Exec...Show more
    Last updated: 6 hours ago • Promoted • New!
    Technical Project Manager with Kinaxis

    Technical Project Manager with Kinaxis

    NLB Services • st catharines, on, ca
    Full-time
    Technical Project Manager with Kinaxis.Experience, Supply Chain / Life Science Experience.The Technical PM is responsible for overseeing the simultaneous rollout of a multi-site production schedulin...Show more
    Last updated: 9 hours ago • Promoted • New!
    Program Test Manager - st catharines

    Program Test Manager - st catharines

    Teacup Tech Systems • st catharines, on, ca
    Permanent
    Reporting to the Team Lead for Enterprise Quality Assurance, the Program Test Manager is responsible for managing the testing and delivery of a multi-year program of complex projects, as well as me...Show more
    Last updated: 2 days ago • Promoted
    Trigonometry Private Tutoring Jobs Welland

    Trigonometry Private Tutoring Jobs Welland

    Superprof • Welland, Canada
    Full-time +1
    Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi...Show more
    Last updated: 30+ days ago • Promoted
    Technical Project Manager with Kinaxis - NLB Services

    Technical Project Manager with Kinaxis - NLB Services

    NLB Services • st catharines, on, ca
    Full-time
    Technical Project Manager with Kinaxis.Experience, Supply Chain / Life Science Experience.The Technical PM is responsible for overseeing the simultaneous rollout of a multi-site production schedulin...Show more
    Last updated: 9 hours ago • Promoted • New!
    Group Product Manager - st catharines

    Group Product Manager - st catharines

    ODAIA • st catharines, on, ca
    Full-time +1
    An Ancient Greek word referring to “tools of the trade.ODAIA is a remote first organization, all our positions are WFH with frequent company and team based socials, events and meetings in-person an...Show more
    Last updated: 4 days ago • Promoted
    Pet Groomer Trainee

    Pet Groomer Trainee

    PetSmart • St Catharines, Ontario, Canada
    Full-time +1
    PetSmart does Anything for Pets – JOIN OUR TEAM!.At PetSmart, Anything for Pets begins with our people.Every associate plays a vital role in creating meaningful experiences for pets and their famil...Show more
    Last updated: 9 days ago • Promoted
    Trigonometry Private Tutoring Jobs Lincoln

    Trigonometry Private Tutoring Jobs Lincoln

    Superprof • Lincoln, Canada
    Full-time +1
    Superprof is Canada's #1 tutoring platform, and we're actively recruiting passionate tutors! Whether you're a student, a professional, or simply someone who loves teaching, join the largest communi...Show more
    Last updated: 30+ days ago • Promoted
    Agentic AI Developer - NLB Services

    Agentic AI Developer - NLB Services

    NLB Services • st catharines, on, ca
    Full-time
    Strong programming experience in Python (required); JavaScript / TypeScript a plus.AI workflows using frameworks such as LangChain, LangGraph, AutoGen, CrewAI, or Semantic Kernel.ReAct, Plan-and-Exec...Show more
    Last updated: 6 hours ago • Promoted • New!
    SAP ABAP Technical Lead

    SAP ABAP Technical Lead

    Hays • st catharines, on, ca
    Full-time
    Senior SAP ABAP Technical Lead.We are in search of a seasoned Senior SAP ABAP Technical Lead to oversee SAP technical operations and guide development activities within our SAP ecosystem.This inclu...Show more
    Last updated: 2 days ago • Promoted
    Agentic AI Developer - st catharines

    Agentic AI Developer - st catharines

    NLB Services • st catharines, on, ca
    Full-time
    Strong programming experience in Python (required); JavaScript / TypeScript a plus.AI workflows using frameworks such as LangChain, LangGraph, AutoGen, CrewAI, or Semantic Kernel.ReAct, Plan-and-Exec...Show more
    Last updated: 6 hours ago • Promoted • New!
    Senior Machine Learning Scientist - st catharines

    Senior Machine Learning Scientist - st catharines

    Metric Geo • st catharines, on, ca
    Full-time
    Metric has partnered with a VC-backed AI company working with leading retail and ecommerce brands to improve how their product data performs across search engines, generative answer engines, and AI...Show more
    Last updated: 9 hours ago • Promoted • New!
    Senior Machine Learning Scientist - Metric Geo

    Senior Machine Learning Scientist - Metric Geo

    Metric Geo • st catharines, on, ca
    Full-time
    Metric has partnered with a VC-backed AI company working with leading retail and ecommerce brands to improve how their product data performs across search engines, generative answer engines, and AI...Show more
    Last updated: 9 hours ago • Promoted • New!