Talent.com
Remote ML Technical Quality Assurance Lead - AI Trainer
Remote ML Technical Quality Assurance Lead - AI TrainerSuperAnnotate • Calgary, Alberta, CA
No longer accepting applications
Remote ML Technical Quality Assurance Lead - AI Trainer

Remote ML Technical Quality Assurance Lead - AI Trainer

SuperAnnotate • Calgary, Alberta, CA
23 days ago
Job type
  • Full-time
  • Remote
Job description

re you ready to take on a pivotal role in ensuring the highest standards in AI training? We are looking for a MLTechnical Quality Assurance Lead to help ensure consistently high standards in our AI data training projects. This role combines the opportunity to work with modern machine learning systems with the responsibility of maintaining high-quality Python and ML content, making it a strong fit for people who are passionate about both technology and precision.

You will play a crucial role in guaranteeing the technical quality and consistency of ML-related training data, code, and evaluations, ultimately contributing to the success of our projects.

Key Responsibilities :

  • Technical quality review : Review Python / ML tasks and code submissions (scripts, notebooks, experiments) for correctness, clarity, model design, and alignment with project guidelines; provide clear and constructive feedback and escalate critical issues when needed.
  • Communication : Keep trainers and QAs updated on Discord about new items, ML-related clarifications, or project changes, and respond to their technical and process questions in a timely and professional manner.
  • Activation management : Monitor trainer / QA activity and proactively communicate with inactive contributors to understand blockers and encourage re-engagement.
  • Documentation : Create, maintain, and improve technical documentation such as ML coding guidelines, experiment checklists, best-practice examples, trackers, FAQs, honeypots, and related documents.
  • Onboarding & training : Schedule, organize, and run onboarding and training calls with trainers / QAs to walk them through ML quality standards, common issues, and review expectations.

Your Profile :

  • Academic / professional background : Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, Statistics, or a related field
  • Python & ML experience : Solid professional experience with Python for machine learning, including end-to-end workflows (data preparation, model training, evaluation, and deployment or experimentation).
  • ML stack : Strong hands-on experience with NumPy, pandas, scikit-learn, and at least one deep learning framework such as PyTorch or TensorFlow.
  • Analytical & problem-solving skills : Exceptional ability to understand and evaluate ML code, experiments, and metrics, quickly identify issues, and propose clear improvements.
  • Written communication : Excellent written communication skills in English, able to explain technical feedback, reasoning, and recommendations clearly to a distributed team.
  • Managing ambiguity : Comfortable working with incomplete or evolving ML specifications and able to clarify complex technical requirements effectively.
  • Leadership mindset : Comfortable working independently, giving feedback, and keeping the trainer / QA community engaged, aligned with standards, and supported.
  • Create a job alert for this search

    Quality Assurance Lead • Calgary, Alberta, CA

    Similar jobs
    Quality Assurance Inspector

    Quality Assurance Inspector

    Avmax Careers - Canada • Calgary, AB, Canada
    Full-time +1
    Avmax is a diverse company offering every product and service related to aviation.We have locations, operations, and deployment worldwide. Avmax") is to simplify our customers' aviation nee...Show more
    Last updated: 10 days ago • Promoted
    Quality Assurance Analyst

    Quality Assurance Analyst

    Splashdot • Calgary, AB, CA
    Remote
    Full-time
    Quick Apply
    Plan, prioritize, and schedule QA activities based on project timelines, risk, and complexity.Develop test strategies, plans, test cases and documentation for individual pr...Show more
    Last updated: 27 days ago
    Quality Assurance Technician

    Quality Assurance Technician

    Cornerstone Building Brands • Calgary, AB, Canada
    Full-time
    Cornerstone Building Brands is a leading manufacturer of exterior building products for residential and low-rise non-residential buildings in North America. Repair & Remodel (R&R) markets.Ou...Show more
    Last updated: 30+ days ago • Promoted
    AI Engineer

    AI Engineer

    Randstad Digital Americas • calgary, ab, ca
    Full-time
    We are seeking a Senior AI Engineer to lead the design and development of advanced generative, recommender, and predictive models that drive significant business value. In this role, you will ensure...Show more
    Last updated: 14 hours ago • Promoted • New!
    QA Automation Lead

    QA Automation Lead

    Targeted Talent • Calgary, AB, Canada
    Permanent
    We are looking for an experienced.Senior Quality Automation Lead.This is a permanent position that is remote to start with later relocation to. Our client is a global enterprise company with a produ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer, AI Model Serving - Calgary, Canada

    Senior Software Engineer, AI Model Serving - Calgary, Canada

    Speechify • Calgary, AB, Canada
    Full-time
    The mission of Speechify is to make sure that reading is never a barrier to learning.Over 50 million people use Speechify's text-to-speech products to turn whatever they're reading – ...Show more
    Last updated: 2 days ago • Promoted
    Quality Assurance Engineer

    Quality Assurance Engineer

    NDAX Canada Inc. • Calgary, AB, Canada
    Full-time
    As one of Canada's largest and fastest growing cryptocurrency trading platforms, Ndax has set the bar high for the country's fintech industry and is constantly leading the way in terms of s...Show more
    Last updated: 30+ days ago • Promoted
    Technical Writer & Trainer

    Technical Writer & Trainer

    Helcim • Calgary, AB, Canada
    Full-time
    Helcim was founded with a mission at heart : to be the worlds most loved payment system.We believe that by offering small businesses in North America a decidedly human payment solution where it is e...Show more
    Last updated: 9 hours ago • Promoted • New!
    Product Manager, Mobile Experience (Remote)

    Product Manager, Mobile Experience (Remote)

    Rivalry • Calgary, AB, Canada
    Remote
    Full-time
    Rivalry is focused on building the most engaging next gen sports betting and entertainment brand globally and we’re looking for a solid Product Manager to join us on our next phase of growth....Show more
    Last updated: 30+ days ago • Promoted
    Solutions Architect (Insurance) - Fully Remote

    Solutions Architect (Insurance) - Fully Remote

    CoverGo • Calgary, AB, CA
    Remote
    Full-time
    Quick Apply
    Working on the latest tech for the Insurtech Market Leader.At CoverGo, our mission is to empower all insurance companies to make insurance 100% digital and accessible to everyone.We are a leading g...Show more
    Last updated: 30+ days ago
    Laboratory Quality Assurance Specialist - Calgary

    Laboratory Quality Assurance Specialist - Calgary

    freelance.ca • Calgary, Canada
    Full-time
    The Quality Assurance Specialist is responsible for ensuring all quality metrics are met in the laboratory / region in which they work. To accomplish this goal, QA Specialists will have a disciplined ...Show more
    Last updated: 30+ days ago • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Hifyre • calgary, ab, ca
    Full-time
    Hifyre provides market intelligence for the cannabis industry, analyzing retail data to help.Our models power product recommendations, sales forecasting, and market analysis for both internal opera...Show more
    Last updated: 19 days ago • Promoted
    Manager Quality Assurance

    Manager Quality Assurance

    Forum Canada, ULC • Calgary, AB, Canada
    Full-time
    The Quality Manager is responsible for developing, implementing, and maintaining the company’s Quality Management System (QMS) at each of the 3 Alberta-based manufacturing facilities.The role...Show more
    Last updated: 23 days ago • Promoted
    QA Engineer – Mobile Testing - Apptad

    QA Engineer – Mobile Testing - Apptad

    Apptad • airdrie, ab, ca
    Full-time
    Job Title : QA Engineer – Mobile Testing.We are seeking a detail-oriented and experienced QA Engineer with strong expertise in mobile application testing to join our team supporting a leading financ...Show more
    Last updated: 4 days ago • Promoted
    Customer Success Engineer - BioIntelligence Technologies

    Customer Success Engineer - BioIntelligence Technologies

    BioIntelligence Technologies • calgary, ab, ca
    Full-time
    BioIntelligence Technologies started with a simple goal : accelerate access to greener chemicals for families, friends, citizens, and the planet. Today, biotech accounts for 20% of all molecules and ...Show more
    Last updated: 19 days ago • Promoted
    Senior Lead Clinical Data Manager

    Senior Lead Clinical Data Manager

    Warman O'Brien • calgary, ab, ca
    Permanent
    Senior Lead Clinical Data Manager – Top CRO – Fully Remote – Permanent.My client is a global CRO who have revolutionized the field of data science and are rapidly expanding their data management te...Show more
    Last updated: 19 days ago • Promoted
    Lab Tech

    Lab Tech

    RESA Canada, Inc • Calgary, AB, Canada
    Full-time
    Analytical Testing Production : .Ensures turn-around-times are not exceeded and establishes sample / testing priorities in the department. Performs analytical analyses on samples of varying matrices.Ver...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Quality Assurance Analyst

    Senior Data Quality Assurance Analyst

    atVenu • Calgary, AB, CA
    Full-time
    Quick Apply
    Senior Data Quality Assurance Analyst Reports to : QA Manager About the Job : Our Senior Data Quality Assurance Analyst will be hyper focused on the backend of our proprietary software.This spe...Show more
    Last updated: 3 days ago