Talent.com
Remote ML Technical Quality Assurance Lead - AI Trainer
Remote ML Technical Quality Assurance Lead - AI TrainerSuperAnnotate • Calgary, Alberta, CA
Remote ML Technical Quality Assurance Lead - AI Trainer

Remote ML Technical Quality Assurance Lead - AI Trainer

SuperAnnotate • Calgary, Alberta, CA
17 days ago
Job type
  • Full-time
  • Remote
Job description

re you ready to take on a pivotal role in ensuring the highest standards in AI training? We are looking for a MLTechnical Quality Assurance Lead to help ensure consistently high standards in our AI data training projects. This role combines the opportunity to work with modern machine learning systems with the responsibility of maintaining high-quality Python and ML content, making it a strong fit for people who are passionate about both technology and precision.

You will play a crucial role in guaranteeing the technical quality and consistency of ML-related training data, code, and evaluations, ultimately contributing to the success of our projects.

Key Responsibilities :

  • Technical quality review : Review Python / ML tasks and code submissions (scripts, notebooks, experiments) for correctness, clarity, model design, and alignment with project guidelines; provide clear and constructive feedback and escalate critical issues when needed.
  • Communication : Keep trainers and QAs updated on Discord about new items, ML-related clarifications, or project changes, and respond to their technical and process questions in a timely and professional manner.
  • Activation management : Monitor trainer / QA activity and proactively communicate with inactive contributors to understand blockers and encourage re-engagement.
  • Documentation : Create, maintain, and improve technical documentation such as ML coding guidelines, experiment checklists, best-practice examples, trackers, FAQs, honeypots, and related documents.
  • Onboarding & training : Schedule, organize, and run onboarding and training calls with trainers / QAs to walk them through ML quality standards, common issues, and review expectations.

Your Profile :

  • Academic / professional background : Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, Statistics, or a related field
  • Python & ML experience : Solid professional experience with Python for machine learning, including end-to-end workflows (data preparation, model training, evaluation, and deployment or experimentation).
  • ML stack : Strong hands-on experience with NumPy, pandas, scikit-learn, and at least one deep learning framework such as PyTorch or TensorFlow.
  • Analytical & problem-solving skills : Exceptional ability to understand and evaluate ML code, experiments, and metrics, quickly identify issues, and propose clear improvements.
  • Written communication : Excellent written communication skills in English, able to explain technical feedback, reasoning, and recommendations clearly to a distributed team.
  • Managing ambiguity : Comfortable working with incomplete or evolving ML specifications and able to clarify complex technical requirements effectively.
  • Leadership mindset : Comfortable working independently, giving feedback, and keeping the trainer / QA community engaged, aligned with standards, and supported.
  • Create a job alert for this search

    Quality Assurance Lead • Calgary, Alberta, CA

    Similar jobs
    Quality Assurance Inspector

    Quality Assurance Inspector

    Avmax Careers - Canada • Calgary, AB, Canada
    Full-time +1
    Avmax is a diverse company offering every product and service related to aviation.We have locations, operations, and deployment worldwide. Avmax") is to simplify our customers' aviation nee...Show more
    Last updated: 4 days ago • Promoted
    Epic Beaker Analyst

    Epic Beaker Analyst

    W3Global Inc • Calgary, AB, Canada
    Permanent
    An Epic Beaker Analyst configures, implements, and supports the Epic Beaker Laboratory Information System (LIS), bridging clinical workflows and IT by designing system builds, managing interfaces (...Show more
    Last updated: 2 hours ago • Promoted • New!
    Quality Assurance Technician

    Quality Assurance Technician

    Cornerstone Building Brands • Calgary, AB, Canada
    Full-time
    Cornerstone Building Brands is a leading manufacturer of exterior building products for residential and low-rise non-residential buildings in North America. Repair & Remodel (R&R) markets.Ou...Show more
    Last updated: 30+ days ago • Promoted
    Tech Product Manager : Lead AI‑Driven Delivery & Growth

    Tech Product Manager : Lead AI‑Driven Delivery & Growth

    MNP • Calgary
    Full-time
    A leading national accounting firm based in Calgary is looking for a Technology Product Manager.In this role, you'll manage product teams, drive technology solutions, and lead product delivery effo...Show more
    Last updated: 10 days ago • Promoted
    Quality Assurance Manager

    Quality Assurance Manager

    Ateko, backed by Bell Canada • Calgary
    Full-time
    Get AI-powered advice on this job and more exclusive features.Direct message the job poster from Ateko, backed by Bell Canada. Ateko, backed by Bell Canada, delivers IT solutions across five platfor...Show more
    Last updated: 10 days ago • Promoted
    Machine Learning Engineer – PINN / FNO & Reservoir Simulation

    Machine Learning Engineer – PINN / FNO & Reservoir Simulation

    Computer Modelling Group Ltd. • Calgary
    Full-time
    Join CMG’s Innovation Lab asMachine Learning Engineer with a Master’s or PhD focused on Physics-Informed Neural Networks (PINNs), Fourier Neural Operators (FNOs), Deep Reinforcement Learning (DRL) ...Show more
    Last updated: 30+ days ago • Promoted
    Data Governance Lead : Elevate Data Quality & Trust

    Data Governance Lead : Elevate Data Quality & Trust

    Bridgewater Bank • Calgary
    Full-time
    A leading financial institution in Calgary is looking for a Senior Data Governance Analyst to lead enterprise data quality efforts and ensure the integrity of crucial data assets.The ideal candidat...Show more
    Last updated: 10 days ago • Promoted
    Lead Manufacturing Quality Assurance Engineer

    Lead Manufacturing Quality Assurance Engineer

    MRO Electronics • Calgary
    Full-time
    Lead Manufacturing Quality Assurance Engineer.Your actual pay will be based on your skills and experience — speak with our recruiter for details. The Lead Quality Assurance Engineer / Manager is respo...Show more
    Last updated: 30+ days ago • Promoted
    QA Engineer – Mobile Testing

    QA Engineer – Mobile Testing

    Apptad Inc • Calgary, AB, Canada
    Full-time
    Quick Apply
    MessageBody"> Job Title : QA Engineer Mobile Testing Location : Calgary, AB Job Summary : ...Show more
    Last updated: 4 hours ago • New!
    Laboratory Quality Assurance Specialist - Calgary

    Laboratory Quality Assurance Specialist - Calgary

    freelance.ca • Calgary, Canada
    Full-time
    The Quality Assurance Specialist is responsible for ensuring all quality metrics are met in the laboratory / region in which they work. To accomplish this goal, QA Specialists will have a disciplined ...Show more
    Last updated: 30+ days ago • Promoted
    Senior SQA Test Lead

    Senior SQA Test Lead

    Export Development Canada • Calgary
    Full-time +1
    At EDC, we support Canadian businesses to succeed globally.We provide the financial tools and expertise they need to explore new markets, reduce risks, all towards the goal of making Canada and the...Show more
    Last updated: 10 days ago • Promoted
    Senior Lead Clinical Data Manager

    Senior Lead Clinical Data Manager

    Warman O'Brien • Calgary, Alberta, Canada
    Permanent
    Senior Lead Clinical Data Manager – Top CRO – Fully Remote – Permanent.My client is a global CRO who have revolutionized the field of data science and are rapidly expanding their data management te...Show more
    Last updated: 2 days ago • Promoted
    Manager Quality Assurance

    Manager Quality Assurance

    Forum Canada, ULC • Calgary, AB, Canada
    Full-time
    The Quality Manager is responsible for developing, implementing, and maintaining the company’s Quality Management System (QMS) at each of the 3 Alberta-based manufacturing facilities.The role...Show more
    Last updated: 16 days ago • Promoted
    Quality Assurance (QA) / Quality Control (QC) Specialist

    Quality Assurance (QA) / Quality Control (QC) Specialist

    Pengcorp • Calgary
    Full-time +1
    Hiring Locations : Calgary, Edmonton, Fort McMurray, Texas, Eagle Ford & Marcellus.We are seeking a highly skilled and detail-oriented. Quality Assurance (QA) / Quality Control (QC) Specialist.This rol...Show more
    Last updated: 10 days ago • Promoted
    SDET : AI / ML Library in C++ (Open-Source)

    SDET : AI / ML Library in C++ (Open-Source)

    AMD • Calgary
    Full-time
    A leading tech company in Calgary is seeking a Software Development Engineer to provide Quality support for a library enabling GPU and AI-driven applications. The ideal candidate will develop test s...Show more
    Last updated: 30+ days ago • Promoted
    Electrical Quality Assurance / Quality Control Specialist

    Electrical Quality Assurance / Quality Control Specialist

    CDN • Calgary
    Full-time
    Electrical Quality Assurance / Quality Control Specialist.Electrical Quality Assurance / Quality Control Specialist.Be among the first 25 applicants. CDN is a recognized industry leader in the energy se...Show more
    Last updated: 10 days ago • Promoted
    Senior Quality Assurance Analyst

    Senior Quality Assurance Analyst

    PrePad • Calgary
    Full-time
    We\'re growing fast — and we need someone who can keep up.PrePad is on a mission to make engineering workflows radically more efficient for completions teams. As our first QA hire, you’ll be the bri...Show more
    Last updated: 10 days ago • Promoted
    Lab Tech

    Lab Tech

    RESA Canada, Inc • Calgary, AB, Canada
    Full-time
    Analytical Testing Production : .Ensures turn-around-times are not exceeded and establishes sample / testing priorities in the department. Performs analytical analyses on samples of varying matrices.Ver...Show more
    Last updated: 30+ days ago • Promoted