Talent.com
ML Technical Quality Assurance Lead
ML Technical Quality Assurance LeadSuperAnnotate • Fredericton, New Brunswick, CA
No longer accepting applications
ML Technical Quality Assurance Lead

ML Technical Quality Assurance Lead

SuperAnnotate • Fredericton, New Brunswick, CA
16 days ago
Job type
  • Full-time
  • Remote
Job description

re you ready to take on a pivotal role in ensuring the highest standards in AI training? We are looking for a MLTechnical Quality Assurance Lead to help ensure consistently high standards in our AI data training projects. This role combines the opportunity to work with modern machine learning systems with the responsibility of maintaining high-quality Python and ML content, making it a strong fit for people who are passionate about both technology and precision.

You will play a crucial role in guaranteeing the technical quality and consistency of ML-related training data, code, and evaluations, ultimately contributing to the success of our projects.

Key Responsibilities :

  • Technical quality review : Review Python / ML tasks and code submissions (scripts, notebooks, experiments) for correctness, clarity, model design, and alignment with project guidelines; provide clear and constructive feedback and escalate critical issues when needed.
  • Communication : Keep trainers and QAs updated on Discord about new items, ML-related clarifications, or project changes, and respond to their technical and process questions in a timely and professional manner.
  • Activation management : Monitor trainer / QA activity and proactively communicate with inactive contributors to understand blockers and encourage re-engagement.
  • Documentation : Create, maintain, and improve technical documentation such as ML coding guidelines, experiment checklists, best-practice examples, trackers, FAQs, honeypots, and related documents.
  • Onboarding & training : Schedule, organize, and run onboarding and training calls with trainers / QAs to walk them through ML quality standards, common issues, and review expectations.

Your Profile :

  • Academic / professional background : Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, Statistics, or a related field
  • Python & ML experience : Solid professional experience with Python for machine learning, including end-to-end workflows (data preparation, model training, evaluation, and deployment or experimentation).
  • ML stack : Strong hands-on experience with NumPy, pandas, scikit-learn, and at least one deep learning framework such as PyTorch or TensorFlow.
  • Analytical & problem-solving skills : Exceptional ability to understand and evaluate ML code, experiments, and metrics, quickly identify issues, and propose clear improvements.
  • Written communication : Excellent written communication skills in English, able to explain technical feedback, reasoning, and recommendations clearly to a distributed team.
  • Managing ambiguity : Comfortable working with incomplete or evolving ML specifications and able to clarify complex technical requirements effectively.
  • Leadership mindset : Comfortable working independently, giving feedback, and keeping the trainer / QA community engaged, aligned with standards, and supported.
  • Create a job alert for this search

    Quality Assurance Lead • Fredericton, New Brunswick, CA

    Similar jobs
    Palantir Data Engineer - Quality IT Resourcing

    Palantir Data Engineer - Quality IT Resourcing

    Quality IT Resourcing • fredericton, nb, ca
    Full-time
    Palantir Data Engineer / Analytics Specialist.There is a growing global demand for professionals with deep expertise in Palantir platforms, particularly within government, defense, and large enterp...Show more
    Last updated: 6 hours ago • Promoted • New!
    Technology Risk Management Leader

    Technology Risk Management Leader

    KPMG Canada • Fredericton
    Full-time
    A leading professional services firm in Fredericton, New Brunswick is looking for a Manager, Technology Risk Management.This role involves overseeing the execution of technology risk assessments, e...Show more
    Last updated: 30+ days ago • Promoted
    Growth-Driven BDR : Outbound Lead Gen & Qualification

    Growth-Driven BDR : Outbound Lead Gen & Qualification

    PLATO Testing Inc. • Fredericton
    Full-time
    A dynamic testing company in Fredericton is seeking a motivated early-career individual for a sales role focused on lead generation and qualification. You'll engage potential clients through various...Show more
    Last updated: 9 days ago • Promoted
    Senior Manager, System of Quality Management & Controls

    Senior Manager, System of Quality Management & Controls

    KPMG Canada • Fredericton
    Full-time
    A leading professional services firm in Fredericton is seeking a Senior Manager to lead the System of Quality Management program. The successful candidate will have a CPA designation and over 7 year...Show more
    Last updated: 10 days ago • Promoted
    Project Control Lead

    Project Control Lead

    Aecom • Fredericton
    Full-time
    At AECOM, we're delivering a better world.Whether improving your commute, keeping the lights on, providing access to clean water, or transforming skylines, our work helps people and communities thr...Show more
    Last updated: 9 days ago • Promoted
    Senior Lead Clinical Data Manager

    Senior Lead Clinical Data Manager

    Warman O'Brien • Fredericton, New Brunswick, Canada
    Permanent
    Senior Lead Clinical Data Manager – Top CRO – Fully Remote – Permanent.My client is a global CRO who have revolutionized the field of data science and are rapidly expanding their data management te...Show more
    Last updated: 2 days ago • Promoted
    Manager, Technology Risk Management

    Manager, Technology Risk Management

    KPMG Canada • Fredericton
    Full-time
    Manager, Technology Risk Management.At KPMG, you’ll join a team of diverse and dedicated problem solvers, connected by a common cause turning insight into opportunity for clients and communities ar...Show more
    Last updated: 30+ days ago • Promoted
    Senior QE Engineer

    Senior QE Engineer

    Targeted Talent • Fredericton, NB, Canada
    Permanent
    We are looking for an experienced.This is a permanent position that is remote to start with later relocation to.Our client is a global enterprise company with a product that you've likely used....Show more
    Last updated: 30+ days ago • Promoted
    Manager, Assurance

    Manager, Assurance

    Grant Thornton - Canada • Fredericton
    Full-time
    You know those big cities that still feel like small towns? Where everyone’s friendly and helps each other out? That’s like Doane Grant Thornton. Except here we’re all professionals and there isn’t ...Show more
    Last updated: 30+ days ago • Promoted
    Director of Technology

    Director of Technology

    Affinity • Fredericton
    Full-time
    On behalf of our Healthcare Client, Affinity Healthcare Solutions is looking for a Health Technical Project Director who will lead and manage the technical workstream within a large-scale digital h...Show more
    Last updated: 5 hours ago • Promoted • New!
    Technical Analyst

    Technical Analyst

    Bulletproof Solutions Inc • Fredericton, NB, Canada
    Temporary
    Headquartered in Canada with locations across the United States and around the globe with a footprint on six continents, Bulletproof, a GLI company has decades of technology, security, and complian...Show more
    Last updated: 30+ days ago • Promoted
    Oracle Cloud Senior Technical Lead

    Oracle Cloud Senior Technical Lead

    ArcLight Consulting • Fredericton, New Brunswick, Canada
    Full-time
    ArcLight Consulting, an Addison Group Company, is dedicated to ensuring that Cloud Solutions clients are successful with their investment. For over 15 years, ArcLight experts have provided guidance ...Show more
    Last updated: 2 days ago • Promoted
    Senior Manager – System of Quality Management

    Senior Manager – System of Quality Management

    KPMG Canada • Fredericton
    Full-time
    Senior Manager – System of Quality Management.Senior Manager – System of Quality Management.At KPMG, you’ll join a team of diverse and dedicated problem solvers, connected by a common cause turning...Show more
    Last updated: 30+ days ago • Promoted
    Senior Quality Engineer

    Senior Quality Engineer

    Targeted Talent • Fredericton, NB, Canada
    Permanent
    We are looking for an experienced.This is a permanent position that is remote to start with later relocation to.Our client is a global enterprise company with a product that you've likely used....Show more
    Last updated: 30+ days ago • Promoted
    Quality Engineer

    Quality Engineer

    Targeted Talent • Fredericton, NB, Canada
    Permanent
    We are looking for an experienced.This is a permanent position that is remote to start with later relocation to.Our client is a global enterprise company with a product that you've likely used....Show more
    Last updated: 30+ days ago • Promoted
    Health Tech Program Director

    Health Tech Program Director

    Affinity • Fredericton
    Full-time
    A healthcare consulting firm is seeking a Health Technical Project Director in Fredericton, Canada.The candidate will lead the technical workstream in a large-scale digital health program, ensuring...Show more
    Last updated: 5 hours ago • Promoted • New!
    Insurance document reviewer

    Insurance document reviewer

    Great Value Hiring • Fredericton, New Brunswick, Canada
    Full-time
    Insurance document reviewer [$80-$105 / hr].Insurance experts to review specialized content related to health insurance, reimbursement structures, and lifelong condition support.Review and validate i...Show more
    Last updated: 2 days ago • Promoted
    Assurance Manager : Lead Client Engagements & Growth

    Assurance Manager : Lead Client Engagements & Growth

    Grant Thornton - Canada • Fredericton
    Full-time
    A growing professional services firm in Fredericton seeks a motivated Manager in Assurance.You will lead client engagements, contribute to business development, and mentor teams while fostering a c...Show more
    Last updated: 10 days ago • Promoted