Talent.com
Mercor
German Audio Generalist Evaluator ExpertMercor • Ontario, Canada
German Audio Generalist Evaluator Expert

German Audio Generalist Evaluator Expert

Mercor • Ontario, Canada
29 days ago
Job type
  • Full-time
Job description
Mercor is seeking a German Audio Generalist Evaluator Expert to contribute to a high-impact audio AI research project with a leading research lab. In this role, you will work on transcription, annotation, and evaluation tasks that help train and benchmark advanced language models. This is a short-term, structured engagement ideal for candidates with strong academic or analytical backgrounds who are fluent in German and English and enjoy translating complex audio and visual information into precise, well-structured text. Job Responsibilities Transcribe and Optimize Audio & Video Listen to, analyze, and transcribe audio and video content in German , following detailed constraints and instructions. Produce high-quality written outputs in German, with supporting work in English when required. Ensure clarity, accuracy, and strict adherence to formatting and stylistic guidelines. Capture nuances such as tone, intent, and regional variations (e.g., High German vs. dialectal influences) where relevant. Define and Document Evaluation Standards Establish clear expectations for correct and high-quality responses in general consumer audio contexts. Develop detailed evaluation rubrics and grading guidelines in German and English . Document standards to ensure consistency across reviewers and model evaluations. Identify linguistic nuances, formal vs. informal register distinctions, and edge cases specific to German. Conduct Model Testing and Grading Run prompts through language models and assess generated outputs. Evaluate responses against predefined criteria for accuracy, completeness, fluency, and instructional clarity. Provide structured feedback to improve model performance in German audio tasks. Support Benchmarking and Quality Assurance Participate in QA and review cycles to ensure tasks, rubrics, and outputs meet Mercor’s quality bar. Maintain consistency and reliability before datasets are integrated into official benchmarks. Collaborate with project leads to resolve ambiguities and improve task design. Minimum Qualifications Strong writing, editing, and critical thinking skills. Ability to work independently, manage time effectively, and meet deadlines. Native or near-native fluency in German (spoken and written) and professional fluency in English. Ability to accurately transcribe and analyze German audio content across general consumer contexts. Available to commit 10–20 hours per week . Preferred Qualifications College students or recent graduates. Background in linguistics, humanities, social sciences, journalism, or technical disciplines. Prior experience with transcription, annotation, localization, evaluation, or research workflows in German. Familiarity with regional dialects (e.g., Austrian German, Swiss German) and register distinctions. Interest in AI, language models, or applied research environments. Application & Onboarding Process Complete a short AI-led interview (approximately 15 minutes). If selected, you will be onboarded and invited to begin project work. Additional Role Details Work in a structured, goal-oriented project environment with clear tooling, guidelines, and support. Gain hands-on exposure to real-world AI research and evaluation workflows. Contribute directly to benchmarking and improving advanced multilingual language models.
Create a job alert for this search

German Audio Generalist Evaluator Expert • Ontario, Canada

Similar jobs

Borealis AI Machine Learning Specialist

Borealis AISouthwestern Ontario, ON, CA
Full-time

Become a Machine Learning Specialist at Borealis AI and shape the future of AI through innovative research.Channel your skills in Python and deep learning to develop groundbreaking models.As a valu... Show more

 • Promoted

Camera Software Engineer at Ford EV Team

Ford Motor Companysouthwestern ontario, on, Canada
Full-time

Shape electric vehicle technology as a Camera Software Engineer at Ford of Canada.Focus on developing and integrating camera solutions for next-gen infotainment systems.In this hybrid opportunity, ... Show more

 • Promoted

Embedded Vision Developer

Planitar-Inc.southwestern ontario, on, Canada
Full-time

At Planitar, we build technology that helps people see and understand the world’s spaces more clearly.We are the creators of iGUIDE, a powerful property technology solution that combines immersive ... Show more

 • Promoted

Lead Data Modelling Engineer

OpenTextsouthwestern ontario, on, Canada
Full-time

Lead Data Modelling Engineer – OpenText.Join OpenText as a Lead Data Modelling Engineer, where AI powers innovation and you will lead data architecture and software development.A Development role a... Show more

 • Promoted

Lead AI Vision Engineer

Musashi AI North Americasouthwestern ontario, on, Canada
Full-time

Based in Waterloo, Ontario, Musashi AI North America employs a talented and dynamic team of R&D and Applications Engineers who lead design, prototyping, and testing efforts to drive new technology ... Show more

 • Promoted

Lead Machine Learning Engineer for AI Products

MasterClasssouthwestern ontario, on, Canada
Full-time

Pioneer AI-driven learning solutions as a Lead Machine Learning Engineer.Focus on delivering impactful consumer-facing products utilizing the latest AI advancements and engineering practices.This r... Show more

 • Promoted

Technician - Nuclear - KNES - New Berlin, WI

BlueGreen Alliance IncON, CA
Full-time

JobTarget helps you cut through the noise to reach and convert the best candidates.Our unified platform uses data and automated technology to help you efficiently manage applications and connect wi... Show more

 • Promoted

Google Augmented Reality Graphics Developer

GoogleSouthwestern Ontario, ON, CA
Full-time

Drive innovation at Google as a Graphics Developer in Augmented Reality.Use your C++ skills to tackle challenges in graphics rendering and immersive computing.As a pivotal member of the Google team... Show more

 • Promoted

Statistical Programmer in Pharma Consulting

AlsinovaSouthwestern Ontario, ON, CA
Full-time

Become a Statistical Programmer Consultant with Alsinova in Belgium, tackling complex statistical challenges within the pharmaceutical industry.Enhance your skills in automation, analysis, and clie... Show more

 • Promoted

Machine Learning Architect Driving Next-Gen AI Capabilities

Kinaxissouthwestern ontario, on, Canada
Full-time

Become a Machine Learning Architect and lead AI innovation efforts in supply chain management.Work in a flexible hybrid role focused on practical solutions for real customer challenges.This role re... Show more

 • Promoted

Machine Learning Research Engineer

AppleSouthwestern Ontario, ON, CA
Full-time

The Product Operations machine learning team is seeking a machine learning research engineer to conduct research in anomaly detection and automated machine learning to address domain‑specific chall... Show more

 • Promoted

Lead Machine Learning Researcher with Borealis AI

Borealis AISouthwestern Ontario, ON, CA
Full-time

Harness your expertise to revolutionize AI at Borealis AI as a Senior Machine Learning Researcher.Engage with vast data sets and develop advanced algorithms that set industry standards.Join Boreali... Show more

 • Promoted

Senior Operational Test and Evaluation Engineer

Spectrum Comm IncEastern Ontario
Full-time +1

Senior Operational Test and Evaluation Engineer.Spectrum is seeking highly qualified Engineers and/or Analysts to support Operational Test & Evaluation (OT&E) programs located in Edwards AFB, CA.Ke... Show more

 • Promoted

Kinaxis Machine Learning & Operations Research Engineer

Kinaxissouthwestern ontario, on, Canada
Full-time

Drive innovation with Kinaxis as a Machine Learning & Operations Research Engineer.This role involves enhancing supply chain solutions through mathematical modeling and robust software development ... Show more

 • Promoted

Machine Learning/Operations Research Platform Engineer

Kinaxissouthwestern ontario, on, Canada
Full-time

Are you looking to join an innovative, market‑leading company where you can truly elevate your career? At Kinaxis we are serious about culture, technology, customers, and not taking ourselves too s... Show more

 • Promoted

Statistical Programmer – Waterloo, Belgium (F/M)

AlsinovaSouthwestern Ontario, ON, CA
Full-time

What we will accomplish together.Alsinova is looking on a regular basis for Statistical Programmer Consultants to join our consulting team for clients’ projects (from big pharma to small biotech) b... Show more

 • Promoted

Medical Affairs Expert for Alsinova

AlsinovaSouthwestern Ontario, ON, CA
Full-time

Elevate your career in Belgium as a Medical Affairs Expert with Alsinova.Contribute to high-profile pharmaceutical projects while honing your scientific knowledge.Join Alsinova in this exciting Con... Show more

 • Promoted

Senior Machine Learning Engineer

Instacart, on, canada, on, Canada
Permanent

We're transforming the grocery industry.At Instacart, we invite the world to share love through food because we believe everyone should have access to the food they love and more time to enjoy it t... Show more

 • Promoted

Machine Learning Engineer, Edge AI

onsemisouthwestern ontario, on, Canada
Full-time

We are looking for a Principal Firmware Engineer to lead the integration and control of our next‑generation AI accelerators.As our products evolve to include dedicated neural network hardware, the ... Show more

 • Promoted

Home Health Speech Language Pathologist

PARS TherapySouthwestern Ontario, ON, CA
Full-time

This is an exciting opportunity to help shape an interdisciplinary, patient-centered care model by contributing to the development of a collaborative and high-performing therapy team.Deliver direct... Show more