Talent.com
Luma
Multimodal AI Evaluation Research EngineerLuma • Toronto, Canada
No longer accepting applications
Multimodal AI Evaluation Research Engineer

Multimodal AI Evaluation Research Engineer

Luma • Toronto, Canada
7 days ago
Job type
  • Full-time
Job description
Expand your career with Luma AI as a Research Engineer specializing in multimodal AI evaluations. This role focuses on creating scalable evaluation infrastructures for generative models across various mediums.

In this innovative position at Luma AI, you will design automated systems that meticulously evaluate the performance of visual and multimodal models. By working closely with research and engineering teams, you’ll ensure our model outputs meet rigorous evaluation standards, which is crucial for enhancing model capabilities in generative AI.

Key Responsibilities: • Design automated evaluation pipelines for multimodal outputs • Develop metrics focusing on coherence and temporal consistency • Implement integration of evaluation signals in model training • Build large-scale regression testing infrastructure • Collaborate on automated human study translations

Requirements: • Master’s or PhD in Computer Science or similar fields • Minimum 5 years in ML evaluation system development • Practical experience with visual data handling • Proficient in Python and related ML frameworks • Understanding of human-in-the-loop processes

Contribute to groundbreaking research in generative AI model evaluation with Luma AI. #J-18808-Ljbffr
Create a job alert for this search

Multimodal AI Evaluation Research Engineer • Toronto, Canada

Similar jobs

AI Model Evaluation Analyst - markham

Workerbeemarkham, on, ca
Permanent

No C2C or third-party submissions.Workerbee connects workers with employers through trusted introductions.By joining Workerbee you can be matched for project-based, contract, or permanent opportuni... Show more

 • Promoted

AI Platform Engineer: Build & Evaluate AI Systems

Armilla AIToronto, ON, CA
Full-time

A leading AI-focused startup in Toronto is seeking an experienced AI Engineer to shape the future of AI risk management.In this pivotal role, you will be responsible for building core AI tools and ... Show more

 • Promoted

Applied AI Research Scientist — Multimodal Evaluation

MillionLogicsToronto, ON, CA
Full-time

A global IT solutions provider is searching for skilled Applied AI Research Scientists to contribute to AI system evaluations.Candidates should hold an MS or Ph.The role involves designing rigorous... Show more

 • Promoted

Sr. Machine Learning Engineer

SPECTRAFORCEGreater Toronto Area, Canada, Canada
Full-time

Location: Toronto, ON, Hybrid- 2-3 days onsite.This role is a shared service supporting all LOBs.Area of focus- Pricing model/ discretionary customer pricing solutions.Uses advanced analytical algo... Show more

 • Promoted

AI Model Evaluation Analyst - newmarket

Workerbeenewmarket, on, ca
Permanent

No C2C or third-party submissions.Workerbee connects workers with employers through trusted introductions.By joining Workerbee you can be matched for project-based, contract, or permanent opportuni... Show more

 • Promoted

Agentic AI Researcher

LG Electronics Canada, Inc.Toronto, ON, CA
Full-time

Toronto’s AI Lab is seeking an Agentic AI Researcher to help shape the next generation of LG Electronics’ products by advancing research in agentic AI systems and applying those capabilities across... Show more

 • Promoted

Agentic AI Developer

HaysGreater Toronto Area, Canada, Canada
Full-time

Our client is a fast‑growing technology organization building next‑generation AI‑driven products.The team is focused on designing and scaling intelligent, autonomous systems that solve real‑world p... Show more

 • Promoted

Model Evaluation Senior Research Engineer

CohereToronto, ON, CA
Full-time

Drive cutting-edge AI evaluation techniques at Cohere as a Senior Research Engineer in Model Evaluation.Develop groundbreaking methods to assess and scale frontier model capabilities efficiently.In... Show more

 • Promoted

World Models Research Engineer - Generative AI for Dynamic Scenes

WaabiToronto, ON, CA
Full-time

A leading autonomous technology company in Toronto is seeking a Research Engineer to design and implement generative and predictive modeling systems.You will collaborate with research scientists to... Show more

 • Promoted

AI Model Evaluation Analyst - Workerbee

Workerbeemarkham, on, ca
Permanent

No C2C or third-party submissions.Workerbee connects workers with employers through trusted introductions.By joining Workerbee you can be matched for project-based, contract, or permanent opportuni... Show more

 • Promoted

Remote Machine Learning Evaluation Specialist

AlignerrToronto, ON, CA
Remote
Full-time

Shape the future of AI with Alignerr as a Remote Machine Learning Evaluation Specialist.Design advanced evaluation challenges to stretch cutting-edge AI systems beyond their standard limits.At Alig... Show more

 • Promoted

Research Engineer - Decentralized AI Systems

Yotta LabsToronto, ON, CA
Full-time

Research Engineer - Decentralized AI Systems.Join to apply for the Research Engineer - Decentralized AI Systems role at Yotta Labs.Yotta Labs is pioneering the development of a Decentralized Operat... Show more

 • Promoted

ML Engineer / Research Engineer (Contractor)

ManevaToronto, ON, CA
Full-time

Maneva is pioneering the development of AI systems for manufacturing operations, leveraging vision and production data to reduce downtime, enhance quality, and improve worker safety through actiona... Show more

 • Promoted

AI Researcher for Agentic Systems

LG Electronics Canada, Inc.Toronto, ON, CA
Full-time

Shape the future of LG Electronics with cutting-edge AI research as an Agentic AI Researcher.Drive innovation in self-learning and personalized AI systems for smart home devices and appliances.Join... Show more

 • Promoted

Multilang Code & AI Model Evaluator

Mercor AiToronto, ON, CA
Full-time

A tech company specialized in AI is seeking an experienced software engineer to evaluate LLM-generated responses and conduct rigorous fact-checking.The ideal candidate holds a BS, MS, or PhD in Com... Show more

 • Promoted

AI/ML Research Developer – Interaction Lab

HuaweiMarkham, York Region, CA
Full-time

Join as an AI/ML Research Developer to innovate human-machine interactions.Prototype cutting-edge AI models enhancing smart devices with a focus on user-centered design.This position entails workin... Show more

 • Promoted

Multimodal Interaction Systems Principal Researcher

Huawei CanadaMarkham, York Region, CA
Full-time

Lead the way as a Senior Principal Researcher focused on multimodal interaction systems.Utilize your expertise in AI and human-computer interaction to craft innovative user experiences.In this infl... Show more

 • Promoted

Principal Machine Learning Engineer, Evaluation

Autodesk, Inc.Toronto, ON, CA
Full-time

WD96327, Principal Machine Learning Engineer, Evaluation***French translation to follow!/Traduction française à suivre!** Design and run evaluation protocols (datasets, metrics, statistical analysi... Show more

 • Promoted

Senior Research Engineer, Generative AI & Vision Models

IdeogramToronto, ON, CA
Full-time

A leading design technology company in Toronto is seeking a Machine Learning Engineer to develop and optimize post-training pipelines for their innovative text-to-image models.The ideal candidate w... Show more

 • Promoted

AI Research Engineer — Agentic Systems for Quantum R&D

XanaduToronto, ON, CA
Full-time

A leading quantum computing firm in Toronto seeks an AI Specialist to integrate AI technologies into R&D processes.The role involves designing AI systems to enhance research efforts, collaborating ... Show more