Talent.com
Luma
Multimodal AI Evaluation Research EngineerLuma • Winnipeg, Canada
No longer accepting applications
Multimodal AI Evaluation Research Engineer

Multimodal AI Evaluation Research Engineer

Luma • Winnipeg, Canada
5 days ago
Job type
  • Full-time
Job description
Expand your career with Luma AI as a Research Engineer specializing in multimodal AI evaluations. This role focuses on creating scalable evaluation infrastructures for generative models across various mediums.

In this innovative position at Luma AI, you will design automated systems that meticulously evaluate the performance of visual and multimodal models. By working closely with research and engineering teams, you’ll ensure our model outputs meet rigorous evaluation standards, which is crucial for enhancing model capabilities in generative AI.

Key Responsibilities: • Design automated evaluation pipelines for multimodal outputs • Develop metrics focusing on coherence and temporal consistency • Implement integration of evaluation signals in model training • Build large-scale regression testing infrastructure • Collaborate on automated human study translations

Requirements: • Master’s or PhD in Computer Science or similar fields • Minimum 5 years in ML evaluation system development • Practical experience with visual data handling • Proficient in Python and related ML frameworks • Understanding of human-in-the-loop processes

Contribute to groundbreaking research in generative AI model evaluation with Luma AI. #J-18808-Ljbffr
Create a job alert for this search

Multimodal AI Evaluation Research Engineer • Winnipeg, Canada

Similar jobs

Multilang Code & Ai Model Evaluator

Mercor AiWinnipeg, Canada
Full-time

A tech company specialized in AI is seeking an experienced software engineer to evaluate LLM-generated responses and conduct rigorous fact-checking.The ideal candidate holds a BS, MS, or PhD in Com... Show more

 • Promoted

Director of AI

People In AIwinnipeg, mb, ca
Full-time

Director, AI / ML (Applied AI & Agentic Systems).A scaled, product-led technology company operating at the intersection of data, AI, and vertical SaaS—focused on transforming how complex, real-worl... Show more

 • Promoted

Expert Ml Research Engineer For Transformative Ai Solutions

SandboxAQWinnipeg, Canada
Full-time

Drive innovative AI solutions in drug discovery as a Staff ML Research Engineer.Spearhead the transition from theoretical research models to practical applications in the biopharma space.In this in... Show more

 • Promoted

AI Enablement Advocate & Developer Evangelist (Hybrid)

BDO CanadaWinnipeg, MB, CA
Full-time

A leading accounting firm in Canada is looking for a Developer Advocate to bridge AI Studio and Service Line Labs.This hybrid role involves promoting responsible AI practices, leading workshops, an... Show more

 • Promoted

Innovation Engineer: Applied Ai & Emerging Tech

Envisio Solutions Inc.Winnipeg, Canada
Full-time

A technology solutions provider is looking for an Innovation Engineer to explore emerging technologies and create practical solutions.The role emphasizes rapid prototyping and applied problem-solvi... Show more

 • Promoted

Advanced Machine Learning Postdoctoral Fellow

University of ManitobaWinnipeg, MB, CA
Full-time

Elevate digital agriculture research as a Postdoctoral Fellow in machine learning and computer vision.Spearhead model development and tackle segmentation and detection problems in agricultural sett... Show more

 • Promoted

AI Model Evaluation Analyst

Workerbeewinnipeg, mb, ca
Permanent

No C2C or third-party submissions.Workerbee connects workers with employers through trusted introductions.By joining Workerbee you can be matched for project-based, contract, or permanent opportuni... Show more

 • Promoted

Applied AI Engineer - Quantum Applications

Photonic Inc.Winnipeg, Manitoba, Canada
Full-time

Join Photonic as an Applied AI Software Engineer and revolutionize quantum computing with AI solutions.This remote role allows you to apply your expertise in Machine Learning and Deep Learning for ... Show more

 • Promoted

Machine Learning Researcher | Remote

Crossing HurdlesWinnipeg, Manitoba, Canada
Remote
Full-time

Lead and conduct cutting-edge research in machine learning and artificial intelligence domains.Design, implement, and evaluate state-of-the-art deep learning algorithms using frameworks such as Ten... Show more

 • Promoted

Ai Engineer Position Focusing On Llm And Multi-Agent Systems

iVedha Inc.Winnipeg, Canada
Full-time

Step into the role of AI Engineer, where you'll lead the design and operationalization of advanced LLM systems in the financial sector.Your skills in AI engineering and comprehensive system rel... Show more

 • Promoted

Remote Ml Research Fellow - Generative Ai & Pytorch

Scale AIWinnipeg, Canada
Remote
Full-time

A leading AI company in Canada seeks candidates for the Human Frontier Collective Fellowship.This fully remote position allows fellows to collaborate on high-impact AI projects and gain exposure to... Show more

 • Promoted

Generative AI Developer – Retail/CPG Domain

Comprehensive Resources Incwinnipeg, mb, ca
Full-time

Generative AI Developer (Retail/CPG).Seeking a GenAI Developer with expertise in LLMs, RAG, and prompt engineering.Build scalable AI solutions using Python, LangChain, HuggingFace, and vector DBs l... Show more

 • Promoted

AI Model Evaluation Analyst - Workerbee

Workerbeewinnipeg, mb, ca
Permanent

No C2C or third-party submissions.Workerbee connects workers with employers through trusted introductions.By joining Workerbee you can be matched for project-based, contract, or permanent opportuni... Show more

 • Promoted

Agentic Rl Researcher - Distributed Ai Systems

360DxWinnipeg, Canada
Full-time

AI Computing Researcher focused on optimizing AI systems for large model training/inference on Ascend platform, involving low-precision training, multimodal optimization, and reinforcement learning. Show more

 • Promoted • New!

Ai Enablement Research Analyst

BC HousingWinnipeg, Canada
Full-time

Biomedical research analyst position at UHN in Toronto, Ontario.Responsibilities include managing animal purchasing, compliance, and record-keeping in a full-time, permanent role. Show more

 • Promoted

Ai Research Engineer — Agentic Systems For Quantum R&D - C$120,000 - C$170,000 A Year

A Leading Technology FirmWinnipeg, Canada
Full-time

Conducting advanced AI research in generative AI and reinforcement learning, transitioning findings into production solutions.Collaboration with global teams is key. Show more

 • Promoted

Agentic Rl Researcher - Distributed Ai Systems - C$106,000 - C$156,000 A Year

360DxWinnipeg, Canada
Full-time

A global tech company in Canada is seeking a Student Researcher to collaborate on innovative research projects focused on developing real-world solutions.This opportunity is suitable for students p... Show more

 • Promoted • New!

Ai Implementation And Research Director

Info-Tech Research GroupWinnipeg, Canada
Full-time

Shape the future of applied AI by directing client engagements and system prototyping.This position melds hands-on delivery with innovative research to enhance AI applications.The AI Implementation... Show more

 • Promoted

Senior Machine Learning Engineer for AI Innovation

Insight GlobalWinnipeg, Manitoba, Canada
Full-time

Be part of a transformative team at Insight Global as a Senior Machine Learning Engineer, focusing on generative AI and personalized retail solutions.Impact millions of customer interactions every ... Show more

 • Promoted

Artificial Intelligence Researcher | Upto $75/Hr Hourly - Remote

MercorWinnipeg, Canada
Remote
Full-time

Author and review computer science questions, focusing on deep conceptual understanding.Provide detailed solutions and academic references. Show more