Talent.com
Lifted, an Upwork Company
Copy of LLM Model Response EvaluationLifted, an Upwork Company • Ottawa, Ontario, Canada
Copy of LLM Model Response Evaluation

Copy of LLM Model Response Evaluation

Lifted, an Upwork Company • Ottawa, Ontario, Canada
6 days ago
Job type
  • Full-time
  • Remote
Job description
Job Description

  • Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
  • The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
  • The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
  • Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
  • Each task will include detailed project guidelines within the evaluation platform.

Qualifications

  • 3+ years of hands-on experience in LLM / GenAI data evaluation.
  • Bachelor's Degree required
  • Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
  • Comfortable evaluating content across multiple modalities


Additional Information

Flexible and remote work
Variable workload: Accept or decline tasks based on your availability
No guaranteed hours: Workload may vary weekly

Create a job alert for this search

Copy of LLM Model Response Evaluation • Ottawa, Ontario, Canada

Similar jobs

Content Evaluator (Remote)

Work VistaOttawa, ON, CA
Remote
Full-time

United States, United Kingdom, Canada, Ireland, Australia & New Zealand.You must be legally authorised to work in the country where you are based).We are hiring on behalf of one of our clients, a l... Show more

 • Promoted

Remote Chemistry Expert (LLM Evaluation) - 34879

TuringOttawa, ON, CA
Remote
Full-time

Remote Chemistry Expert (LLM Evaluation) - 34879.Remote Chemistry Expert (LLM Evaluation) - 34879.Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.Turi... Show more

 • Promoted

Remote AI Engineer - LLM Specialist

PulsoraOttawa, ON, CA
Remote
Full-time

Discover an exciting career as a Remote AI Engineer specializing in Large Language Models.Play a key role in developing AI-driven software solutions in a fully remote setting.Your expertise in AI/M... Show more

 • Promoted

Senior Distributed Diffusion ML Engineer — Remote

Bagel LabsOttawa, ON, CA
Remote
Full-time

A leading machine learning research lab is looking for an expert in distributed systems to design scalable infrastructure for diffusion models.The ideal candidate will have substantial experience i... Show more

 • Promoted

Threat Modeling Analyst

nugget.aiOttawa, ON, CA
Full-time

The Threat Modeling Analyst is responsible for identifying threats and vulnerabilities across company systems and communicating the issues with the appropriate team – infrastructure, IT, risk, DLP,... Show more

 • Promoted

AI Inference Systems Reliability Lead

Cerebras Systems, Inc.ottawa, on, Canada
Full-time

Join Cerebras Systems as the AI Inference Systems Reliability Lead to build the most reliable AI service in the industry.Drive innovative strategies and implement critical reliability systems in a ... Show more

 • Promoted

Senior ML Engineer (Speech-to-Speech) — Remote SME

VosynOttawa, ON, CA
Remote
Full-time

Vosyn seeks a Senior ML Engineer SME to lead the development of cutting-edge speech-to-speech technology.This role involves providing strategic technical guidance on TTS models, collaborating with ... Show more

 • Promoted

Remote ML Research Fellow - Generative AI & PyTorch

Scale AIOttawa, ON, CA
Remote
Full-time

A leading AI company in Canada seeks candidates for the Human Frontier Collective Fellowship.This fully remote position allows fellows to collaborate on high-impact AI projects and gain exposure to... Show more

 • Promoted

Remote Math Specialist for AI Training & Evaluation

Crossing HurdlesOttawa, ON, CA
Remote
Full-time

A referral company is seeking a Mathematics Specialist (Undergraduate/Master’s) to curate advanced mathematics problems for AI training.This remote role involves reviewing AI-generated solutions fo... Show more

 • Promoted

Remote AI/ML Engineer - NLP & LLM Deployment (3+ yrs)

Veracity Software IncOttawa, ON, CA
Remote
Full-time

A technology consulting company is seeking an AI / ML Engineer or Data Scientist with over 3 years of experience in AI/ML development.The successful candidate will have a solid educational backgrou... Show more

 • Promoted

Remote AI & ML Developer — LLMs, RAG & APIs

OrganimiOttawa, ON, CA
Remote
Full-time

A leading B2B SaaS company is seeking an experienced AI / Machine Learning Developer to work on innovative AI models and systems.The candidate will train and deploy large language models and relate... Show more

 • Promoted

Senior ML Engineer — Remote, Real‑Time Ads Pipelines

StackAdaptOttawa, ON, CA
Remote
Full-time

A leading technology company is seeking Senior and Staff Machine Learning Engineers to join their Data Science team.You will be responsible for designing scalable data pipelines and implementing ML... Show more

 • Promoted

Analytics & ML Product Associate - Remote, Mentorship

Switch Growth Inc.Ottawa, ON, CA
Remote
Full-time

A leading analytics and AI startup in Toronto is seeking an Associate Product Manager to drive analytics and ML product development.The ideal candidate will have 1-2 years of experience in analytic... Show more

 • Promoted

Senior ML Inference Engineer — Model Efficiency

CohereOttawa, ON, CA
Full-time

A leading AI technology company is seeking a Member of Technical Staff to enhance model efficiency.This role involves improving performance metrics, optimizing bottlenecks, and collaborating with v... Show more

 • Promoted

RLHF Evaluation Specialist for AI Training

Rex.zoneOttawa, ON, CA
Full-time

A tech company specializing in AI is seeking an AI Trainer based in Canada.The role involves improving large language models through RLHF-style evaluations, prompt evaluation, and data labeling.Can... Show more

 • Promoted

ML Engineer (Speech-to-Speech) — Subject Matter Expert

VosynOttawa, ON, CA
Full-time

ML Engineer (Speech-to-Speech) — Subject Matter Expert.At Vosyn, we embrace the exciting, game-changing world of Artificial Intelligence, driving innovation and pioneering impactful projects across... Show more

 • Promoted

Content Evaluation Specialist (Remote)

Work VistaOttawa, ON, CA
Remote
Full-time

Content Evaluation Specialist (Remote).Remote within the United States, United Kingdom, Canada, Ireland, Australia & New Zealand (You must be legally authorised to work in the country where you are... Show more

 • Promoted

Principal MLOPs Engineer (Canada)

Rackspace TechnologyOttawa, ON, CA
Full-time

Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.We are looking for a seasoned Principal ML OPS Engineer to architect, build, and optimize ML inference... Show more

 • Promoted

Senior ML & Applied Science Lead - NLP/LLM & Agents

LoopioOttawa, ON, CA
Full-time

A leading technology company is seeking a Senior Manager of Machine Learning & Applied Science to lead advanced NLP and AI capabilities.The role involves hands-on applied science, technical leaders... Show more

 • Promoted

Machine Learning Engineer

Dew SoftwareOttawa, ON, CA
Full-time

Toronto, Canada Remote, and US remote.PyTorch, Huggingface transformers, Deep Learning, Spark/Hadoop, MLOps.Willing to contribute to team discussions and solutions; available for stand ups, core me... Show more