Talent.com
RemoteJobsOne
Evaluation Specialist/Recent GradRemoteJobsOne • Toronto, Canada
Evaluation Specialist/Recent Grad

Evaluation Specialist/Recent Grad

RemoteJobsOne • Toronto, Canada
1 day ago
Salary
CA$20.00–CA$60.00 hourly
Job type
  • Full-time
  • Remote
  • Quick Apply
Job description

IMPORTANT: after you apply, please check your email. We send you a link to complete your application — it is not considered until that last step is done. If you do not see it, check your spam folder.

This is a fully remote position, open to candidates based in Canada.

Pay: $20–$60/hr

Role Title: Evaluation Specialist/Recent Grad

Role Type: Contractor

Location: Remote

We are engaging Evaluation Specialists/Recent Grads to contribute to a high-impact project for a customer at the frontier of artificial intelligence. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.

Scope of Work

  1. Develop original, challenging question-and-answer pairs that test the limits of advanced AI models across diverse subjects.
  2. Conduct in-depth research, applying rigorous source triangulation to ensure each answer is accurate, comprehensive, and well-documented.
  3. Create multi-step questions that require synthesis and analytical reasoning — not just single-source lookups.
  4. Test your questions against AI models, analyze outcomes, and iterate to increase or adjust difficulty as needed.
  5. Document your research process, providing clear citations and logical explanations for each answer.
  6. Refine content based on reviewer input and maintain alignment with project guidelines and quality standards.

Preferred Qualifications

  1. Proven ability to conduct thorough, independent research and critically evaluate information from multiple sources.
  2. Exceptional attention to detail and written precision in English (fluency required, but it does not need to be your first language).
  3. Talent for crafting nuanced and well-structured questions that probe deep understanding.
  4. Strong self-direction, reliability, and accountability in remote, independent project work.
  5. Interest in cutting-edge AI and a passion for testing the boundaries of current model capabilities.
  6. Prior experience in AI training, evaluation, or content creation is a plus, but not required.
  7. Open to recent graduates, advanced-degree holders, and individuals from any academic or professional background with demonstrated research and writing expertise.

Compensation Structure

Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.

Start Timeline & Availability

We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding.

How to apply

Apply here with your profile. We will then email you a link to complete your application on the hiring platform — your application is only considered once that final step is done.

Create a job alert for this search

Evaluation Specialist/Recent Grad • Toronto, Canada

Similar jobs

Remote Chemistry Specialist — AI Content QA & Evaluation

Crossing HurdlesToronto, ON, CA
Remote
Full-time

A recruitment firm is seeking a Chemistry Expert to review and verify AI-generated content and develop chemistry problems.This remote role requires an advanced degree and strong analytical skills.T... Show more

 • Promoted

Equity Research Specialist - Fully Remote | Upto $120/hr

ObsidianToronto
Remote
Full-time

Have at least 2 years of experience working at top firms in equity research and hands‑on experience with analyzing and extracting info from public SEC filings.You must be able to commit at least 10... Show more

 • Promoted • New!

Finance Quality Control & Advisor Support Specialist

ONVIGOMarkham
Full-time +1

Finance Quality Control & Advisor Support Specialist (Part-Time, Hybrid).Hybrid, Home-based | Markham Office.Onvigo is a Canadian owned and operated host agency with a twist.Not only are we dedicat... Show more

 • Promoted • New!

Implementation Specialist, Metricsfirst - C$65,000 - C$75,000 A Year

Jonas Club SoftwareEast York, Canada
Full-time

This role involves leading new clients through the launch of an analytics platform for private clubs, focusing on project management, data accuracy, and client relationship building. Show more

 • Promoted

RLHF Evaluation Specialist for AI Training

Rex.zoneToronto, ON, CA
Full-time

A tech company specializing in AI is seeking an AI Trainer based in Canada.The role involves improving large language models through RLHF-style evaluations, prompt evaluation, and data labeling.Can... Show more

 • Promoted

Remote Math Specialist for AI Training & Evaluation

Crossing HurdlesToronto, ON, CA
Remote
Full-time

A referral company is seeking a Mathematics Specialist (Undergraduate/Master’s) to curate advanced mathematics problems for AI training.This remote role involves reviewing AI-generated solutions fo... Show more

 • Promoted

Employer Engagement and Partnership Specialist

Yorkville UniversityToronto, ON, CA
Full-time

Employer Engagement and Partnership Specialist.At Yorkville University and Toronto Film School, we believe education is more than the pursuit of knowledge – it is a catalyst for transformation.Our ... Show more

 • Promoted

Employer Relations & Practical Experience Evaluator

CPA OntarioToronto, ON, CA
Full-time

A professional accounting association in Toronto is seeking an Employer Relations Officer to evaluate CPA students' experience reports and build employer relationships.The role requires a CPA desig... Show more

 • Promoted

Economics AI Training & Evaluation Specialist

MindriftToronto, ON, CA
Part-time

A technology firm in Canada is seeking contributors for a flexible, project-based opportunity.Ideal candidates should have a strong academic background in Economics, excellent analytical skills, an... Show more

 • Promoted

DSM Evaluation Manager - EM&V

BuoyantToronto, ON, CA
Full-time

Impact Evaluation Manager to join our expanding team.In this role, you will provide technical support and project management services within the Advisory Services Group business unit, focusing on e... Show more

 • Promoted

Content Evaluator (Remote)

Work VistaToronto, ON, CA
Remote
Full-time

United States, United Kingdom, Canada, Ireland, Australia & New Zealand.You must be legally authorised to work in the country where you are based).We are hiring on behalf of one of our clients, a l... Show more

 • Promoted

Research Analyst, HR Research & Advisory Services

McLean & CompanyToronto, ON, CA
Full-time

The Research Analyst is part of a team that creates and delivers client-driven, project-based, practical research and advisory services to help HR leaders drive measurable results in their organiza... Show more

 • Promoted • New!

Bilingual Grants & Research Specialist (Canada)

Breakthrough T1D Canada | Percée DT1Toronto, ON, CA
Full-time

A leading non-profit organization in Canada is seeking a National Specialist for Research & Mental Health Programs.This bilingual role involves managing grants, analyzing data, and being a liaison ... Show more

 • Promoted

Evaluator for Ontario Driving Tests

SercoToronto, ON, CA
Full-time

Become a Driver Examiner with Serco Canada Inc.Ontario, where you'll evaluate driving skills and provide essential licensing services.This role is centered on commitment to customer support during ... Show more

 • Promoted

Digital Technical Specialist– Entry Level Sales Program 2026

LeadingtalentMarkham
Full-time

Technology sales at IBM is evolving its way of working to break beyond boundaries with innovative approaches.Preferring to show versus tell we are looking for recent graduates who want to combine t... Show more

 • Promoted • New!

Lead Dsm Research & Evaluation (Remote/Hybrid) - $74,500 - $110,000 A Year

Resource InnovationsToronto County, Canada
Remote
Full-time

Lead research and evaluation of energy efficiency programs, managing projects and mentoring staff. Show more

 • Promoted

Audit Specialist

Global Technical Talent, an Inc. 5000 CompanyToronto, ON, CA
Full-time

Senior Risk & Compliance Specialist, IT Risk Analyst, Internal Controls Specialist, Governance, Risk & Compliance (GRC) Analyst, Technology Risk Consultant.Location & Onsite Flexibility:.Toronto, O... Show more

 • Promoted

RQ08046 - Sr. Project Methodology Specialist - Agile Coach

Rubicon PathToronto, Ontario, Canada
Full-time

Project Methodology Specialist - Agile Coach.Office of the Registrar General in Ontario is responsible for the issuance of registrations and certificates for vital events (birth, marriage and death... Show more

 • Promoted

Advanced Quality Engineering Specialist

Magna-International-6df39721Newmarket, ON, CA
Permanent

Job descriptions may display in multiple languages based on your language selection.What we offer: At Magna, you can expect an engaging and dynamic environment where you can help to develop industr... Show more

 • Promoted

Client Implementation Specialist (2+ yrs exp. customer-facing, billing/revenue software req.)

#twiceasnice RecruitingToronto, Ontario, Canada
Full-time

Client Implementation Specialist (2+ yrs exp.Client Implementation Specialist (2+ yrs exp.Client Implementation Specialist (2+ yrs exp.Client Implementation Specialist (2+ yrs exp.Get AI-powered ad... Show more