Talent.com
Mercor
Design Evaluation Expert - GraphicMercor • Toronto, Ontario, Canada
Design Evaluation Expert - Graphic

Design Evaluation Expert - Graphic

Mercor • Toronto, Ontario, Canada
9 days ago
Job type
  • Part-time
  • Remote
  • Quick Apply
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Design Expert
Type: Contract
Compensation: $80–$150/hour
Location: Remote

Role Responsibilities

  • Design precise, task-specific grading criteria for real-world design deliverables such as brand identity systems and guidelines, campaign visuals, and packaging concepts.
  • Score AI-generated and human work samples against established criteria, providing detailed written justifications for each score.
  • Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
  • Incorporate structured feedback from senior reviewers and iterate quickly on your work.
  • Collaborate asynchronously and work independently to meet deadlines and improve AI model performance.

Qualifications

Must-Have

  • 5+ years of professional experience in graphic, brand, or visual design.
  • Background at world-class design studios or creative agencies, or in senior design roles at leading consumer or technology brands.
  • Deep fluency in typography, layout, visual hierarchy, color, composition, and brand systems.
  • Exceptionally strong written communication skills.
  • Detail-oriented and consistent, with comfort in having your judgment reviewed.

Preferred

  • Prior experience with AI training, evaluation, or human-data projects.

Application Process (Takes 20–30 mins to complete)

  • Submit your resume, portfolio, or relevant professional background to get started.
  • Qualified applicants may be asked to complete a brief assessment or submit additional information.

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Create a job alert for this search

Design Evaluation Expert - Graphic • Toronto, Ontario, Canada

Similar jobs

UX Design Expert for AI Research

ObsidianToronto, ON, CA
Full-time

Mercor is inviting applications for UX Design Experts to contribute to a pivotal AI research project.Harness your expertise in product design and user journeys to shape innovative solutions for a l... Show more

 • Promoted

Customer-Focused Design Sales Expert

Pottery Barn KidsToronto, ON, CA
Full-time

Become a Design Sales Specialist with Williams-Sonoma, shaping how customers express themselves in their homes.This position focuses on sales and design through consultations at the store and in cl... Show more

 • Promoted

Relay Design Engineer: Focus on Quality

Relaytoronto, on, Canada
Full-time

Become a Design Engineer at Relay, leading the charge on front-end quality and user interaction.Your role will be vital in enhancing product usability!.As part of Relay's dynamic design engineering... Show more

 • Promoted

Senior Specialist, Visual & Data Design

MastercardToronto, ON, CA
Full-time

Mastercard powers economies and empowers people in 200+ countries and territories worldwide.Together with our customers, we’re helping build a sustainable economy where everyone can prosper.We supp... Show more

 • Promoted

Senior Service Design Lead: Research & Blueprints

Rubicon PathToronto
Full-time

A leading Canadian technology firm is seeking a Senior UX Designer with over 6 years of experience in service design.This role involves conducting user research, facilitating stakeholder workshops,... Show more

 • Promoted

Technical Advisor/Senior Design Manager

AECOMThornhill
Full-time

Primary Location: CA - Markham, ON - 105 Commerce Vall.Compensation: CAD 145000 - CAD 185000 - yearly.At AECOM, we're delivering a better world.Whether improving your commute, keeping the lights on... Show more

 • Promoted

Ebay Director Of Design Strategy

eBayToronto, Canada
Full-time

Join eBay as Director of Design Strategy, where you will enhance team performance and drive impactful user experiences.Your leadership will cultivate high-quality design standards globally.In this ... Show more

 • Promoted

Scotiabank UX Design Team Lead

ScotiabankToronto, ON, CA
Full-time

Elevate user experiences as the UX Design Team Lead at Scotiabank, Toronto.Employ your design expertise to enhance digital customer interactions in banking.We're seeking a skilled UX Design Team Le... Show more

 • Promoted

Remote AI Evaluation Scenario Designer

MindriftToronto, ON, CA
Remote
Full-time

A leading AI solutions company is looking for an expert to design and evaluate test scenarios for AI agents.The ideal candidate will have a Bachelor's or Master's degree in a relevant field, experi... Show more

 • Promoted

UX Design Expert with AI Focus

MediumToronto
Full-time

Caseware is seeking a Senior UX Designer to innovate user experiences for its cloud-based audit products, leveraging your AI design skills in a hybrid work environment.Join a forward-thinking team ... Show more

 • Promoted

Product Design Lead — Strategy, UX & Impact

Creative CircleToronto, Ontario, Canada
Full-time

Sign in to set job alerts for “Creative Circle” roles.Creative Circle Jobs in United States.Brand Manager Associate -Beauty Industry- CPG.Brand Product Marketing Manager - Haircare, Beauty, R&D.Gra... Show more

 • Promoted

Experience Design Associate (Facilitation and Training)

LaridaeToronto, ON, CA
Full-time

This is a behind-the-scenes enablement role focused on drafting and refining materials, supporting delivery readiness, and ensuring strong preparation and follow-through so facilitators can deliver... Show more

 • Promoted

Senior Design Specialist - Strategic Projects

TELUSToronto, ON, CA
Full-time

OUR TEAM AND WHAT WE'LL ACCOMPLISH TOGETHER.The Strategic Projects team is at the forefront of TELUS's network evolution, delivering transformational initiatives that will reshape how we connect Ca... Show more

 • Promoted

User Research Expert - Evaluator

MercorToronto, Ontario, Canada
CA$80.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.User/customer research and feedback synthesis Evaluator.Evaluate AI-generated artifacts against domain-specific quality rubrics.Identify factua... Show more

DEI Learning Experience Designer

BloomToronto, ON, CA
Full-time

Transform workplace learning as a DEI Learning Experience Designer.Facilitate engaging sessions that explore complex dynamics, driving leadership and accountability in both remote and in-person env... Show more

 • Promoted

Designers, Open Application

DeptToronto, ON, CA
Full-time

Please note, this is a talent pool position, not a live role.If you would like to be considered for any future Design positions at DEPT®, please submit an application and we will be in touch when a... Show more

 • Promoted

Generative AI Implementation Expert

SiaToronto, Ontario, Canada
Full-time

Drive the future of AI solutions as a Generative AI Implementation Expert.Utilize your skills to design and optimize generative AI systems for widespread impact across various industries.You will p... Show more

 • Promoted

Lead Design Researcher

AquentToronto, ON, CA
Full-time

Design Research Strategy (30%).Strategic Advisory: Direct discussions with Design and cross-functional teams regarding overarching research strategies.Provide expert recommendations and contribute ... Show more

 • Promoted

Expert UX Designer with Stakeholder Engagement Skills

DawninfotekToronto, ON, CA
Full-time

Join as a Senior UX Designer, focusing on user research and innovative service design.Lead projects that significantly enhance user experience across diverse platforms.In this senior role, you will... Show more

 • Promoted

Design Career Opportunities at DEPT®

DeptToronto, ON, CA
Full-time

Explore DEPT®’s future Designer openings as we build our talent pool for innovative design professionals.Contribute to creative projects that drive results for major clients.We welcome Designers of... Show more