Design Evaluation Expert - Graphic

$80 - $150 per hour

Mercor

Remote job

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Design Expert

Type: Contract

Compensation: $80–$150/hour

Location: Remote

Role Responsibilities

Design precise, task-specific grading criteria for real-world design deliverables such as brand identity systems and guidelines, campaign visuals, and packaging concepts.
Score AI-generated and human work samples against established criteria, providing detailed written justifications for each score.
Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
Incorporate structured feedback from senior reviewers and iterate quickly on your work.
Collaborate asynchronously and work independently to meet deadlines and improve AI model performance .

Qualifications

Must-Have

5+ years of professional experience in graphic, brand, or visual design.
Background at world-class design studios or creative agencies, or in senior design roles at leading consumer or technology brands.
Deep fluency in typography, layout, visual hierarchy, color, composition, and brand systems.
Exceptionally strong written communication skills.
Detail-oriented and consistent, with comfort in having your judgment reviewed.

Preferred

Prior experience with AI training , evaluation, or human-data projects.

Application Process (Takes 20–30 mins to complete)

Submit your resume, portfolio, or relevant professional background to get started.
Qualified applicants may be asked to complete a brief assessment or submit additional information.

Resources & Support

For details about the interview process and platform information, please check:
For any help or support, reach out to: Show email

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 28 days ago

Similar jobs that could be interesting for youBased on the Design Evaluation Expert - Graphic in Toronto, ON vacancy

Graphic Designer
About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position...
Suggested
Full time
Contract work
Summer work
Mercor
Toronto, ON
23 hours ago
Graphic Designer / Illustrator
$70k - $90k per year
...towards this goal, we would love to hear from you! Role summary Reporting to the Director, Marketing Communications, the Graphic Designer will play a key role in helping Magnet Forensics scale its design and brand presence across digital channels. This role focuses...
Suggested
Full time
Work at office
Local area
Flexible hours
Shift work
Magnet Forensics
Toronto, ON
23 hours ago
Motion Graphics Designer (remote)
$50k - $80k per year
...the right place. As one of our superstar Designers you’ll partner with our Internal Creative... ...But this isn’t your “typical” Motion Graphics role - we’re looking for video natives who... ...to come up with fresh visual concepts and designs Advanced skills in After Effects and Premiere...
Suggested
Full time
Work at office
Remote work
Vidsy
Toronto, ON
23 hours ago
Sr. Graphic Designer
$35 - $45 per hour
...experience from SGS&Co and SGK, forming a powerhouse in packaging graphics, prepress, and print production. We offer a full suite of... ...footprint. Crafted Highlights : As the Sr. Graphic Designer in this 6âmonth contract role, you elevate Molson Coors’ creative...
Suggested
Hourly pay
Full time
Contract work
Work at office
Local area
Flexible hours
Propelis
Toronto, ON
23 hours ago
Graphic Designer / Production Designer - Remote
...eurOptimum is a leader in custom design and manufacturing of interior signage and display systems. We are known for creating innovative... ...academic and hospitality clientele. The role - Production Graphic Designer We welcome you to apply if you are a Production Graphic...
Suggested
Full time
Work at office
Remote work
Work from home
EurOptimum
Toronto, ON
23 hours ago
Business Operations Expert - Evaluator
$60 - $80 per hour
...Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type:... ...Provide structured feedback on the task itself and on the study design. Work independently to complete the task within a...
Hourly pay
Full time
Contract work
For contractors
Summer work
Remote work
Mercor
Toronto, ON
23 hours ago
Graphic Design Specialist - Fully Remote
$80 - $180 per hour
...Dorsey . Position: Professional Design Experts Type: Contract Compensation... .../week Role Responsibilities Evaluate product design decisions to align with... ...and taste preferences. Develop graphics, documents, and other files using Figma...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
23 hours ago
Sales Engineering Expert - Evaluator
$100 - $150 per hour
...Position: Sales Engineering Expert Type: Contract... ...Role Responsibilities Design precise, task-specific grading... ...supporting proofs of concept, and evaluating product fit and technical... ...experience with AI training , evaluation, or human-data projects....
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
23 hours ago
Graphic & Web Designer Contractor
...Modu Design Communications is interested in working with an intermediate print and digital freelance designer with 3+ years experience... ...production of print collateral for client projects including booth graphics, flyers, brochures, logos, business cards, and other types of...
Full time
For contractors
Freelance
Remote work
Modu Design
Toronto, ON
23 hours ago
Privacy Compliance Expert - Evaluator
$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
23 hours ago
GenAI Motion Graphics Designer
...the world’s first and only specialist in designing, building, and running bespoke in-house agencies... ...results. Role: GenAI Motion Designer Location: Remote - Toronto, Canada... ...comparison charts, promo assets, CRM/email graphics) Create clear, benefit-led layouts that...
Remote job
Full time
Internship
Local area
The Oliver Agency
Toronto, ON
23 hours ago
Data Quality Expert - Evaluator
$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data quality / CRM operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
23 hours ago
Customer Success Evaluator - Expert
$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Customer success / support operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
23 hours ago
Privacy Compliance Evaluator - Expert
$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...
Full time
Contract work
Summer work
Work at office
Remote work
Flexible hours
Mercor
Toronto, ON
23 hours ago
Legal Compliance Expert - Evaluator
$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
23 hours ago
Data Science Expert - Evaluation Specialist
$120 - $170 per hour
...Jack Dorsey . Position: Data Science Expert Type: Contract... ...Remote Role Responsibilities Design precise, task-specific grading criteria for... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
23 hours ago
Data Science Expert - AI Evaluation
$120 - $170 per hour
...Jack Dorsey . Position: Data Science Expert Type: Contract... ...Remote Role Responsibilities Design precise, task-specific grading criteria for... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
23 hours ago
Motion Graphics Designer (remote)
$70k - $95k per year
...Description: We’re looking for a creative, curious, and ambitious designer who’s excited to make their mark in performance-driven... ...drive improvement of digital marketing KPIs. Produce motion graphics and basic short-form video cutdowns optimized for social media advertising...
Remote job
Full time
Work at office
Home office
Directive Corporation
Toronto, ON
23 hours ago
Presentation Design Expert - PowerPoint
$50 - $60 per hour
...Larry Summers , and Jack Dorsey . Position: Visual Slide Design Expert (PowerPoint Aesthetics & Design) Type: Contract... ...consulting slides, or investor presentations . Background in graphic design, UI/UX, or branding . Familiarity with tools like...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
23 hours ago
Product Design Expert - Vibecoding
$70 - $80 per hour
...include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Design Expert Type: Contract Compensation: $70–$80/hour Location: Remote Role Responsibilities...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
23 hours ago
Senior Design Expert - UX Specialist
$150 per hour
..., Larry Summers , and Jack Dorsey . Position: Senior Design Expert - Paid AI Design Research Study Type: Contract... ...recorded remote sessions to capture expert design thinking. Evaluate design quality and critique to differentiate strong craft from...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
23 hours ago
AI Scenario Designer - Creative Expert
$30 - $80 per hour
...Summers , and Jack Dorsey . Position: AI Training Scenario Designer Type: Contract Compensation: $30–$80/hour... ...and prioritize effectively. Run the agent against scenarios, evaluate performance, and guide it to success through structured hints....
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
23 hours ago
Graphic Designer and Illustrator- Freelancer
...Responsible for the conceptualization and implementation of design concepts across all channels: Professional, Retail, and DTC Design... ...compelling visuals Qualifications: ~ Bachelor’s degree in graphic design, marketing, or related field preferred ~3-5 years of...
Full time
Freelance
Work at office
Local area
Worldwide
Weekend work
Afternoon shift
Dermalogica
Toronto, ON
23 hours ago
HUB-NU26-22 Illustrator and Graphic Designer- Canada Summer Jobs
$17.6 per hour
...service organizations, and Springboard staff, the HUB reaches thousands of participants annually across Canada. The Illustrator and Graphic Designer is an entry level digital artist, graphic designer and illustrator position that will be based in Springboard’s Community...
Permanent employment
Full time
Contract work
Summer work
Work at office
Immediate start
Remote work
Monday to friday
Shift work
Springboard
Toronto, ON
23 hours ago
UI/UX Design Expert - Evaluator
$80 - $150 per hour
...Jack Dorsey . Position: UI / UX Design Expert Type: Contract Compensation... ...independently and asynchronously to evaluate and improve AI model performance .... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...
Remote job
Contract work
Summer work
Mercor
Toronto, ON
20 days ago
Graphics Programmer
$105k - $145k per year
...Description Level: Mid-Senior Graphics Programmer Location: on-site/hybrid From dodgeball in the streets to racetracks in your living room, we've always been more interested in asking "what if?" than following a roadmap. Whether we're dreaming up a chaotic game...
Full time
Flexible hours
Night shift
Velan Studios, Inc.
Toronto, ON
23 hours ago
Need full time graphic designer
$15 - $55 per hour
...Job Title: Graphic Designer Job Overview Royal Tent is a leader in premium tent engineering, delivering products renowned for their... ...portfolio that showcases your design skills and creativity. Expert proficiency with the Adobe Creative Suite, particularly InDesign...
Hourly pay
Full time
Qureos Inc
Toronto, ON
7 days ago
Senior UX Designer
...Position: Senior UX Designer Location: Toronto, ON (Hybrid... ...methodologies ~ Degree or diploma in graphic design; or related education... ...Digital provides the IT Experts you need that solve problems and... ...with proven experts evaluated through our QMS (Quality Management...
Full time
Symbiotic Digital
Toronto, ON
23 hours ago
Motion Graphics Designer/Animator
$60k - $70k per year
...offering with 450+ subject matter experts spanning Digital, Video and... ...and digital assets shot, designed, developed and deployed by our... ...editor hybrid with an eye for design to help us create thumb-stopping... ...post-secondary certificate in Graphic Design Proficiency in Adobe Suite...
Full time
Publicis Groupe
Toronto, ON
5 days ago
Data Scientist - AI Evaluation
$100 - $150 per hour
...Remote Role Responsibilities Design precise, task-specific grading criteria for... ..., and A/B test write-ups . Evaluate AI-generated or human-created work against... ...Provide detailed written justifications for evaluations and scores to maintain transparency and...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
23 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Design Evaluation Expert - Graphic. Be the first to apply!