Design Evaluation Expert - Graphic
$80 - $150 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Design Expert
Type: Contract
Compensation: $80–$150/hour
Location: Remote
Role Responsibilities
- Design precise, task-specific grading criteria for real-world design deliverables such as brand identity systems and guidelines, campaign visuals, and packaging concepts.
- Score AI-generated and human work samples against established criteria, providing detailed written justifications for each score.
- Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
- Incorporate structured feedback from senior reviewers and iterate quickly on your work.
- Collaborate asynchronously and work independently to meet deadlines and improve AI model performance .
Qualifications
Must-Have
- 5+ years of professional experience in graphic, brand, or visual design.
- Background at world-class design studios or creative agencies, or in senior design roles at leading consumer or technology brands.
- Deep fluency in typography, layout, visual hierarchy, color, composition, and brand systems.
- Exceptionally strong written communication skills.
- Detail-oriented and consistent, with comfort in having your judgment reviewed.
Preferred
- Prior experience with AI training , evaluation, or human-data projects.
Application Process (Takes 20–30 mins to complete)
- Submit your resume, portfolio, or relevant professional background to get started.
- Qualified applicants may be asked to complete a brief assessment or submit additional information.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Design Evaluation Expert - Graphic in Toronto, ON vacancy
$80 - $150 per hour
...Jack Dorsey . Position: UI / UX Design Expert Type: Contract Compensation... ...independently and asynchronously to evaluate and improve AI model performance .... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...SuggestedRemote jobContract workSummer work$15 - $55 per hour
...Job Title: Graphic Designer Job Overview Royal Tent is a leader in premium tent engineering, delivering products renowned for their... ...portfolio that showcases your design skills and creativity. Expert proficiency with the Adobe Creative Suite, particularly InDesign...SuggestedHourly payFull time$100 - $150 per hour
...Position: Sales Engineering Expert Type: Contract... ...Role Responsibilities Design precise, task-specific grading... ...supporting proofs of concept, and evaluating product fit and technical... ...experience with AI training , evaluation, or human-data projects....SuggestedRemote jobContract workSummer work$100 - $150 per hour
...Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation... ...Remote Role Responsibilities Design precise, task-specific grading criteria... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...SuggestedRemote jobContract workSummer work$70k - $110k per year
...A Jacobs Senior Graphic Designer is a proactive team player, excited and ready to engage on a multitude... ...process, principles, and production techniques. This role requires expert technical skills and expertise in developing and executing creative...SuggestedWork at officeRemote workFlexible hoursWeekend work$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Cybersecurity / IT GRC Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
.... Position: Investor materials / fundraising / pitchbook Evaluator Type: Contract Compensation: $80–$120/hour... ...asynchronously to meet deadlines while ensuring high-quality evaluations. Qualifications Must-Have ~5+ years of relevant...Remote jobContract workSummer workWork at office$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
...General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role Responsibilities Evaluate AI...Full timeContract workSummer workWork at officeRemote work$14 per hour
...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract Compensation: $14/... ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other standards...Remote jobContract workSummer workImmediate start$120 - $170 per hour
...Jack Dorsey . Position: Data Science Expert Type: Contract... ...Remote Role Responsibilities Design precise, task-specific grading criteria for... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work- ...a play then you are in the right place. As one of our superstar Designers you ’ll partner with our Internal Creative Team and our external... ...hottest new startups too 🔥. But this isn’t your “typical” Motion Graphics role - we’re looking for video natives who can get stuck in...Full time
- ...physical and digital collateral, our team is there every step of the way, ensuring consistency in the FCR brand across the board. As Graphic Design & Content Coordinator you will be a key part of driving those initiatives forward, working closely with team to develop and...Full timeRemote workFlexible hours
$70k - $95k per year
...Description: We’re looking for a creative, curious, and ambitious designer who’s excited to make their mark in performance-driven... ...drive improvement of digital marketing KPIs. - Produce motion graphics and basic short-form video cutdowns optimized for social media advertising...Full timeWork at officeRemote workHome office$80 - $120 per hour
...and Jack Dorsey . Position: Training / onboarding / L&D Evaluator Type: Contract Compensation: $80–$120/hour... ...structured written feedback. Collaborate with subject matter experts to ensure consistency and quality. Work independently and...Remote jobContract workSummer workWork at office$70 - $80 per hour
...include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Design Expert Type: Contract Compensation: $70–$80/hour Location: Remote Role Responsibilities...Remote jobContract workSummer work$60 - $70 per hour
...Summers , and Jack Dorsey . Position: Higher Education Expert Type: Contract Compensation: $60–$70/hour... ...Construct higher education scenarios for curriculum and program design, faculty senate or accreditation review, and budget or enrollment...Remote jobContract workSummer work- ...20-Aug-2026 Reporting to the Manager, Evaluation and Quality Improvement, the Program Evaluator... ...program evaluators within the division ~Designs and tests evaluation and applied research... ..., senior management and technical experts. ~Credentialed Evaluator designation, is...Hourly payFull timeTemporary workPart timeInternshipMonday to friday
$68k - $72k per year
...a new position of Manager, Planning and Evaluation. This is a full-time position working 35... ...~ Demonstrates organizational impact by designing, implementing, and continuously improving... ...organizational planning processes, including workflow design, tracking, and reporting. ~ Has...Full timeInternshipWork at officeFlexible hoursWeekend work- ...agentic systems as a core part of how they design, build, debug, and ship. Not as a side... ...seeking a passionate and resilient Principal Graphics Engineer to own a foundational piece of... ...Experience building, fine-tuning, or evaluating internal AI/agent tooling that augments engineering...Internship
$105k - $145k per year
...Level: Mid-Senior Graphics Programmer Location: on-site/hybrid From dodgeball in the streets to racetracks in your living room, we've always been more interested in asking "what if?" than following a roadmap. Whether we're dreaming up a chaotic game of hide & seek...Full timeFlexible hoursNight shift$14 per hour
...Jack Dorsey . Position: Music Audio Expert - Punjabi Type: Contract... ...hours/week Role Responsibilities Evaluate AI model output for lyrics and voice generation... ...performance. Develop and refine evaluation standards for AI-generated music ....Remote jobContract workSummer workImmediate start$122k - $192k per year
...Innovations is looking for an experienced DSM Evaluation Manager to join our expanding team. In... ...process evaluations by supporting study design, developing research instruments,... ...evaluation of energy efficiency programs. ~ Expert level understanding of building systems,...Full timeInternshipWork at officeLocal area$70 - $100 per hour
...Larry Summers , and Jack Dorsey . Position: Office-Suite Experts Type: Contract Compensation: $70–$100/hour... ...Commitment: 10–20+ hours/week Role Responsibilities Evaluate and compare AI-generated office artifacts in Excel , Word...Remote jobContract workSummer workWork at officeImmediate start$100 - $150 per hour
...Remote Role Responsibilities Design precise, task-specific grading criteria for... ..., and A/B test write-ups . Evaluate AI-generated or human-created work against... ...Provide detailed written justifications for evaluations and scores to maintain transparency and...Remote jobContract workSummer work$80k - $180k per year
...institutions modernize how critical work is designed, governed, and delivered. Our technology... .... What’s the Opportunity? The AI Evaluation Engineer ensures AI agent solutions are accurate... ...System) delivery lifecycle, the role designs, executes, and leads evaluation...Full time$130 - $180 per hour
..., Larry Summers , and Jack Dorsey . Position: Medical Expert Type: Contract Compensation: $130–$180/hour... ...Commitment: 20+ hours/week Role Responsibilities Design clinically realistic prompts and scenarios from your specialty, including...Remote jobWeekly payContract workSummer workWork at office$80 - $120 per hour
...Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: General Sales / GTM Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role Responsibilities Evaluate...Full timeContract workSummer workWork at officeRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Design Evaluation Expert - Graphic. Be the first to apply!
Related searches
- expert batiment Toronto, ON
- expert automobile Toronto, ON
- entry level graphic designer Toronto, ON
- freelance graphic designer Toronto, ON
- commercial interior designer Toronto, ON
- graphic design assistant Toronto, ON
- full-time, temporary graphic designer Toronto, ON
- intern graphic design summer Toronto, ON
- infographiste print Toronto, ON
- part time graphic designer Toronto, ON