Humanities Evaluator - Arts Specialist
$80 - $120 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Humanities / arts / culture Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents , spreadsheets , and slide decks .
- Provide clear, structured written feedback to improve AI model outputs .
- Work independently and asynchronously to ensure high-quality evaluations.
- Collaborate with AI research teams to enhance training data quality .
Qualifications
Must-Have
- 5+ years of relevant professional experience in Humanities / arts / culture .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 24 days ago
Similar jobs that could be interesting for youBased on the Humanities Evaluator - Arts Specialist in Toronto, ON vacancy
$41 per hour
...Summers , and Jack Dorsey . Position: Bilingual AI Response Evaluator Type: Full-time or Part-time Contract Work... ...reasoning errors or misleading information. Follow clear evaluation guidelines to ensure consistency. Qualifications Must...SuggestedFull timeContract workPart timeSummer workRemote work$15 - $20 per hour
...Role Responsibilities Conduct fact-checking using trusted public sources and external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies. Assess reasoning quality, clarity,...SuggestedFull timeContract workSummer workRemote work$45k - $95k per year
...VML is celebrated for its innovative and human first, award-winning work for blue chip client... ...& Optimization. In addition, VML’s specialist health network, VML Health, is one of the... ...growth. For more information, visit . AI Art Director / Creative Specialist Reports...SuggestedFull timeWork at office$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedFull timeContract workSummer workWork at officeRemote work$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: General Sales / GTM Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedFull timeContract workSummer workWork at officeRemote workFlexible hours$70k - $73.85k per year
...Posting will be closed on July 29, 2026 at 5:00 pm and this posting is for an existing vacancy. Objective: The Research and Evaluation Specialist will lead the analysis and development of sector-based program and policy research and evaluation that will enhance Friendship...Full timeInternship$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Full timeContract workSummer workWork at officeRemote work$80 - $150 per hour
..., and Jack Dorsey . Position: MS Excel / Google Sheets Evaluator Type: Contract Compensation: $80–$150/hour... ...relevance. Provide structured feedback to enhance document evaluation processes. Utilize MS Excel and Google Slides to perform...Full timeContract workSummer workRemote work$90 per hour
...impact. ~ Professional written English for task justification. Preferred Prior RLHF , preference-labeling, model-evaluation, or structured code-review work. Pixel-perfect design-to-code experience. Accessibility expertise ( ARIA , semantic...Full timeContract workSummer workLocal areaRemote work$78.75k - $122.35k per year
...improvements, leverage technology solutions, and support strategic HR initiatives. What You Bring to the Table ~3-6 years of progressive Human Resources experience supporting multiple HR disciplines. ~ Demonstrated experience in talent acquisition, employee experience,...Full timeWork at office$75k - $85k per year
...education, we’d love to hear from you! We are looking for a HR Specialist to join our growing team. This role will play an important role... .... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans....Full timeWork at officeRemote workFlexible hours$70 - $100 per hour
...Compensation: $70–$100/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities Evaluate AI-generated office artifacts in Excel , Word , and PowerPoint formats. Perform side-by-side comparisons of two candidate...Full timeContract workSummer workWork at officeImmediate startRemote work$14 - $42 per hour
...Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate against detailed quality standards. Compare AI-generated lyrics with published songs...Full timeContract workSummer workImmediate startRemote work$25 - $45 per hour
...25–$45/hour Location: Remote Role Responsibilities Evaluate AI-generated written conversations using predefined rubrics to enhance performance. Draft and refine evaluation rubrics for generalist writing tasks. Apply structured scoring...Full timeContract workSummer workRemote work$73 per hour
...Larry Summers , and Jack Dorsey . Position: Chemistry AI Evaluator Type: Contract Compensation: $73/hour... ...of explanations for different audiences. Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed...Full timeContract workSummer workRemote work$25 - $35 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Model Evaluation Contractor Type: Contract Compensation: $25–$35/hour Commitment: 20 hours/week Role Responsibilities...Full timeContract workFor contractorsSummer work$45 - $65 per hour
...Project-based Role Responsibilities Review and evaluate AI-generated outputs related to job descriptions, compensation... ...Collaborate asynchronously with research teams to refine evaluation frameworks for HR-domain AI . Qualifications Must-Have...Full timeContract workSummer work$80k per year
...As a Program Specialist, you will help shape the future of K–12 learning by designing innovative, research-informed, and classroom-relevant... ...understanding of the student developmental trajectories in ELA/Humanities, a passion for teaching and learning, and curiosity about how...Long term contractFull timeTemporary workSummer workWork at officeLocal areaRemote workFlexible hours$120 - $170 per hour
...dashboards, and experiment readouts. Score AI-generated and human work samples against established criteria with detailed, well-... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobContract workSummer work$70 - $100 per hour
...Compensation: $70–$100/hour Location: Remote Commitment: 10–20+ hours/week Role Responsibilities Evaluate AI-generated office artifacts across Excel , Word , and PowerPoint formats. Perform pairwise comparisons of candidate responses...Remote jobContract workSummer workWork at officeImmediate start- ...’re ready to make a real impact and help us transform professional education, we’d love to hear from you! We are looking for a HR Specialist to join our growing team. This role will play an important role in supporting the employee experience, working on people programs and...Permanent employmentFull timeWork at office
$70 - $100 per hour
...PowerPoint (.pptx) formats. Perform side-by-side pairwise comparisons of two candidate responses and select the stronger one. Evaluate both the content and rendering of each document—layout, formatting, visual structure, formulas, and overall presentation against the...Remote jobContract workSummer workWork at officeImmediate start$70 - $100 per hour
...Compensation: $70–$100/hour Location: Remote Commitment: 10–20+ hours/week Role Responsibilities Evaluate and compare AI-generated office artifacts in Excel , Word , and PowerPoint formats. Perform side-by-side comparisons of...Remote jobContract workSummer workWork at officeImmediate start$95k - $145k per year
...to nurturing talent across every level of the art department we’d like to talk to you! Velan Studios is looking for a Specialist or Principal level Artist to fill a role as the... ...with production needs. Partnering with Human Resources and Production to foresee hiring needs...Long term contractFull timeInternshipNight shift3 days per week$70k - $73.85k per year
...timely setup of required equipment for new employees. Delivers Human Resources orientation sessions and ensures completion of pre-... ...objectives, including organizing review cycles, tracking completion of evaluations, and supporting the performance improvement process. HR...Full timeContract workInternshipWork at office$115k - $135k per year
...Role Overview Clipwire Games is growing and looking for an Art Director to help shape the visual direction of current and future... ...to screen applications or make hiring decisions. All candidate evaluations and hiring decisions are made by people. This opening is for...Full timeWork at office2 days per week- ...consumer responses, and drive conversion. ABOUT THE ROLE The Art Director plays a key role in creating work that builds brands and... ...every LPi Group team member to think like an agency owner, evaluating outcomes based on three decision-making metrics: impact on the client...Full timeWork at officeMonday to friday2 days per week3 days per week
$55k - $65k per year
...Job description LG2 Toronto is looking for a Mid-Level (Intermediate) Art Director to join our team. This is an opportunity to step into a fast-moving, creatively ambitious environment with exposure to a diverse portfolio of clients - including the chance to work on...Full timeInternship$90k - $120k per year
...us know in your application. About the role The Senior Art Director will be responsible for the conception and design of integrated... .... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If...Long term contractFull timeSummer workFreelanceInternshipWork at officeImmediate startRemote workWork from homeFlexible hours1 day per week$45k - $95k per year
...benefit from shared resources and strategic direction that help us unlock new opportunities across the globe. POSITION OVERVIEW As an Art Director, you will work closely with a Copywriter to develop bold, strategic ideas deployed seamlessly across all channels. Reporting...Full timeInternshipWork at officeImmediate startWeekend work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Humanities Evaluator - Arts Specialist. Be the first to apply!
Related searches
- admissions evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- test evaluator Toronto, ON
- estimateur automobile Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur en bâtiment Toronto, ON
- chargé de projet estimateur Toronto, ON
- estimateur structure Toronto, ON
- crisis intervention specialist Toronto, ON
- leasing specialist Toronto, ON