Video Evaluation Expert - Fully Remote | Upto $20/hr
$20 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Video Evaluation Generalist
Type: Contract
Compensation: $15–$20/hour
Location: Remote
Commitment: 20 hours/week
Role Responsibilities
- Evaluate paired video outputs by comparing two short video clips against a provided rubric for prompt adherence, motion quality, visual artifacts, and physical plausibility.
- Score and justify preferences by assigning rubric scores to each clip, selecting an overall preference, and documenting a brief written justification.
- Maintain scoring consistency across high task volumes, ensuring calibration to the rubric remains steady for reliable judgments.
- Work independently and meet deadlines in a structured project environment with clear goals and tools.
Qualifications
Must-Have
- BS or BA from a reputable institution completed or in progress.
- Strong writing and critical thinking skills.
- Ability to work independently and meet deadlines.
Preferred
- 2+ years of experience in teaching or research.
Application Process (Takes 20–30 mins to complete)
- Complete an AI-led interview, this should take around 15 minutes.
- If selected, you will be invited to work on the project.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Video Evaluation Expert - Fully Remote | Upto $20/hr in Toronto, ON vacancy
$20 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Video Evaluation Generalist Type: Contract Compensation: $15–$20/hour Location: Remote Commitment: 20 hours/week Role Responsibilities Evaluate...Remote jobVideoContract workSummer work$60 - $80 per hour
.... Position: Adobe Premiere Expert Type: Contract Compensation... ...$60–$80/hour Location: Remote Role Responsibilities Develop and execute video editing projects using Adobe... ...Application Process (Takes 20–30 mins to complete)...Remote workVideoFull timeContract workSummer workMercor
Toronto, ON20 hours ago$80 - $160 per hour
...Compensation: $80–$160/hour Location: Remote Role Responsibilities Review... ...skills to contribute to high-impact evaluation projects. Collaborate with teams to improve... ...Canada Application Process (Takes 20–30 mins to complete) Upload resume...Remote workFull timeContract workSummer workMercor
Toronto, ON20 hours ago$80 - $120 per hour
...Procurement / vendor management Evaluator Type: Contract... ...$120/hour Location: Remote Role Responsibilities... ...deadlines while ensuring high-quality evaluations. Qualifications Must... ...Application Process (Takes 20–30 mins to complete) Upload...Remote workFull timeContract workSummer workWork at officeMercor
Toronto, ON20 hours ago$20 - $25 per hour
...Position: AI Data Generalist — Egocentric Video Review Type: Contract Compensation: $20–$25/hour Location: Remote Duration: Approximately 2 weeks... ...structured quality-review tasks. Evaluate action segments within videos for accurate...Remote workVideoFull timeContract workSummer workDay shiftMercor
Toronto, ON20 hours ago$120 per hour
...Position: Real estate / hospitality / events Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... .... Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer workWork at office$42 per hour
...Dorsey . Position: Music & Lyrics Expert - Hebrew Type: Contract... ...$17–$42/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres...Remote jobContract workSummer workImmediate start- ...Jack Dorsey . Position: Free Video Editing For Small Businesses and Creators... ...: $1–$2/hour Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-... ...footage. Application Process (Takes 20–30 mins to complete) Upload...Remote jobVideoContract workSummer work
$160 per hour
...Compensation: $80–$160/hour Location: Remote Role Responsibilities Review... .... Collaborate with teams to improve evaluation processes and methodologies. Work... ...Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$160 per hour
...Compensation: $80–$160/hour Location: Remote Role Responsibilities Review... ...to improve document standards and evaluation processes. Utilize Excel , PowerPoint... ...Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$19 per hour
...Position: Music & Lyrics Expert - Bengali Type: Contract... ...11–$19/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities... ...adherence, and originality. Evaluate whether lyrics sound natural,...Remote jobContract workSummer workImmediate start$120 per hour
...management / reliability / SRE Evaluator Type: Contract... ...$120/hour Location: Remote Role Responsibilities... ...deadlines while ensuring high-quality evaluations. Qualifications Must... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer workWork at office$77 per hour
...Compensation: $61–$77/hour Location: Remote Commitment: 10+ hours/week... ...undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above). Provide 1... ...writing. Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$70 per hour
...Summers , and Jack Dorsey . Position: Biology PhD Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week Role Responsibilities Source material from...Remote jobContract workSummer workImmediate start$100 per hour
...Dorsey . Position: Investor Relations Expert Type: Contract Compensation: $100/hour Location: Remote Role Responsibilities Draft earnings... .... Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$160 per hour
...Position: Analyst / Insights Experts Type: Contract... ...$160/hour Location: Remote Role Responsibilities... ...to contribute to high-impact evaluation projects. Collaborate asynchronously... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer workFlexible hours$120 per hour
.... Position: People ops / recruiting Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... ...institution. Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer workWork at office$120 per hour
...and Jack Dorsey . Position: Legal Expert — Immigration (Project Donna) Type:... ...Compensation: $100–$120/hour Location: Remote Commitment: ~6 hours Role... ...deadline. Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$120 per hour
...Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... .... Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer workWork at office$12 per hour
...PDF Annotation & Transcription Experts – Malayalam Type:... ...$13/hour Location: Remote Role Responsibilities... ...annotation, labeling, or bilingual evaluation. Skills in transcription... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work$150 per hour
...$150/hour Location: Remote Role Responsibilities... ..., and technical reports. Evaluate AI-generated or human-created... ...detailed written justifications for evaluations and scores to maintain... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work$85 per hour
...$70–$85/hour Location: Remote Role Responsibilities Evaluate the accuracy of AI-generated content... ...files, and scoresheets, to provide expert judgment. Assess domain content... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work$12 per hour
...PDF Annotation & Transcription Experts – Telugu Type:... ...$13/hour Location: Remote Role Responsibilities... ...data annotation or bilingual evaluation. Skills in transcription,... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work$60 per hour
...Jack Dorsey . Position: Education Expert - Sourcing Funnel (Private) Type:... ...Compensation: $45–$60/hour Location: Remote Role Responsibilities Design realistic... ...). Application Process (Takes 20–30 mins to complete) Submit a resume...Remote jobContract workSummer work$63 per hour
...Compensation: $50–$63/hour Location: Remote Commitment: 10+ hours/week... ...undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above). Provide 1... ...plus. Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$120 per hour
...Dorsey . Position: Legal Expert — Environmental (Project Donna)... ...–$120/hour Location: Remote Commitment: ~13 hours... ...Role Responsibilities Evaluate AI-generated legal deliverables... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work$110 per hour
...Contract Compensation: $90–$110/hour Location: Remote Role Responsibilities Complete a ~15 minute written intake... ...weekly via Stripe Connect . Application Process (Takes 20–30 mins to complete) Upload resume AI interview based...Remote jobHourly payWeekly payContract workFor contractorsSummer work$12 per hour
...PDF Annotation & Transcription Experts – Gujarati Type:... ...$13/hour Location: Remote Role Responsibilities... ...annotation, labeling, or bilingual evaluation. Skills in transcription... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work$80 per hour
...STEM PhDs and Technical Domain Experts Type: Contract... ...55–$80/hour Location: Remote Role Responsibilities... ...Complete a short interview and task (20–30 mins ). Paid for up to... ...including this and onboarding videos if hired. Application Process...Remote jobVideoContract workSummer work$170 per hour
...120–$170/hour Location: US or Canada Commitment: 20–25 hours/week Role Responsibilities Simulate raw... ...through rigorous data analysis. Collaborate with subject matter experts to ensure consistency, relevance, and coverage across datasets....Remote jobHourly payContract workFor contractorsSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Video Evaluation Expert - Fully Remote | Upto $20/hr. Be the first to apply!
Related searches