Video Evaluation Expert - Fully Remote | Upto $20/hr
$20 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Video Evaluation Generalist
Type: Contract
Compensation: $15–$20/hour
Location: Remote
Commitment: 20 hours/week
Role Responsibilities
- Evaluate paired video outputs by comparing two short video clips against a provided rubric for prompt adherence, motion quality, visual artifacts, and physical plausibility.
- Score and justify preferences by assigning rubric scores to each clip, selecting an overall preference, and documenting a brief written justification.
- Maintain scoring consistency across high task volumes, ensuring calibration to the rubric remains steady for reliable judgments.
- Work independently and meet deadlines in a structured project environment with clear goals and tools.
Qualifications
Must-Have
- BS or BA from a reputable institution completed or in progress.
- Strong writing and critical thinking skills.
- Ability to work independently and meet deadlines.
Preferred
- 2+ years of experience in teaching or research.
Application Process (Takes 20–30 mins to complete)
- Complete an AI-led interview, this should take around 15 minutes.
- If selected, you will be invited to work on the project.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Video Evaluation Expert - Fully Remote | Upto $20/hr in Toronto, ON vacancy
$20 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Video Evaluation Generalist Type: Contract Compensation: $15–$20/hour Location: Remote Commitment: 20 hours/week Role Responsibilities Evaluate...Remote jobVideoContract workSummer work$120 per hour
.... Position: FP&A / corporate finance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... ...institution. Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer workWork at office$40 per hour
...Compensation: $30–$40/hour Location: Remote Role Responsibilities Evaluate DaVinci Resolve projects for color grading and video editing quality. Develop structured... .... Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobVideoContract workSummer work$70 per hour
...Application Users - Linux Ubuntu 24.04 Expert - Professionals Type:... ...$60–$70/hour Location: Remote Role Responsibilities Evaluate the usability and functionality of... ...setup. Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work$12 per hour
...PDF Annotation & Transcription Experts – Telugu Type:... ...$13/hour Location: Remote Role Responsibilities... ...data annotation or bilingual evaluation. Skills in transcription,... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work$65 per hour
...Compensation: $55–$65/hour Location: Remote Role Responsibilities Evaluate VMware Fusion applications on macOS to ensure optimal... ...or dual-monitor setup. Application Process (Takes 20–30 mins to complete) Upload resume AI interview...Remote jobContract workSummer work$80 per hour
...Position: Insurance Underwriting Specialists Type: Contract Compensation: $80/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities Design realistic scenarios involving risk selection, exposure analysis,...Remote jobContract workSummer workImmediate start$150 per hour
...Jack Dorsey . Position: Political Expert — Elections Forecasting & Political Risk... ...Compensation: $150–$250/hour Location: Remote Role Responsibilities Author... ...Group and EIU. Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$19 per hour
...Position: Music & Lyrics Expert - Bengali Type: Contract... ...11–$19/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities... ...adherence, and originality. Evaluate whether lyrics sound natural,...Remote jobContract workSummer workImmediate start$120 per hour
...Position: Real estate / hospitality / events Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... .... Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer workWork at office$160 per hour
...Compensation: $80–$160/hour Location: Remote Role Responsibilities Review... ...with teams to contribute to high-impact evaluation projects. Utilize strong analytical... ...Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$12 per hour
...PDF Annotation & Transcription Experts – Odia Type:... ...$13/hour Location: Remote Role Responsibilities... ...labeling, grading, or bilingual evaluation. Skills in transcription... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work$160 per hour
...Compensation: $80–$160/hour Location: Remote Role Responsibilities Review... ...skills to contribute to high-impact evaluation projects. Collaborate with teams to improve... ...Canada Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work- ...Jack Dorsey . Position: Free Video Editing For Small Businesses and Creators... ...: $1–$2/hour Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-... ...footage. Application Process (Takes 20–30 mins to complete) Upload...Remote jobVideoContract workSummer work
$150 per hour
...Dorsey . Position: Local Political Expert — Elections Forecasting & Political Risk... ...Compensation: $150–$250/hour Location: Remote Role Responsibilities Author... ...races. Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer workLocal area$12 per hour
...PDF Annotation & Transcription Experts – Gujarati Type:... ...$13/hour Location: Remote Role Responsibilities... ...annotation, labeling, or bilingual evaluation. Skills in transcription... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work$98 per hour
...Compensation: $77–$98/hour Location: Remote Commitment: 10+ hours/week... ...undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above). Provide 1... ...plus. Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$42 per hour
...Dorsey . Position: Music & Lyrics Expert - Hindi Type: Contract... ...$14–$42/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres...Remote jobContract workSummer workImmediate startFlexible hours$120 per hour
...management / reliability / SRE Evaluator Type: Contract... ...$120/hour Location: Remote Role Responsibilities... ...deadlines while ensuring high-quality evaluations. Qualifications Must... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer workWork at office$90 per hour
...Position: Knowledge Management Expert Type: Contract Compensation... ...Compensation: $70–$90/hour Location: Remote Role Responsibilities Evaluate answers from enterprise search and workplace AI tools on HR topics within your area of expertise....Remote jobContract workSummer work$33 per hour
...PDF Annotation & Transcription Experts – Korean Type:... ...$34/hour Location: Remote Role Responsibilities... ...labeling, grading, or bilingual evaluation. Skills in transcription... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work$100 per hour
...Dorsey . Position: Investor Relations Expert Type: Contract Compensation: $100/hour Location: Remote Role Responsibilities Draft earnings... .... Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$63 per hour
...Contract Compensation: $50–$63/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities... ...defined. Rate each question's difficulty as Medium, Hard, or Expert. Provide 1 correct answer and 9 plausible but subtly incorrect alternatives...Remote jobContract workSummer work$120 per hour
.... Position: People ops / recruiting Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... ...institution. Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer workWork at office$160 per hour
...Compensation: $80–$160/hour Location: Remote Role Responsibilities Review... ...to improve document standards and evaluation processes. Utilize Excel , PowerPoint... ...Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$70 per hour
...Summers , and Jack Dorsey . Position: Biology PhD Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week Role Responsibilities Source material from...Remote jobContract workSummer workImmediate start$160 per hour
...Compensation: $80–$160/hour Location: Remote Role Responsibilities Review... ...skills to contribute to high-impact evaluation projects. Work independently and asynchronously... ...Canada Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$40 per hour
...Compensation: $30–$40/hour Location: Remote Role Responsibilities Evaluate the functionality and performance of Unreal Engine on... ...or dual-monitor setup. Application Process (Takes 20–30 mins to complete) Upload resume AI interview...Remote jobContract workSummer workFlexible hours$150 per hour
...$150/hour Location: Remote Role Responsibilities... ..., and technical reports. Evaluate AI-generated or human-created... ...detailed written justifications for evaluations and scores to maintain... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work$25 per hour
...Position: AI Data Generalist — Egocentric Video Review Type: Contract Compensation: $20–$25/hour Location: Remote Duration: Approximately 2 weeks... ...structured quality-review tasks. Evaluate action segments within videos for accurate...Remote jobVideoContract workSummer workDay shift
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Video Evaluation Expert - Fully Remote | Upto $20/hr. Be the first to apply!
Related searches
- expert automobile Toronto, ON
- expert batiment Toronto, ON
- montage video Toronto, ON
- jeux video Toronto, ON
- video coordinator Toronto, ON
- remote steel estimator Toronto, ON
- data analyst remote working Toronto, ON
- remote call center quality analyst Toronto, ON
- remote travel writer Toronto, ON
- remote nonprofit Toronto, ON