Video Evaluation Expert - Fully Remote | Upto $20/hr
$20 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Video Evaluation Generalist
Type: Contract
Compensation: $15–$20/hour
Location: Remote
Commitment: 20 hours/week
Role Responsibilities
- Evaluate paired video outputs by comparing two short video clips against a provided rubric for prompt adherence, motion quality, visual artifacts, and physical plausibility.
- Score and justify preferences by assigning rubric scores to each clip, selecting an overall preference, and documenting a brief written justification.
- Maintain scoring consistency across high task volumes, ensuring calibration to the rubric remains steady for reliable judgments.
- Work independently and meet deadlines in a structured project environment with clear goals and tools.
Qualifications
Must-Have
- BS or BA from a reputable institution completed or in progress.
- Strong writing and critical thinking skills.
- Ability to work independently and meet deadlines.
Preferred
- 2+ years of experience in teaching or research.
Application Process (Takes 20–30 mins to complete)
- Complete an AI-led interview, this should take around 15 minutes.
- If selected, you will be invited to work on the project.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Video Evaluation Expert - Fully Remote | Upto $20/hr in Toronto, ON vacancy
$120 per hour
.... Position: FP&A / corporate finance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... ...institution. Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer workWork at office$40 per hour
...Compensation: $30–$40/hour Location: Remote Role Responsibilities Evaluate DaVinci Resolve projects for color grading and video editing quality. Develop structured... .... Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobVideoContract workSummer work$12 per hour
...PDF Annotation & Transcription Experts – Telugu Type:... ...$13/hour Location: Remote Role Responsibilities... ...data annotation or bilingual evaluation. Skills in transcription,... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work$80 per hour
...Position: Insurance Underwriting Specialists Type: Contract Compensation: $80/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities Design realistic scenarios involving risk selection, exposure analysis,...Remote jobContract workSummer workImmediate start$65 per hour
...Compensation: $55–$65/hour Location: Remote Role Responsibilities Evaluate VMware Fusion applications on macOS to ensure optimal... ...or dual-monitor setup. Application Process (Takes 20–30 mins to complete) Upload resume AI interview...Remote jobContract workSummer work$70 per hour
...Application Users - Linux Ubuntu 24.04 Expert - Professionals Type:... ...$60–$70/hour Location: Remote Role Responsibilities Evaluate the usability and functionality of... ...setup. Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work$120 per hour
...Position: Real estate / hospitality / events Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... .... Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer workWork at office$150 per hour
...Jack Dorsey . Position: Political Expert — Elections Forecasting & Political Risk... ...Compensation: $150–$250/hour Location: Remote Role Responsibilities Author... ...Group and EIU. Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$160 per hour
...Compensation: $80–$160/hour Location: Remote Role Responsibilities Review... ...with teams to contribute to high-impact evaluation projects. Utilize strong analytical... ...Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$12 per hour
...PDF Annotation & Transcription Experts – Odia Type:... ...$13/hour Location: Remote Role Responsibilities... ...labeling, grading, or bilingual evaluation. Skills in transcription... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work$19 per hour
...Position: Music & Lyrics Expert - Bengali Type: Contract... ...11–$19/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities... ...adherence, and originality. Evaluate whether lyrics sound natural,...Remote jobContract workSummer workImmediate start$160 per hour
...Compensation: $80–$160/hour Location: Remote Role Responsibilities Review... ...skills to contribute to high-impact evaluation projects. Collaborate with teams to improve... ...Canada Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$98 per hour
...Compensation: $77–$98/hour Location: Remote Commitment: 10+ hours/week... ...undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above). Provide 1... ...plus. Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$120 per hour
...management / reliability / SRE Evaluator Type: Contract... ...$120/hour Location: Remote Role Responsibilities... ...deadlines while ensuring high-quality evaluations. Qualifications Must... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer workWork at office$12 per hour
...PDF Annotation & Transcription Experts – Gujarati Type:... ...$13/hour Location: Remote Role Responsibilities... ...annotation, labeling, or bilingual evaluation. Skills in transcription... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work$150 per hour
...Dorsey . Position: Local Political Expert — Elections Forecasting & Political Risk... ...Compensation: $150–$250/hour Location: Remote Role Responsibilities Author... ...races. Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer workLocal area$42 per hour
...Dorsey . Position: Music & Lyrics Expert - Hebrew Type: Contract... ...$17–$42/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres...Remote jobContract workSummer workImmediate start$90 per hour
...Position: Knowledge Management Expert Type: Contract Compensation... ...Compensation: $70–$90/hour Location: Remote Role Responsibilities Evaluate answers from enterprise search and workplace AI tools on HR topics within your area of expertise....Remote jobContract workSummer work$100 per hour
...Dorsey . Position: Investor Relations Expert Type: Contract Compensation: $100/hour Location: Remote Role Responsibilities Draft earnings... .... Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$33 per hour
...PDF Annotation & Transcription Experts – Korean Type:... ...$34/hour Location: Remote Role Responsibilities... ...labeling, grading, or bilingual evaluation. Skills in transcription... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work- ...Jack Dorsey . Position: Free Video Editing For Small Businesses and Creators... ...: $1–$2/hour Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-... ...footage. Application Process (Takes 20–30 mins to complete) Upload...Remote jobVideoContract workSummer work
$63 per hour
...Contract Compensation: $50–$63/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities... ...defined. Rate each question's difficulty as Medium, Hard, or Expert. Provide 1 correct answer and 9 plausible but subtly incorrect alternatives...Remote jobContract workSummer work$160 per hour
...Compensation: $80–$160/hour Location: Remote Role Responsibilities Review... ...to improve document standards and evaluation processes. Utilize Excel , PowerPoint... ...Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$70 per hour
...Summers , and Jack Dorsey . Position: Biology PhD Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week Role Responsibilities Source material from...Remote jobContract workSummer workImmediate start$160 per hour
...Compensation: $80–$160/hour Location: Remote Role Responsibilities Review... ...skills to contribute to high-impact evaluation projects. Work independently and asynchronously... ...Canada Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$120 per hour
...and Jack Dorsey . Position: Legal Expert — Immigration (Project Donna) Type:... ...Compensation: $100–$120/hour Location: Remote Commitment: ~6 hours Role... ...deadline. Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$40 per hour
...Compensation: $30–$40/hour Location: Remote Role Responsibilities Evaluate the functionality and performance of Unreal Engine on... ...or dual-monitor setup. Application Process (Takes 20–30 mins to complete) Upload resume AI interview...Remote jobContract workSummer workFlexible hours$150 per hour
...$150/hour Location: Remote Role Responsibilities... ..., and technical reports. Evaluate AI-generated or human-created... ...detailed written justifications for evaluations and scores to maintain... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work$120 per hour
...success / support operations Evaluator Type: Contract... ...$120/hour Location: Remote Role Responsibilities... ...Collaborate with subject matter experts to ensure consistency and relevance... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer workWork at office$60 per hour
...and Jack Dorsey . Position: Insurance Experts Type: Contract Compensation: $50–$60/hour Location: Remote Role Responsibilities Construct... ...a plus. Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Video Evaluation Expert - Fully Remote | Upto $20/hr. Be the first to apply!
Related searches
- expert automobile Toronto, ON
- expert batiment Toronto, ON
- jeux video Toronto, ON
- montage video Toronto, ON
- video coordinator Toronto, ON
- italian customer service remote Toronto, ON
- ux researcher remote Toronto, ON
- remote entry level web developer Toronto, ON
- northern remote Toronto, ON
- remote support Toronto, ON