Video Evaluation Expert - Fully Remote | Upto $20/hr
$20 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Video Evaluation Generalist
Type: Contract
Compensation: $15–$20/hour
Location: Remote
Commitment: 20 hours/week
Role Responsibilities
- Evaluate paired video outputs by comparing two short video clips against a provided rubric for prompt adherence, motion quality, visual artifacts, and physical plausibility.
- Score and justify preferences by assigning rubric scores to each clip, selecting an overall preference, and documenting a brief written justification.
- Maintain scoring consistency across high task volumes, ensuring calibration to the rubric remains steady for reliable judgments.
- Work independently and meet deadlines in a structured project environment with clear goals and tools.
Qualifications
Must-Have
- BS or BA from a reputable institution completed or in progress.
- Strong writing and critical thinking skills.
- Ability to work independently and meet deadlines.
Preferred
- 2+ years of experience in teaching or research.
Application Process (Takes 20–30 mins to complete)
- Complete an AI-led interview, this should take around 15 minutes.
- If selected, you will be invited to work on the project.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the Video Evaluation Expert - Fully Remote | Upto $20/hr in Toronto, ON vacancy
$20 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Video Evaluation Generalist Type: Contract Compensation: $15–$20/hour Location: Remote Commitment: 20 hours/week Role Responsibilities Evaluate...Remote jobVideoContract workSummer work$19 per hour
...Position: Music & Lyrics Expert - Bengali Type: Contract... ...11–$19/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities... ...adherence, and originality. Evaluate whether lyrics sound natural,...Remote jobContract workSummer workImmediate start- ...Jack Dorsey . Position: Free Video Editing For Small Businesses and Creators... ...: $1–$2/hour Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-... ...footage. Application Process (Takes 20–30 mins to complete) Upload...Remote jobVideoContract workSummer work
$42 per hour
...Dorsey . Position: Music & Lyrics Expert - Hebrew Type: Contract... ...$17–$42/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres...Remote jobContract workSummer workImmediate start$120 per hour
...business strategy / management Evaluator Type: Contract... ...$120/hour Location: Remote Role Responsibilities... ...Collaborate with subject matter experts to ensure consistency, relevance... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer workWork at office$60 per hour
...Dorsey . Position: 3D Artists & Video Editors (Must own MacBook) Type... ...: $50–$60/hour Location: Remote Commitment: 10–20 hours/week Role Responsibilities... ...a brief paid assessment to further evaluate your fit for the role. Resources...Remote jobVideoContract workSummer workImmediate start$120 per hour
...Position: Education / school Evaluator Type: Contract... ...$120/hour Location: Remote Role Responsibilities... ...deadlines while ensuring high-quality evaluations. Qualifications Must... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer workWork at office$120 per hour
.... Position: People ops / recruiting Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... ...institution. Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer workWork at office$160 per hour
...Compensation: $80–$160/hour Location: Remote Role Responsibilities Review... ...skills to contribute to high-impact evaluation projects. Collaborate with teams to improve... ...Canada Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$160 per hour
...Compensation: $80–$160/hour Location: Remote Role Responsibilities Review... ...to improve document standards and evaluation processes. Utilize Excel , PowerPoint... ...Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$12 per hour
...PDF Annotation & Transcription Experts – Telugu Type:... ...$13/hour Location: Remote Role Responsibilities... ...data annotation or bilingual evaluation. Skills in transcription,... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work$70 per hour
...Application Users - Linux Ubuntu 24.04 Expert - Professionals Type:... ...$60–$70/hour Location: Remote Role Responsibilities Evaluate the usability and functionality of... ...setup. Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer work$40 per hour
...Compensation: $30–$40/hour Location: Remote Role Responsibilities Conduct... ...queries each day to ensure timely evaluation. Provide short notes and annotations... ...languages. Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobDaily paidContract workSummer workFlexible hours$150 per hour
...Jack Dorsey . Position: Political Expert — Elections Forecasting & Political Risk... ...Compensation: $150–$250/hour Location: Remote Role Responsibilities Author... ...Group and EIU. Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$70 per hour
...Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate and utilize Word on macOS for long-form document authoring... ...or dual-monitor setup. Application Process (Takes 20–30 mins to complete) Upload resume AI...Remote jobContract workSummer workFlexible hours$40 per hour
...Compensation: $30–$40/hour Location: Remote Role Responsibilities Evaluate the use of Photoshop for raster image editing, retouching... ...a dual-monitor setup. Application Process (Takes 20–30 mins to complete) Upload resume AI interview...Remote jobContract workSummer work$160 per hour
...Compensation: $80–$160/hour Location: Remote Role Responsibilities Review... ...with teams to contribute to high-impact evaluation projects. Utilize strong analytical... ...Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$65 per hour
...Compensation: $55–$65/hour Location: Remote Role Responsibilities Evaluate VMware Fusion applications on macOS to ensure optimal... ...or dual-monitor setup. Application Process (Takes 20–30 mins to complete) Upload resume AI interview...Remote jobContract workSummer work$120 per hour
...management / reliability / SRE Evaluator Type: Contract... ...$120/hour Location: Remote Role Responsibilities... ...deadlines while ensuring high-quality evaluations. Qualifications Must... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer workWork at office$160 per hour
...Position: Analyst / Insights Experts Type: Contract... ...$160/hour Location: Remote Role Responsibilities... ...to contribute to high-impact evaluation projects. Collaborate asynchronously... ...Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer workFlexible hours$80 per hour
.... Position: Adobe Premiere Expert Type: Contract Compensation... ...$60–$80/hour Location: Remote Role Responsibilities Develop and execute video editing projects using Adobe... ...Application Process (Takes 20–30 mins to complete)...Remote jobVideoContract workSummer work$40 per hour
...Compensation: $30–$40/hour Location: Remote Role Responsibilities Evaluate DaVinci Resolve projects for color grading and video editing quality. Develop structured... .... Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobVideoContract workSummer work$110 per hour
...Contract Compensation: $90–$110/hour Location: Remote Role Responsibilities Complete a ~15 minute written intake... ...weekly via Stripe Connect . Application Process (Takes 20–30 mins to complete) Upload resume AI interview based...Remote jobHourly payWeekly payContract workFor contractorsSummer work$60 per hour
...Jack Dorsey . Position: Education Expert - Sourcing Funnel (Private) Type:... ...Compensation: $45–$60/hour Location: Remote Role Responsibilities Design realistic... ...). Application Process (Takes 20–30 mins to complete) Submit a resume...Remote jobContract workSummer work$63 per hour
...Compensation: $50–$63/hour Location: Remote Commitment: 10+ hours/week... ...undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above). Provide 1... ...plus. Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$120 per hour
...and Jack Dorsey . Position: Legal Expert — Immigration (Project Donna) Type:... ...Compensation: $100–$120/hour Location: Remote Commitment: ~6 hours Role... ...deadline. Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$63 per hour
...Compensation: $50–$63/hour Location: Remote Commitment: 10+ hours/week... ...question's difficulty as Medium, Hard, or Expert to guide AI model training. Provide one... ...psychology . Application Process (Takes 20–30 mins to complete) Upload resume...Remote jobContract workSummer work$70 per hour
...Summers , and Jack Dorsey . Position: Biology PhD Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week Role Responsibilities Source material from...Remote jobContract workSummer workImmediate start$170 per hour
...120–$170/hour Location: US or Canada Commitment: 20–25 hours/week Role Responsibilities Simulate raw... ...through rigorous data analysis. Collaborate with subject matter experts to ensure consistency, relevance, and coverage across datasets....Remote jobHourly payContract workFor contractorsSummer work$25 per hour
...Position: AI Data Generalist — Egocentric Video Review Type: Contract Compensation: $20–$25/hour Location: Remote Duration: Approximately 2 weeks... ...structured quality-review tasks. Evaluate action segments within videos for accurate...Remote jobVideoContract workSummer workDay shift
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Video Evaluation Expert - Fully Remote | Upto $20/hr. Be the first to apply!
Related searches
- expert automobile Toronto, ON
- expert batiment Toronto, ON
- wedding video editing Toronto, ON
- jeux video Toronto, ON
- montage video Toronto, ON
- video coordinator Toronto, ON
- 3d environment artist remote Toronto, ON
- remote heavy equipment operator Toronto, ON
- remote speech therapy Toronto, ON
- IT support remote Toronto, ON