Critical Reviewer - Fully Remote | Upto $70/hr
$70 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Generalist Expert
Type: Contract
Compensation: $70/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated responses to strengthen reasoning and rigor in model outputs .
- Provide structured written feedback to improve training data quality and downstream performance.
- Develop clear, precise, and well-evidenced written rationales that go beyond surface-level observations.
- Ensure consistent and honest judgment, including critical assessments when warranted.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- Bachelor's degree from a top-500 globally ranked university preferred.
- Strong analytical and written communication skills.
- Ability to work independently and follow detailed task guidelines.
- Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning.
- Native English fluency required.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 19 hours ago
Similar jobs that could be interesting for youBased on the Critical Reviewer - Fully Remote | Upto $70/hr in Toronto, ON vacancy
$70 per hour
...Position: Generalist Expert (US/Canada) Type: Contract Compensation: $50–$70/hour Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for quality and correctness....Remote jobContract workSummer workFlexible hours$70 per hour
...Experts Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct enterprise... ..., reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and...Remote jobContract workSummer work$70 per hour
...Expert Type: Contract Compensation: $40–$70/hour Location: Remote Role Responsibilities Evaluate the accuracy... ...strengthen reasoning and rigor in model outputs . Review complex content for alignment with domain principles and methodologies...Remote jobContract workSummer work$70 per hour
...Experts Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct enterprise... ...support, reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and...Remote jobContract workSummer work$120 per hour
...Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated... ...help or support, reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and application...Remote jobContract workSummer workWork at office$70 per hour
...Expert Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct enterprise... ...plus understanding of F500 budgets, procurement, and legal review. Preferred ~ Prior rubric, sales-enablement...Remote jobContract workSummer work$70 per hour
...Expert Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct higher... ...scenarios for curriculum and program design, faculty senate reviews, and institutional planning cycles. Build education tasks...Remote jobContract workSummer work$70 per hour
...Autonomous Systems annotation Type: Contract Compensation: $50–$70/hour Location: Remote Commitment: 30–40 hours/week Role Responsibilities Review real-world data from deployed networks, including logs, configs, telemetry, and...Remote jobContract workSummer work$70 per hour
...Expert Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct higher... ...curriculum and program design, faculty senate or accreditation review, and budget or enrollment planning. Build education tasks...Remote jobContract workSummer work$120 per hour
...Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts... ...written feedback to improve AI-generated content. Review documents, spreadsheets, and slide decks for accuracy and rigor....Remote jobContract workSummer workWork at office$70 per hour
...Expert Type: Contract Compensation: $50–$70/hour Location: Remote Role Responsibilities Evaluate and optimize... ...support, reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and...Remote jobContract workSummer work$18 per hour
...Compensation: $18/hour Location: Remote Duration: Up to 6 months... ...Headphones or studio monitors suitable for critical listening. Preferred Formal... ...to: ****@*****.*** PS: Our team reviews applications daily. Please complete your...Remote jobContract workSummer workImmediate start$42 per hour
...Compensation: $17–$42/hour Location: Remote Duration: Up to 6 months... ...or studio monitors suitable for critical listening. Preferred Formal... ...to: ****@*****.*** PS: Our team reviews applications daily. Please complete your...Remote jobContract workSummer workImmediate start$19 per hour
...Compensation: $11–$19/hour Location: Remote Duration: Up to 6 months... ..., and other musical characteristics. Review AI-generated lyrics and vocals against reference... ...or studio monitors suitable for critical listening. Preferred Formal...Remote jobContract workSummer workImmediate start$120 per hour
...Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts... ...or support, reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and application...Remote jobContract workSummer workWork at office$190 per hour
...Contract Compensation: $140–$190/hour Location: Remote Commitment: 20–25 hours/week Role Responsibilities... ...help or support, reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and...Remote jobContract workSummer work$85 per hour
...Expert Type: Contract Compensation: $70–$85/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities... ..., reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and...Remote jobContract workSummer work$120 per hour
...Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts... ...or support, reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and application...Remote jobContract workSummer workWork at office$70 per hour
...Position: Basketball Expert Type: Contract Compensation: $45–$70/hour Location: Remote Role Responsibilities Evaluate basketball games and review AI-generated play-by-play commentary and post-game analysis. Score the accuracy...Remote workFull timeContract workSummer work$170 per hour
...about the interview process and platform information, please check: For any help or support, reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity....Remote jobHourly payContract workFor contractorsSummer work$60 per hour
...Type: Contract Compensation: $50–$60/hour Location: Remote Role Responsibilities Track project and annotator performance using Google Sheets . Review annotator quality to ensure high standards. Handle contributor communications...Remote jobContract workSummer work$170 per hour
...Contract Compensation: $120–$170/hour Location: Remote Commitment: 20–25 hours/week Role Responsibilities... ...help or support, reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and...Remote jobContract workSummer workManual labor$98 per hour
...Contract Compensation: $77–$98/hour Location: Remote Commitment: 10+ hours/week Role... ...academic references per question from reputable sources like peer-reviewed journals. Review pre-written questions for accuracy, clarity, and rigor. Edit...Remote jobContract workSummer work$110 per hour
...Contract Compensation: $90–$110/hour Location: Remote Role Responsibilities Complete a ~15 minute written... ...help or support, reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and...Remote jobHourly payWeekly payContract workFor contractorsSummer work$63 per hour
...Compensation: $50–$63/hour Location: Remote Commitment: 10+ hours/week... ...from reputable sources such as peer-reviewed journals and university repositories.... ...to: ****@*****.*** PS: Our team reviews applications daily. Please complete your...Remote jobContract workSummer work$120 per hour
...Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts... ...or support, reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and application...Remote jobContract workSummer workWork at office$80 per hour
...Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type: Contract... ...Compensation: $60–$80/hour Location: Remote Role Responsibilities Sign an NDA... ...task using the source files provided. Review five model-generated outputs for that task....Remote jobHourly payContract workFor contractorsSummer work$100 per hour
...Contract Compensation: $60–$100/hour Location: Remote Role Responsibilities Evaluate the accuracy and depth... ...to strengthen reasoning and rigor in model outputs . Review complex machine learning research for alignment with domain principles...Remote jobContract workSummer work$150 per hour
...Contract Compensation: $150–$250/hour Location: Remote Role Responsibilities Conduct structured, recorded... ...interviews, depending on fit. Work independently to prepare and review each task/interview, totaling 4–5 hours . Qualifications...Remote jobContract workSummer work$80 per hour
...Contract Compensation: $80/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review model-generated implementations involving ETL pipelines , data...Remote jobContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Critical Reviewer - Fully Remote | Upto $70/hr. Be the first to apply!
Related searches
- remote disability management Toronto, ON
- remote security manager Toronto, ON
- remote lawyer Toronto, ON
- remote coding part time Toronto, ON
- clinical data coordinator remote Toronto, ON
- remote ios developer Toronto, ON
- remote payroll Toronto, ON
- remote work no experience Toronto, ON
- remote environmental Toronto, ON
- hr director remote Toronto, ON