Management Evaluator - Fully Remote | Upto $120/hr
$120 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: General business strategy / management Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors.
- Provide clear, structured written feedback.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
- Collaborate with subject matter experts to ensure consistency, relevance, and coverage across datasets.
Qualifications
Must-Have
- 5+ years of relevant professional experience in General business strategy / management .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree ( Master's or higher ) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Management Evaluator - Fully Remote | Upto $120/hr in Toronto, ON vacancy
$120 per hour
...Summers , and Jack Dorsey . Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...Remote jobContract workSummer workWork at office$120 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: FP&A / corporate finance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...Remote jobContract workSummer workWork at office$120 per hour
...Larry Summers , and Jack Dorsey . Position: Legal contracts / diligence / redlines Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...Remote jobContract workSummer workWork at office$120 per hour
...Pharmacist Type: Contract Compensation: $75–$120/hour Location: Remote Role Responsibilities Confirm interaction,... ...~ Prior data annotation, labeling, or AI evaluation experience Application Process (Takes 20–30 mins...Remote jobContract workSummer work$120 per hour
...Summers , and Jack Dorsey . Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobContract workSummer workWork at office$120 per hour
...Expert Type: Contract Compensation: $120/hour Location: Remote Duration: Minimum four weeks Commitment:... ...public SEC filings to support AI model training . Evaluate the accuracy of AI-generated equity research to enhance...Remote jobHourly payContract workFor contractorsSummer work$120 per hour
...Jack Dorsey . Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...Remote jobContract workSummer workWork at office$120 per hour
...Accounting Domain Intake — Shape Upcoming Accounting Engagements Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Complete a ~30-minute written intake about your accounting practice. Describe your...Remote jobContract workFor contractorsSummer work$120 per hour
...Dorsey . Position: Domain Expert – Legal (Lexis+ Research) Type: Contract Compensation: $76–$120/hour Location: Remote Role Responsibilities Confirm every case, statute, and regulation is still good law for the point cited. Catch...Remote jobContract workSummer work$19 per hour
...Contract Compensation: $11–$19/hour Location: Remote Duration: Up to 6 months Commitment: 20+... ...on quality, creativity, prompt adherence, and originality. Evaluate whether lyrics sound natural, including word choice, slang, and...Remote jobContract workSummer workImmediate start$17 per hour
...Type: Contract Compensation: $17/hour Location: Remote Duration: Up to 6 months Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other standards in music ....Remote jobContract workSummer workImmediate start$60 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Expert Project Manager Type: Contract Compensation: $50–$60/hour Location: Remote Role Responsibilities Track project and annotator performance using Google Sheets...Remote jobContract workSummer work$85 per hour
...Contract Compensation: $85/hour Location: Remote Role Responsibilities Author original, free-response... ...against three frontier language models until at least one fails. Evaluate the accuracy and depth of AI-generated content in...Remote jobContract workSummer work$85 per hour
...Compensation: $70–$85/hour Location: Remote Commitment: 15–20 hours/week... ...challenging computational problems to evaluate AI capabilities in solving scientific... ...Collaborate on AI model training, evaluation, and improvement in computational seismology...Remote jobContract workSummer work$85 per hour
...Experience) Type: Contract Compensation: $85/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated implementations...Remote jobContract workSummer work$180 per hour
...Design Experts Type: Contract Compensation: $80–$180/hour Location: Remote Commitment: 15+ hours/week Role Responsibilities Evaluate product design decisions to align with professional taste preferences. Leverage...Remote jobContract workSummer work$19 per hour
...Type: Contract Compensation: $11–$19/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across genres for musicality, creativity, and production quality...Remote jobContract workSummer workImmediate start$70 per hour
...Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning and... ...attention to detail and accurate application of structured evaluation guidelines. Work independently and asynchronously...Remote jobContract workSummer work$70 per hour
...Compensation: $40–$70/hour Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated content to strengthen... ...quality and downstream performance. Develop evaluation rubrics and benchmarks for assessing AI-generated...Remote jobContract workSummer work$160 per hour
...Contract Compensation: $130–$160/hour Location: Remote Role Responsibilities Design precise, task-... ...judgment. Preferred ~ Prior experience with AI training, evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobContract workSummer work$100 per hour
...Contract Compensation: $85–$100/hour Location: Remote Role Responsibilities Build bottoms-up annual... ...project approvals, payback, and prioritization. Create monthly management reporting packs with variance commentary and product, customer,...Remote jobContract workSummer work$70 per hour
...Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct enterprise fraud... ...Develop fraud operations scenarios using tools like SAS Fraud Management , Actimize , Feedzai , and enterprise case management/transaction...Remote jobContract workSummer work$98 per hour
...Contract Compensation: $77–$98/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities... ...PhD , DBA , or doctoral candidate in Business Administration, Management, Marketing, or a closely related field. MBA or Master's degree...Remote jobContract workSummer work$150 per hour
...Contract Compensation: $150–$250/hour Location: Remote Role Responsibilities Conduct structured, recorded remote sessions to capture expert design thinking. Evaluate design quality, critique, and shipping standards in AI design tooling...Remote jobContract workSummer work$77 per hour
...Position: Applied Mathematics Benchmark Specialist Type: Contract Compensation: $61–$77/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities Author original math questions that test deep conceptual understanding...Remote jobContract workSummer work$100 per hour
...Contract Compensation: $85–$100/hour Location: Remote Role Responsibilities Build valuation and merger... ...economics. Produce process and board materials, including management presentations, data packs, buyer universes, board and committee...Remote jobContract workSummer work$60 per hour
...Software Engineering Reviewer – Browser Test Validation Type: Contract Compensation: $30–$60/hour Location: Remote Role Responsibilities Review browser-based testing workflows for AI-generated web applications . Assess technical...Remote jobContract workSummer work$60 per hour
...Position: Education Expert - Sourcing Funnel (Private) Type: Contract Compensation: $45–$60/hour Location: Remote Role Responsibilities Design realistic educational scenarios and tasks from day-to-day work such as lesson planning and...Remote jobContract workSummer work$150 per hour
...Voice Actor: CX Agent Voice Cloning (Standard French) Type: Contract Compensation: $50–$150/hour Location: Remote Commitment: 5–10 hours/week Role Responsibilities Record high-quality voice samples across diverse scripts such...Remote jobContract workSummer work10 hours per week$90 per hour
...Compensation: $70–$90/hour Location: Remote Commitment: 15–20 hours/week... ..., or scientific software packages. Evaluate AI's ability to compute reproducible... ...packages. Familiarity with benchmark or evaluation design. Background in scientific...Remote jobContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Management Evaluator - Fully Remote | Upto $120/hr. Be the first to apply!
Related searches
- chargé de projet estimateur Toronto, ON
- remote social media evaluator Toronto, ON
- test evaluator Toronto, ON
- admissions evaluator Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur automobile Toronto, ON
- estimateur structure Toronto, ON
- évaluateur-estimateur Toronto, ON
- remote disability management Toronto, ON
- remote security manager Toronto, ON