Procurement Evaluator - Fully Remote
$80 - $120 per hourFull-time
Mercor
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Procurement / vendor management Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs .
- Collaborate with AI research teams to enhance the quality and accuracy of outputs.
- Work independently and asynchronously to meet deadlines while ensuring high-quality evaluations.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Procurement / vendor management .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on jobs.jobcopilot.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 4 hours ago
Similar jobs that could be interesting for youBased on the Procurement Evaluator - Fully Remote in Toronto, ON vacancy
$80 - $120 per hour
...Adam DAngelo Larry Summers and Jack Dorsey . Position: People ops / recruiting Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...Remote workFull timeContract workSummer workWork at office$11 - $19 per hour
...Contract Compensation: $11$19/hour Location: Remote Duration: Up to 6 months Commitment: 20 hours... ...based on quality creativity prompt adherence and originality. Evaluate whether lyrics sound natural including word choice slang and...Remote workFull timeContract workSummer workImmediate start$80 - $120 per hour
...and Jack Dorsey . Position: Procurement / vendor management Evaluator Type: Contract... ...$80–$120/hour Location: Remote Role Responsibilities... ...deadlines while ensuring high-quality evaluations. Qualifications Must-Have...Remote workFull timeContract workSummer workWork at office$42 per hour
...Type: Contract Compensation: $17–$42/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres for quality and creativity. Compare...Remote jobContract workSummer workImmediate start$120 per hour
...Larry Summers , and Jack Dorsey . Position: Real estate / hospitality / events Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Remote jobContract workSummer workWork at office$120 per hour
...Summers , and Jack Dorsey . Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...Remote jobContract workSummer workWork at office$45 - $60 per hour
...Compensation: $45–$60/hour Location: Remote Role Responsibilities Build... ...tasks with deterministic rubrics to evaluate agent performance. Create scenarios... ...booking. Develop expense and procurement tasks such as expense reports and purchase...Remote workHourly payFull timeContract workFor contractorsSummer workWork at office$60 - $80 per hour
...Responsibilities Develop realistic and effective environments for evaluating and training models on bookkeeping workflows. Evaluate and... ...Collaborate with teams to improve AI model training and evaluation processes. Provide structured feedback to enhance model...Remote workFull timeContract workSummer work$80 - $120 per hour
...Summers , and Jack Dorsey . Position: Investor materials / fundraising / pitchbook Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...Remote workFull timeContract workSummer workWork at office$38 - $53 per hour
...Contract Compensation: $38–$53/hour Location: Remote Duration: 3–6 months Commitment: 20+ hours/... ...scientific accuracy and clear instructions. Define and document evaluation standards, creating rubrics that ensure scientific rigor and...Remote workFull timeContract workSummer work$100 per hour
...hours available Role Responsibilities Design questions related to the occupation of Accountants and Auditors . Work fully asynchronously around your schedule. Ensure access to a desktop or laptop computer (no Chromebooks ). Engage in a short-...Remote workWeekly payFull timeTemporary workFor contractorsSummer work$70 - $90 per hour
...Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Develop high-quality data by... ...General Relativity , Astrophysics , and Cosmology . Evaluate the impact of AI models on future innovations in the field....Remote workFull timeContract workSummer work$90 - $110 per hour
...Contract Compensation: $90–$110/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities... ..., web search, and code execution. Create objective evaluation rubrics to assess AI performance in the Finance & Banking domain...Remote workFull timeContract workSummer work$50 - $75 per hour
...Larry Summers , and Jack Dorsey . Position: AI Model Evaluator Type: Contract Compensation: $50–$75/hour... ...Provide written justifications with specific evidence for each evaluation. Qualifications Must-Have Master’s degree or...Remote workFull timeContract workSummer work$70 - $100 per hour
...Jack Dorsey . Position: STEM Computational Scientific Software & Evaluation Design - Astrophysics & Cosmology Type: Contract Compensation: $70–$100/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities...Remote workFull timeContract workSummer work- ...Contract Compensation: $800/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities... ...severity, or coverage-sensitive insurance claims. ~ Experience evaluating coverage issues and developing claim strategies involving multiple...Remote workFull timeContract workSummer workImmediate startHome office
$50 - $125 per hour
...Type: Contract Compensation: $50–$125/hour Location: Remote Duration: 3–4 weeks Commitment: 15+ hours/week Role Responsibilities Evaluate product design decisions using professional experience to enhance design and taste...Remote workFull timeContract workSummer work$80 - $120 per hour
...Larry Summers , and Jack Dorsey . Position: Legal contracts / diligence / redlines Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...Remote workFull timeContract workSummer workWork at office$80 per hour
...Experience) Type: Contract Compensation: $80/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review model-generated implementations involving...Remote workFull timeContract workSummer work$45 - $65 per hour
...Project-based Role Responsibilities Review and evaluate AI-generated outputs related to job descriptions, compensation... ...Collaborate asynchronously with research teams to refine evaluation frameworks for HR-domain AI . Qualifications Must-Have...Remote workFull timeContract workSummer work$85 per hour
...Experience) Type: Contract Compensation: $85/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex engineering tasks. Review model-generated frontend code for correctness, quality...Remote workFull timeContract workSummer work$60 - $100 per hour
...Contract Compensation: $60–$100/hour Location: Remote Role Responsibilities Design task briefs based on... ...AI agent attempts and judge them against your own standard. Evaluate AI-generated content in PR & Communications to improve model outputs...Remote workFull timeContract workSummer work$120 - $170 per hour
...Contract Compensation: $120–$170/hour Location: Remote Commitment: 20–25 hours/week Role Responsibilities... .... Design prompts, golden outputs, and rubrics for AI agent evaluation. Evaluate exposure-response relationships to reconcile against...Remote workFull timeContract workSummer workManual labor$180 per hour
...Contract Compensation: $180–$400/hour Location: Remote Duration: Ongoing, reviewed monthly Commitment:... ...Cardiology practice, including ACS management , arrhythmia evaluation , and heart failure optimization . Write "golden"...Remote workWeekly payFull timeContract workSummer workWork at office$60 - $100 per hour
...Contract Compensation: $60–$100/hour Location: Remote Role Responsibilities Design task briefs from real... ...from plausible-but-wrong ones. Review AI agent attempts and evaluate them against established standards. Diagnose issues from...Remote workFull timeContract workSummer work$72 - $80 per hour
...Type: Contract Compensation: $72–$80/hour Location: Remote Commitment: 20 hours/week Role Responsibilities Author and review technical tasks to evaluate AI model performance on agricultural sciences problems. Produce original...Remote workHourly payWeekly payFull timeContract workFor contractorsSummer workFlexible hours$100 per hour
...Type: Contract Compensation: $100/hour Location: Remote Duration: Minimum four weeks Commitment: 10+ hours/week Role Responsibilities Evaluate and create board materials for venture capital projects. Conduct market...Remote workHourly payWeekly payFull timeContract workFor contractorsSummer work$50 - $60 per hour
...Contract Compensation: $50–$60/hour Location: Remote Role Responsibilities Construct public-sector... ...government processes and tooling, understanding public budgets, procurement, legislative review, and regulatory compliance. Preferred...Remote workFull timeContract workSummer work$50 per hour
...Document Understanding Type: Contract Compensation: $50/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities Evaluate the accuracy of AI models in visual document understanding within the Underwriting domain...Remote workFull timeContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Procurement Evaluator - Fully Remote. Be the first to apply!
Related searches
- admissions evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- test evaluator Toronto, ON
- estimateur automobile Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur en bâtiment Toronto, ON
- chargé de projet estimateur Toronto, ON
- estimateur structure Toronto, ON
- fully remote assistant accountant Toronto, ON
- clinical research remote Toronto, ON