Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Procurement Evaluator - Fully Remote

$80 - $120 per hour
Full-time

Mercor

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Procurement / vendor management Evaluator

Type: Contract

Compensation: $80–$120/hour

Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
  • Provide clear, structured written feedback to improve AI model outputs .
  • Collaborate with AI research teams to enhance the quality and accuracy of outputs.
  • Work independently and asynchronously to meet deadlines while ensuring high-quality evaluations.

Qualifications

Must-Have

  • 5+ years of relevant professional experience in Procurement / vendor management .
  • Native or professional fluency in English .
  • Highly proficient in Microsoft Office and Google Workspace , especially Slides .

Preferred

  • Advanced degree (Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Procurement Evaluator - Fully Remote in Toronto, ON vacancy
  • $80 - $160 per hour

     ...Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess domain-...  ...Utilize strong analytical skills to contribute to high-impact evaluation projects. Collaborate with teams to improve document standards... 
    Remote work
    Full time
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $80 - $120 per hour

     ...Angelo , Larry Summers , and Jack Dorsey . Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against... 
    Remote work
    Full time
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 - $120 per hour

     ...Angelo , Larry Summers , and Jack Dorsey . Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against... 
    Remote work
    Full time
    Contract work
    Summer work
    Work at office
    Flexible hours

    Mercor

    Toronto, ON
    more than 2 months ago
  • $50 - $60 per hour

     ...Contract Compensation: $50–$60/hour Location: Remote Commitment: 10–20 hours/week Role Responsibilities...  ...and reasoning skills. Complete a brief paid assessment to evaluate your fit for the role. Resources & Support For details... 
    Remote work
    Full time
    Contract work
    Summer work
    Freelance
    Immediate start

    Mercor

    Toronto, ON
    2 days ago
  • $50 - $60 per hour

     ...Contract Compensation: $50–$60/hour Location: Remote Commitment: 10–20 hours/week Role Responsibilities...  ...and reasoning skills. Complete a brief paid assessment to evaluate your fit for the role. Resources & Support For details... 
    Remote work
    Full time
    Contract work
    Summer work
    Internship
    Immediate start

    Mercor

    Toronto, ON
    2 days ago
  • $80 - $120 per hour

     ...Angelo , Larry Summers , and Jack Dorsey . Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    a month ago
  • $120 per hour

     ...Larry Summers , and Jack Dorsey . Position: Real estate / hospitality / events Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    a month ago
  • $42 per hour

     ...Type: Contract Compensation: $14–$42/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate it against detailed quality standards... 
    Remote job
    Contract work
    Summer work
    Immediate start
    Flexible hours

    Mercor

    Toronto, ON
    a month ago
  • $160 per hour

     ...Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess domain-...  ...Provide structured feedback to improve document standards and evaluation processes. Utilize Excel , PowerPoint , and Word for... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $50 - $60 per hour

     .... Position: UI/UX Designers (Must own MacBook) Type: Contract Compensation: $50–$60/hour Location: Remote Commitment: 10–20 hours/week Role Responsibilities Complete and narrate real UI/UX design tasks on your Mac to... 
    Remote work
    Full time
    Contract work
    Summer work
    Internship
    Immediate start

    Mercor

    Toronto, ON
    2 days ago
  • $20 per hour

     ..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Video Evaluation Generalist Type: Contract Compensation: $15–$20/hour Location: Remote Commitment: 20 hours/week Role Responsibilities Evaluate paired... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  •  ...Top 3 Reasons To Join Us ~ International Environment ~100% Remote ~ Working on the latest tech for the Insurtech Market Leader...  ...team members working remotely from all over the world We are fully funded and backed by reputable VC funds and strategic institutional... 
    Remote work
    Full time

    CoverGo

    Toronto, ON
    8 days ago
  • $16 - $22 per hour

     .... Position: AI Safety Experts — English & Odia Type: Contract Compensation: $16–$22/hour Location: Remote Role Responsibilities Red team conversational AI models and agents to identify jailbreaks, prompt injections, misuse cases... 
    Remote work
    Full time
    Contract work
    Summer work

    Mercor

    Toronto, ON
    6 days ago
  • $19 per hour

     ...Contract Compensation: $11–$19/hour Location: Remote Duration: Up to 6 months Commitment: 20+...  ...on quality, creativity, prompt adherence, and originality. Evaluate whether lyrics sound natural, including word choice, slang, and... 
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    more than 2 months ago
  • $45 - $60 per hour

     ...Compensation: $45–$60/hour Location: Remote Role Responsibilities Build...  ...tasks with deterministic rubrics to evaluate agent performance. Create scenarios...  ...booking. Develop expense and procurement tasks such as expense reports and purchase... 
    Remote work
    Hourly pay
    Full time
    Contract work
    For contractors
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $65 - $75 per hour

     ...Contract Compensation: $65–$75/hour Location: Remote Role Responsibilities Write challenging single-turn...  ...propulsion . Label them as benign, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge the... 
    Remote work
    Hourly pay
    Full time
    Contract work
    For contractors
    Summer work
    Flexible hours

    Mercor

    Toronto, ON
    a month ago
  • $65 - $75 per hour

     ...Compensation: $65–$75/hour Location: Remote Role Responsibilities Write...  ...benign, dual-use, or adversarial. Evaluate model responses against a defined policy...  .... Preferred Prior AI evaluation or red-teaming experience. Technical... 
    Remote work
    Full time
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $60 - $70 per hour

     ...Word on macOS - Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate and utilize Word on macOS for long-form document authoring and review. Develop expertise in styles, referencing... 
    Remote work
    Full time
    Contract work
    Summer work
    Flexible hours

    Mercor

    Toronto, ON
    a month ago
  • $50 - $80 per hour

     ...and Jack Dorsey . Position: Visual Designer Type: Contract Compensation: $50–$80/hour Location: Remote Commitment: 10–20 hours/week Role Responsibilities Write, review, and validate prompt-based questions to train AI... 
    Remote work
    Contract work
    Summer work

    Mercor

    Toronto, ON
    29 days ago
  • $70 - $110 per hour

     ..., and Jack Dorsey . Position: FP&A Expert Type: Contract Compensation: $70–$110/hour Location: Remote Role Responsibilities Review and QA AI-agent rollouts in Financial Forecaster . Judge agent answers against the actual... 
    Remote work
    Full time
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $65 - $75 per hour

     ...Contract Compensation: $65–$75/hour Location: Remote Role Responsibilities Write challenging single-turn...  ...materials . Classify them as benign, dual-use, or adversarial. Evaluate AI model responses against policy standards. Judge the... 
    Remote work
    Full time
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $90 per hour

     ...: Knowledge Management Expert Type: Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Evaluate answers from enterprise search and workplace AI tools on HR topics within your area of expertise. Judge... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    14 days ago
  • $65 - $75 per hour

     ...Contract Compensation: $65–$75/hour Location: Remote Role Responsibilities Write challenging single-turn...  ...radiological safety , labeled as benign, dual-use, and adversarial. Evaluate model responses against a defined policy standard to ensure... 
    Remote work
    Full time
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $30 - $40 per hour

     ...Application Users - Adobe Illustrator on Windows - Generalist Type: Contract Compensation: $30–$40/hour Location: Remote Role Responsibilities Utilize Adobe Illustrator on Windows for vector illustration, logo, and layout design.... 
    Remote work
    Full time
    Contract work
    Summer work
    Flexible hours

    Mercor

    Toronto, ON
    a month ago
  • $55 - $65 per hour

     ...Position: Application Users - PyCharm on macOS - Code Type: Contract Compensation: $55–$65/hour Location: Remote Role Responsibilities Utilize PyCharm on macOS for specialized application tasks. Capture high-resolution... 
    Remote work
    Full time
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  •  ...AI Evaluation Specialist Role Type: Contractor Location: Remote — US, Canada, UK, Ireland, Australia, New Zealand We are seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project... 
    Remote job
    For contractors

    YO AI Labs

    Toronto, ON
    16 days ago
  • $55 - $65 per hour

     ...Visual Studio Code on macOS - Code Type: Contract Compensation: $55–$65/hour Location: Remote Role Responsibilities Evaluate and utilize Visual Studio Code on macOS for specialized applications. Capture high-resolution... 
    Remote work
    Full time
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $60 - $70 per hour

     ...Sonoma 14.5 Expert - Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate and utilize macOS Sonoma 14.5 as your primary desktop operating system. Capture high-resolution... 
    Remote work
    Full time
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $65 - $75 per hour

     ...Compensation: $65–$75/hour Location: Remote Role Responsibilities Write...  ...benign, dual-use, or adversarial. Evaluate AI model responses against defined policy...  ...to maintain high standards in AI model evaluation and improvement. Qualifications... 
    Remote work
    Full time
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $65 - $75 per hour

     ...Compensation: $65–$75/hour Location: Remote Role Responsibilities Write...  ...as benign, dual-use, or adversarial. Evaluate responses against a defined policy...  ...questions while answering legitimate ones fully. Work independently and asynchronously... 
    Remote work
    Full time
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Procurement Evaluator - Fully Remote. Be the first to apply!