Procurement Evaluator - Fully Remote
$80 - $120 per hourFull-time
Mercor
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Procurement / vendor management Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs .
- Collaborate with AI research teams to enhance the quality and accuracy of outputs.
- Work independently and asynchronously to meet deadlines while ensuring high-quality evaluations.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Procurement / vendor management .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on jobs.jobcopilot.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 11 hours ago
Similar jobs that could be interesting for youBased on the Procurement Evaluator - Fully Remote in Toronto, ON vacancy
$80 - $120 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...Remote workContract workSummer workWork at officeMercor
Toronto, ON11 hours ago$80 - $160 per hour
...Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess domain-... ...Utilize strong analytical skills to contribute to high-impact evaluation projects. Collaborate with teams to improve document standards...Remote workFull timeContract workSummer workMercor
Toronto, ON11 hours ago$80 - $120 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against...Remote workFull timeContract workSummer workWork at officeMercor
Toronto, ON11 hours ago$80 - $120 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against...Remote workFull timeContract workSummer workWork at officeFlexible hoursMercor
Toronto, ON11 hours ago$45 - $60 per hour
...Compensation: $45–$60/hour Location: Remote Role Responsibilities Build... ...tasks with deterministic rubrics to evaluate agent performance. Create scenarios... ...booking. Develop expense and procurement tasks such as expense reports and purchase...Remote workHourly payFull timeContract workFor contractorsSummer workWork at officeMercor
Toronto, ON11 hours ago$65 - $75 per hour
...Contract Compensation: $65–$75/hour Location: Remote Role Responsibilities Write challenging single-turn... ...propulsion . Label them as benign, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge the...Remote workHourly payFull timeContract workFor contractorsSummer workFlexible hoursMercor
Toronto, ON11 hours ago$65 - $75 per hour
...Compensation: $65–$75/hour Location: Remote Role Responsibilities Write... ...benign, dual-use, or adversarial. Evaluate model responses against a defined policy... .... Preferred Prior AI evaluation or red-teaming experience. Technical...Remote workFull timeContract workSummer workMercor
Toronto, ON11 hours ago$60 - $70 per hour
...Word on macOS - Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate and utilize Word on macOS for long-form document authoring and review. Develop expertise in styles, referencing...Remote workFull timeContract workSummer workFlexible hoursMercor
Toronto, ON11 hours ago$70 - $110 per hour
..., and Jack Dorsey . Position: FP&A Expert Type: Contract Compensation: $70–$110/hour Location: Remote Role Responsibilities Review and QA AI-agent rollouts in Financial Forecaster . Judge agent answers against the actual...Remote workFull timeContract workSummer workMercor
Toronto, ON11 hours ago$55 - $65 per hour
...Position: Application Users - PyCharm on macOS - Code Type: Contract Compensation: $55–$65/hour Location: Remote Role Responsibilities Utilize PyCharm on macOS for specialized application tasks. Capture high-resolution...Remote workFull timeContract workSummer workMercor
Toronto, ON11 hours ago$65 - $75 per hour
...Contract Compensation: $65–$75/hour Location: Remote Role Responsibilities Write challenging single-turn... ...materials . Classify them as benign, dual-use, or adversarial. Evaluate AI model responses against policy standards. Judge the...Remote workFull timeContract workSummer workMercor
Toronto, ON11 hours ago$100 - $120 per hour
...Project Donna) Type: Contract Compensation: $100–$120/hour Location: Remote Commitment: ~18 hours Role Responsibilities Evaluate AI-generated legal content in restructuring and insolvency to enhance accuracy and depth....Remote workHourly payFull timeContract workFor contractorsSummer workMercor
Toronto, ON11 hours ago$65 - $75 per hour
...Contract Compensation: $65–$75/hour Location: Remote Role Responsibilities Write challenging single-turn... ...radiological safety , labeled as benign, dual-use, and adversarial. Evaluate model responses against a defined policy standard to ensure...Remote workFull timeContract workSummer workMercor
Toronto, ON11 hours ago$90 - $110 per hour
...Contract Compensation: $90–$110/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities... ..., web search, and code execution. Create objective evaluation rubrics to assess AI performance in the Finance & Banking domain...Remote workFull timeContract workSummer workMercor
Toronto, ON11 hours ago$70 - $100 per hour
...Jack Dorsey . Position: STEM Computational Scientific Software & Evaluation Design - Astrophysics & Cosmology Type: Contract Compensation: $70–$100/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities...Remote workFull timeContract workSummer workMercor
Toronto, ON11 hours ago$50 - $75 per hour
...Larry Summers , and Jack Dorsey . Position: AI Model Evaluator Type: Contract Compensation: $50–$75/hour... ...Provide written justifications with specific evidence for each evaluation. Qualifications Must-Have Master’s degree or...Remote workFull timeContract workSummer workMercor
Toronto, ON11 hours ago$70 - $90 per hour
...Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Develop high-quality data by... ...General Relativity , Astrophysics , and Cosmology . Evaluate the impact of AI models on future innovations in the field....Remote workFull timeContract workSummer workMercor
Toronto, ON11 hours ago$65 - $75 per hour
...Compensation: $65–$75/hour Location: Remote Role Responsibilities Write... ...benign, dual-use, or adversarial. Evaluate AI model responses against defined policy... ...to maintain high standards in AI model evaluation and improvement. Qualifications...Remote workFull timeContract workSummer workMercor
Toronto, ON11 hours ago$65 - $75 per hour
...Compensation: $65–$75/hour Location: Remote Role Responsibilities Write... ...as benign, dual-use, or adversarial. Evaluate responses against a defined policy... ...questions while answering legitimate ones fully. Work independently and asynchronously...Remote workFull timeContract workSummer workMercor
Toronto, ON11 hours ago$80 - $120 per hour
...Larry Summers , and Jack Dorsey . Position: Legal contracts / diligence / redlines Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...Remote workFull timeContract workSummer workWork at officeMercor
Toronto, ON11 hours ago$50 - $125 per hour
...Type: Contract Compensation: $50–$125/hour Location: Remote Duration: 3–4 weeks Commitment: 15+ hours/week Role Responsibilities Evaluate product design decisions using professional experience to enhance design and taste...Remote workFull timeContract workSummer workMercor
Toronto, ON11 hours ago$45 - $65 per hour
...Project-based Role Responsibilities Review and evaluate AI-generated outputs related to job descriptions, compensation... ...Collaborate asynchronously with research teams to refine evaluation frameworks for HR-domain AI . Qualifications Must-Have...Remote workFull timeContract workSummer workMercor
Toronto, ON11 hours ago- ...Contract Compensation: $800/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities... ...severity, or coverage-sensitive insurance claims. ~ Experience evaluating coverage issues and developing claim strategies involving multiple...Remote workFull timeContract workSummer workImmediate startHome office
Mercor
Toronto, ON11 hours ago $80 per hour
...Experience) Type: Contract Compensation: $80/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review model-generated implementations involving...Remote workFull timeContract workSummer workMercor
Toronto, ON11 hours ago- ...Compensation: $80–$100/file Location: Remote Role Responsibilities Evaluate personal finance tracking documents, spreadsheets, forms... ...from documents independently. Submit samples for evaluation purposes only; they will not be used beyond this....Remote workFull timeContract workFor contractorsSummer work
Mercor
Toronto, ON11 hours ago $80 - $120 per hour
...Summers , and Jack Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote workFull timeContract workSummer workWork at officeMercor
Toronto, ON11 hours ago$50 per hour
...Document Understanding Type: Contract Compensation: $50/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities Evaluate the accuracy of AI models in visual document understanding within the Underwriting domain...Remote workFull timeContract workSummer workMercor
Toronto, ON11 hours ago$55 - $65 per hour
...Visual Studio Code on macOS - Code Type: Contract Compensation: $55–$65/hour Location: Remote Role Responsibilities Evaluate and utilize Visual Studio Code on macOS for specialized applications. Capture high-resolution...Remote workFull timeContract workSummer workMercor
Toronto, ON11 hours ago$60 - $70 per hour
...Sonoma 14.5 Expert - Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate and utilize macOS Sonoma 14.5 as your primary desktop operating system. Capture high-resolution...Remote workFull timeContract workSummer workMercor
Toronto, ON11 hours ago$38 - $53 per hour
...Contract Compensation: $38–$53/hour Location: Remote Duration: 3–6 months Commitment: 20+ hours/... ...scientific accuracy and clear instructions. Define and document evaluation standards, creating rubrics that ensure scientific rigor and...Remote workFull timeContract workSummer workMercor
Toronto, ON11 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Procurement Evaluator - Fully Remote. Be the first to apply!
Related searches
- estimateur structure Toronto, ON
- évaluateur-estimateur Toronto, ON
- test evaluator Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur automobile Toronto, ON
- admissions evaluator Toronto, ON
- remote social media evaluator Toronto, ON
- chargé de projet estimateur Toronto, ON
- teletravail Toronto, ON
- clinical research coordinator remote Toronto, ON