Process Improvement Specialist - Evaluator
$80 - $120 per hourFull-time
Mercor
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Process improvement / SOPs Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors.
- Provide clear, structured written feedback.
- Collaborate with subject matter experts to ensure consistency and quality.
- Work independently and asynchronously to meet deadlines.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Process improvement / SOPs .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on jobs.jobcopilot.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 6 hours ago
Similar jobs that could be interesting for youBased on the Process Improvement Specialist - Evaluator in Toronto, ON vacancy
$80 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...Process ImprovementRemote jobContract workSummer workWork at office$60.52k - $91k per year
...Lead, Process Improvement – Finance Operations Join Livingston and grow your career in the constantly changing world of international... ...operations team, including hiring, training, and performance evaluations. Train and coach staff on analysis skills, financial applications...Process ImprovementLong term contractFull timeFlexible hours$15 - $20 per hour
...external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies. Assess reasoning... ...-grained qualitative judgments Application Process (Takes 20–30 mins to complete) Upload...SuggestedFull timeContract workSummer workRemote work$70 - $100 per hour
.../week Role Responsibilities Evaluate AI-generated office artifacts in Excel... ...Grade outputs against structured rubrics to improve model behavior. Provide written... ...reviewed on a rolling basis. Application Process (Takes 20–30 mins to complete)...SuggestedFull timeContract workSummer workWork at officeImmediate startRemote work$25 - $45 per hour
...Role Responsibilities Evaluate AI-generated written... ...performance. Draft and refine evaluation rubrics for generalist writing... ...to meet deadlines and improve AI model performance .... ...responsibilities. Application Process (Takes 20–30 mins to complete...SuggestedFull timeContract workSummer workRemote work$70k - $73.85k per year
...for an existing vacancy. Objective: The Research and Evaluation Specialist will lead the analysis and development of sector-based program... ...protected accommodation through any stage of the recruitment process, please make them known when contacted and we will work with...Full timeInternship$80 - $120 per hour
...Summers , and Jack Dorsey . Position: General Sales / GTM Evaluator Type: Contract Compensation: $80–$120/hour... ...Master's or higher) from a reputable institution. Application Process (Takes 20–30 mins to complete) Upload resume AI...Full timeContract workSummer workWork at officeRemote workFlexible hours$80 - $150 per hour
...and Jack Dorsey . Position: MS Excel / Google Sheets Evaluator Type: Contract Compensation: $80–$150/hour... ...relevance. Provide structured feedback to enhance document evaluation processes. Utilize MS Excel and Google Slides to perform...Full timeContract workSummer workRemote work$90 per hour
...Preferred Prior RLHF , preference-labeling, model-evaluation, or structured code-review work. Pixel-perfect design-to-code... ...availability in contiguous multi-hour blocks. Application Process (Takes 20–30 mins to complete) Upload resume AI interview...Full timeContract workSummer workLocal areaRemote work$73 per hour
...Position: Chemistry AI Evaluator Type: Contract... ...identifying strengths, areas of improvement, and factual or conceptual inaccuracies... .... Apply consistent evaluation standards by following clear... ...frameworks Application Process (Takes 20–30 mins to complete...Full timeContract workSummer workRemote work$14 - $42 per hour
...Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate against detailed... ...artists. Start Date ~ Immediate Application Process (Takes 20–30 mins to complete) Upload resume Complete...Full timeContract workSummer workImmediate startRemote work$60 - $80 per hour
...professional domain. Review peer-developed deliverables to improve AI research . Work independently and asynchronously to... ...skills. Start Date ~ Immediate Application Process (Takes 20–30 mins to complete) Upload resume AI interview...Full timeContract workSummer workImmediate startRemote workFlexible hours$25 - $35 per hour
...Larry Summers , and Jack Dorsey . Position: AI Model Evaluation Contractor Type: Contract Compensation: $25–$... ...written communication and critical reasoning skills. Application Process (Takes 20–30 mins to complete) Submit your resume to...Full timeContract workFor contractorsSummer work$70 - $100 per hour
...hours/week Role Responsibilities Evaluate AI-generated office artifacts across... ...rubrics and provide feedback to improve model behavior. Participate in onboarding... ...reviewed on a rolling basis. Application Process (Takes 20–30 mins to complete)...Remote jobContract workSummer workWork at officeImmediate start$70 - $100 per hour
...responses and select the stronger one. Evaluate both the content and rendering of each... ...written feedback to the research team to improve model behavior. Participate in onboarding... ...on a rolling basis. Application Process (Takes 20–30 mins to complete)...Remote jobContract workSummer workWork at officeImmediate start$70 - $100 per hour
...hours/week Role Responsibilities Evaluate and compare AI-generated office... ...structured rubrics and provide feedback to improve model behavior. Participate in onboarding... ...on a rolling basis. Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer workWork at officeImmediate start$120 - $170 per hour
...work. Collaborate with AI research teams to improve training data quality and downstream performance.... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30 mins to complete) Submit your...Remote jobContract workSummer work$100 per hour
...Summers , and Jack Dorsey . Position: Data Collection Specialist Type: Contract Compensation: $100/hour... ...working with new tools and staged environments. Application Process (Takes 20–30 mins to complete) Upload resume AI interview...Full timeContract workSummer workInternshipRemote work$80 - $120 per hour
...Humanities / arts / culture Evaluator Type: Contract... ...structured written feedback to improve AI model outputs . Work... ...asynchronously to ensure high-quality evaluations. Collaborate with AI... .... Application Process (Takes 20–30 mins to complete...Remote jobContract workSummer workWork at office- ...bullet points. Collaborate with team members for document evaluation and feedback. Qualifications Must-Have Experience... ...in document formatting and content privacy. Application Process (Takes 20–30 mins to complete) Upload samples of Microsoft...Full timeContract workSummer work
- ...one that’s changing the world for the better. The HR Process Excellence & Ops Specialist is responsible for strengthening the effectiveness, consistency... ...HR Workflow Process Standardization & Continuous Improvement Map, document, and standardize core HR system processes...Process ImprovementFull timeFor contractorsLocal area
$75k - $85k per year
...recognition programs to celebrate your contributions. The Job: Specialist, Business Process Transformation We’re looking for a Specialist, Business Process Transformation to support initiatives that improve operational efficiency, streamline workflows, and enhance...Process ImprovementTemporary workWork at officeRemote work$45 per hour
Our client, one of Canada's leading banks, is looking for a Process Improvement and Business Analytics Consultant to join a high-impact transformation team in the payments space. This role focuses on modernizing payment operations through automation, reconciliation, AI-driven...Process ImprovementContract work2 days per week$100 - $150 per hour
...A/B test write-ups . Evaluate AI-generated or human-created... ...detailed written justifications for evaluations and scores to maintain... ...submitted work for continuous improvement. Work independently and... .... Application Process (Takes 20–30 mins to complete...Full timeContract workSummer workRemote work$80 - $120 per hour
...: Customer success / support operations Evaluator Type: Contract Compensation... ...clear, structured written feedback to improve AI outputs. Collaborate with teams to... ...institution. Application Process (Takes 20–30 mins to complete) Upload...Full timeContract workSummer workWork at officeRemote work$50k - $60k per year
...SUMMARY The Monitoring, Evaluations & Learning Officer (MELO) provides technical expertise... ...-based strategies and activities to improve project performance and results. This position... ...and implementation of key MEL processes and tools to ensure the achievement of project...Full timeApprenticeshipSummer workWork at officeRemote work$60 - $80 per hour
...Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type: Contract... ...& Legal ~ Hourly contractor Application Process (Takes 20–30 mins to complete) Upload resume AI interview...Hourly payFull timeContract workFor contractorsSummer workRemote work$100 - $150 per hour
...technical objections, supporting proofs of concept, and evaluating product fit and technical risk. ~ Hands-on... ...~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30 mins to complete) Submit your...Full timeContract workSummer workRemote work- ...become a part of our growth and extraordinarily bright future! Job Overview: This role will be responsible for driving process and capability improvement to ultimately deliver breakthrough results and achieve the plant/bakery goals, by working with cross-functional teams to...Process ImprovementFull time
$80 - $120 per hour
...Position: Biology / environmental science Evaluator Type: Contract... ...Provide clear, structured written feedback to improve AI-generated content. Review documents... ...reputable institution. Application Process (Takes 20–30 mins to complete) Upload...Remote jobContract workSummer workWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Process Improvement Specialist - Evaluator. Be the first to apply!
Related searches
- crisis intervention specialist Toronto, ON
- leasing specialist Toronto, ON
- visual specialist Toronto, ON
- child life specialist Toronto, ON
- lead generation specialist Toronto, ON
- spécialiste en amélioration continue Toronto, ON
- spécialiste paie Toronto, ON
- literacy specialist Toronto, ON
- building performance specialist Toronto, ON
- employment specialist Toronto, ON