Nonprofit Evaluator - Program Specialist
$80 - $120 per hourMercor
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Nonprofit / philanthropy / community programs Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in outputs.
- Provide clear, structured written feedback to improve AI-generated work products.
- Collaborate with teams to ensure accuracy and rigor in AI-generated documents, spreadsheets, and slide decks.
- Work independently and asynchronously to meet deadlines and enhance domain quality.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Nonprofit / philanthropy / community programs.
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace, especially Slides .
Preferred
- Advanced degree ( Master's or higher ) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on jobs.jobcopilot.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$50 - $100 per hour
...Larry Summers , and Jack Dorsey . Position: Nonprofit / community / philanthropy (Meridian) Type:... ...Responsibilities Design LLM prompts and evaluate model outputs for nonprofit and community programs. Develop rubric style tasks to assess the...SuggestedFull timeContract workSummer workRemote work$80 - $120 per hour
...Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role...SuggestedFull timeContract workSummer workWork at officeRemote work$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at office$70k - $73.85k per year
...2026 at 5:00 pm and this posting is for an existing vacancy. Objective: The Research and Evaluation Specialist will lead the analysis and development of sector-based program and policy research and evaluation that will enhance Friendship Centre advocacy priorities....SuggestedFull timeInternship$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: General Sales / GTM Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedFull timeContract workSummer workWork at officeRemote workFlexible hours$80 - $150 per hour
..., and Jack Dorsey . Position: MS Excel / Google Sheets Evaluator Type: Contract Compensation: $80–$150/hour... ...relevance. Provide structured feedback to enhance document evaluation processes. Utilize MS Excel and Google Slides to perform...Full timeContract workSummer workRemote work$90 per hour
...impact. ~ Professional written English for task justification. Preferred Prior RLHF , preference-labeling, model-evaluation, or structured code-review work. Pixel-perfect design-to-code experience. Accessibility expertise ( ARIA , semantic...Full timeContract workSummer workLocal areaRemote work$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Full timeContract workSummer workWork at officeRemote work$15 - $20 per hour
...Responsibilities Conduct fact-checking using trusted public sources and external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies. Assess reasoning quality, clarity, tone...Full timeContract workSummer workRemote work$65k - $72k per year
...celebrate different perspectives, experiences, and voices. The Program Specialist is responsible for the planning, coordination, and execution... ...concept and planning through to execution and post-program evaluation. Manage multiple concurrent programs including Leadership...Long term contractFull timeWork at officeRemote work$80 - $120 per hour
...Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role...Full timeContract workSummer workWork at officeRemote work$70 - $100 per hour
...Compensation: $70–$100/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities Evaluate AI-generated office artifacts in Excel , Word , and PowerPoint formats. Perform side-by-side comparisons of two candidate...Full timeContract workSummer workWork at officeImmediate startRemote work$14 - $42 per hour
...Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate against detailed quality standards. Compare AI-generated lyrics with published songs...Full timeContract workSummer workImmediate startRemote work$25 - $45 per hour
...25–$45/hour Location: Remote Role Responsibilities Evaluate AI-generated written conversations using predefined rubrics to enhance performance. Draft and refine evaluation rubrics for generalist writing tasks. Apply structured scoring...Full timeContract workSummer workRemote work$52.72k - $62.61k per year
...their employment with Mitacs. The Program Development Team is responsible for designing... ...the Manager, Program Development, the Specialist will support the review, design and... ...collaborate with other business units to pilot and evaluate new program & skills partnership...Remote jobFull timeTemporary work$25 - $35 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Model Evaluation Contractor Type: Contract Compensation: $25–$35/hour Commitment: 20 hours/week Role Responsibilities...Full timeContract workFor contractorsSummer work$35 - $55 per hour
...Dorsey . Position: K-12 Education Specialist Type: Contract... ...Role Responsibilities Review and evaluate AI-generated outputs related to lesson... ...asynchronously with research teams to refine evaluation frameworks for K-12 education AI ....Full timeContract workSummer workRemote work$73 per hour
...Larry Summers , and Jack Dorsey . Position: Chemistry AI Evaluator Type: Contract Compensation: $73/hour... ...of explanations for different audiences. Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed...Full timeContract workSummer workRemote work$70 - $100 per hour
...Compensation: $70–$100/hour Location: Remote Commitment: 10–20+ hours/week Role Responsibilities Evaluate AI-generated office artifacts across Excel , Word , and PowerPoint formats. Perform pairwise comparisons of candidate responses...Remote jobContract workSummer workWork at officeImmediate start$51.04k per year
...Insight Strategy and using our Membership Involvement Model, the Program Specialist identifies initiatives to increase Membership on Roll,... ...In this role, you will: Develop, implement, monitor and evaluate processes and systems impacting the experience of members in...Long term contractFull timeContract workTemporary workAfternoon shift$70 - $100 per hour
...PowerPoint (.pptx) formats. Perform side-by-side pairwise comparisons of two candidate responses and select the stronger one. Evaluate both the content and rendering of each document—layout, formatting, visual structure, formulas, and overall presentation against the...Remote jobContract workSummer workWork at officeImmediate start$80k per year
...As a Program Specialist, you will help shape the future of K–12 learning by designing innovative, research-informed, and classroom-relevant educational experiences. Reporting to the VP, Content & Curriculum, you will partner closely with subject-area Product Managers and cross...Long term contractFull timeTemporary workSummer workWork at officeLocal areaRemote workFlexible hours$70 - $100 per hour
...Compensation: $70–$100/hour Location: Remote Commitment: 10–20+ hours/week Role Responsibilities Evaluate and compare AI-generated office artifacts in Excel , Word , and PowerPoint formats. Perform side-by-side comparisons of...Remote jobContract workSummer workWork at officeImmediate start$120 - $170 per hour
...comfortable having your judgment reviewed and calibrated against peers. Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30 mins to complete) Submit your resume or relevant technical...Remote jobContract workSummer work$60 - $100 per hour
...Responsibilities Design task briefs based on real-world creator programs, focusing on planted issues and decisions a strong practitioner... ...plausible-but-wrong ones. Review AI agent attempts and evaluate them against established standards. Evaluate AI-generated...Full timeContract workSummer workRemote work$76.8k - $96k per year
...limitless opportunities for success! About the Role We are seeking a Customer Advocacy Marketing Lead to execute and manage programs that engage, grow, and amplify our network of customer advocates. This role will focus on developing relationships with key customers...Full timeWorldwide$50 - $70 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Engineering Program Specialist Type: Full-Time Compensation: $50–$70/hour Location: Remote Role Responsibilities...Full timeSummer workRemote work- ...As an Engineering Program Specialist, you will partner with Technical Program Managers to deliver hardware to cross-functional teams on time to support product development. This role requires strong communication skills and attention to detail, as you will work with large cross...Long term contractFull timeFixed term contractFreelance
- ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Reinsurance & Program Business Specialist Type: Contract Compensation: $800/hour Location: Remote Commitment: 20–40 hours/week...Full timeContract workSummer workImmediate startRemote work
$80 - $120 per hour
...and Jack Dorsey . Position: Humanities / arts / culture Evaluator Type: Contract Compensation: $80–$120/hour... ...Work independently and asynchronously to ensure high-quality evaluations. Collaborate with AI research teams to enhance training...Remote jobContract workSummer workWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Nonprofit Evaluator - Program Specialist. Be the first to apply!
- admissions evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- test evaluator Toronto, ON
- estimateur automobile Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur en bâtiment Toronto, ON
- chargé de projet estimateur Toronto, ON
- estimateur structure Toronto, ON
- crisis intervention specialist Toronto, ON
- leasing specialist Toronto, ON
