Product Launch Expert - Evaluator
$80 - $120 per hourMercor
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Product launch / experiment readiness Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents , spreadsheets , and slide decks .
- Provide clear, structured written feedback to improve AI model outputs .
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines and ensure high-quality evaluations.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Product launch / experiment readiness .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree ( Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product launch / experiment readiness Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at office$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $100–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a software engineering...SuggestedContract workSummer workWork at officeRemote work$100 - $150 per hour
...Position: Sales Engineering Expert Type: Contract... ...translating customer requirements into product solutions, delivering... ...supporting proofs of concept, and evaluating product fit and technical... ...experience with AI training , evaluation, or human-data projects....SuggestedFull timeContract workSummer workRemote work$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedFull timeContract workSummer workWork at officeRemote workFlexible hours$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedFull timeContract workSummer workWork at officeRemote work$60 - $80 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type: Contract Compensation: $60–$80/hour Location:...Hourly payFull timeContract workFor contractorsSummer workRemote work$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Customer success / support operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Full timeContract workSummer workWork at officeRemote work$80 - $160 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Product / Platform Experts Type: Contract Compensation: $80–$160/... ...strong analytical skills to contribute to high-impact evaluation projects. Collaborate asynchronously with teams across...Full timeContract workSummer workRemote work$135k - $180k per year
...Andreessen Horowitz to accelerate this mission. About The Role As a Solutions Engineer at EliseAI, you will be integral to our product launch and support processes. You will work closely with clients, support engineers, and customer success managers to ensure smooth...Full timeWork at officeLocal areaRelocation package- ...Contract Compensation: $80–$100/file Role Responsibilities Share task lists, checklists , or exports from productivity apps like Todoist , Apple Reminders , or Notion . Provide lists with priorities, due dates, categories, or completion statuses...Full timeContract workSummer work
$70 - $80 per hour
..., Larry Summers , and Jack Dorsey . Position: Design Expert Type: Contract Compensation: $70–$80/hour... ...rapid prototyping, design system development, and cross-functional product-design-engineering collaboration. Build tasks across AI-assisted...Full timeContract workSummer workRemote work$80 - $90 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product Management Expert Type: Contract Compensation: $80–$90/hour Location: Remote Role Responsibilities Construct...Full timeContract workSummer workRemote work- ...Position: Product Manager Location: Toronto, ON... ...effectively. Drive product launches and coordinate with cross-functional stakeholders. Evaluate promotional plans to ensure alignment... ...Digital provides the IT Experts you need that solve problems and...Full time
$100 - $150 per hour
...Jack Dorsey . Position: Finance Expert Type: Contract Compensation... ...Remote Role Responsibilities Evaluate AI-generated artifacts for usability in... ...deadlines while enhancing AI-generated work products . Qualifications Must-Have...Remote jobContract workSummer workWork at office$50 per hour
...Position: English Language and Literature Expert Type: Contract... ...Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated... ...writing, linguistic annotation, language evaluation, or NLP data work in English. Strong...Remote jobContract workSummer work$80 - $120 per hour
...Dorsey . Position: Data analysis / quantitative readouts Evaluator Type: Contract Compensation: $80–$120/hour... ...clear, structured written feedback to improve AI-generated work products. Apply deep subject-matter expertise to grade outputs for accuracy...Remote jobContract workSummer workWork at office$70 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+...Remote jobContract workSummer workImmediate start$80 - $120 per hour
..., Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$14 - $42 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Hindi Type: Contract Compensation: $14–$42/... ...Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate against detailed...Full timeContract workSummer workImmediate startRemote work$70 - $100 per hour
...Larry Summers , and Jack Dorsey . Position: Office-Suite Experts Type: Contract Compensation: $70–$100/hour... ...Commitment: 20–40 hours/week Role Responsibilities Evaluate AI-generated office artifacts in Excel , Word , and...Full timeContract workSummer workWork at officeImmediate startRemote work$50 - $70 per hour
...Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract... ...Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar... ...Work independently across common productivity tools with flexible hours . Qualifications...Remote jobContract workSummer workFlexible hours$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobContract workSummer work$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/hour... ...independently and asynchronously to meet deadlines while improving evaluation processes. Qualifications Must-Have ~5+ years...Remote jobContract workSummer work$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at officeFlexible hours$14 per hour
...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract Compensation: $14/... ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other standards...Remote jobContract workSummer workImmediate start$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Healthcare / clinical Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $150 per hour
..., Larry Summers , and Jack Dorsey . Position: Design Expert Type: Contract Compensation: $80–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobContract workSummer work$80 - $150 per hour
...Dorsey . Position: UI / UX Design Expert Type: Contract Compensation... ...grading criteria for real-world digital product and UX deliverables . Score AI-... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$120 - $170 per hour
...Jack Dorsey . Position: Data Science Expert Type: Contract... ...~ Background in business operations, product, or growth data science at top-tier technology... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$120 - $170 per hour
...Jack Dorsey . Position: Data Science Expert Type: Contract... ...~ Background in business operations, product, or growth data science at top-tier technology... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Product Launch Expert - Evaluator. Be the first to apply!

