Product Launch Expert - Evaluator
$80 - $120 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Product launch / experiment readiness Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs.
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines while ensuring domain quality.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Product launch / experiment readiness .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Product Launch Expert - Evaluator in Toronto, ON vacancy
$80 - $120 per hour
...Larry Summers , and Jack Dorsey . Position: Product launch / experiment readiness Evaluator Type: Contract Compensation: $80–$... ...asynchronously to meet deadlines and ensure high-quality evaluations. Qualifications Must-Have ~5+ years...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour... ...clear, structured written feedback to improve AI-generated work products. Apply deep subject-matter expertise to grade outputs for accuracy...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Program management / implementation planning Evaluator Type: Contract... ...presentation errors in AI-generated work products . Provide clear structured written... .... Collaborate with subject matter experts to ensure consistency and quality....SuggestedFull timeContract workSummer workWork at officeRemote work$70 - $100 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type: Contract Compensation: $70–$100/hour Location:...SuggestedRemote jobContract workSummer workInternship$80 - $120 per hour
...Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80$120/hour... ...teams to enhance the accuracy and rigor of AI-generated work products . Work independently and asynchronously to meet deadlines...SuggestedFull timeContract workSummer workWork at officeRemote work$50 - $70 per hour
...Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract... ...Role Responsibilities Review and evaluate documents slides spreadsheets and similar... ...Work independently across common productivity tools with flexible hours . Qualifications...Full timeContract workSummer workRemote workFlexible hours$80 - $120 per hour
...Dorsey . Position: Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $80$120/hour... ...teams to enhance the quality and rigor of AI-generated work products . Work independently and asynchronously to meet deadlines...Full timeContract workSummer workWork at officeRemote work$100 - $150 per hour
...Position: Sales Engineering Expert Type: Contract... ...translating customer requirements into product solutions, delivering... ...supporting proofs of concept, and evaluating product fit and technical... ...experience with AI training , evaluation, or human-data projects....Remote jobContract workSummer work$80 - $120 per hour
...Dorsey . Position: Market research / competitive intelligence Evaluator Type: Contract Compensation: $80–$120/hour... ...clear, structured written feedback to improve AI-generated work products. Apply deep subject-matter expertise in Market research /...Remote jobContract workSummer workWork at office$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/hour... ...independently and asynchronously to meet deadlines while improving evaluation processes. Qualifications Must-Have ~5+ years...Remote jobContract workSummer work$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Healthcare / clinical Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Finance operations / audit support Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role Responsibilities Evaluate...Full timeContract workSummer workWork at officeRemote work$80 - $120 per hour
...General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: IP / trademark / copyright law Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role Responsibilities Evaluate...Full timeContract workSummer workWork at officeRemote work$120 - $170 per hour
...Jack Dorsey . Position: Data Science Expert Type: Contract... ...~ Background in business operations, product, or growth data science at top-tier technology... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$80 - $150 per hour
...Position: UI / UX Design Expert Type: Contract... ...criteria for real-world digital product and UX deliverables . Score... ...independently and asynchronously to evaluate and improve AI model... ...experience with AI training , evaluation, or human-data projects....Remote jobContract workSummer work$70 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+...Remote jobContract workSummer workImmediate start$80 - $150 per hour
..., Larry Summers , and Jack Dorsey . Position: Design Expert Type: Contract Compensation: $80–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobContract workSummer work$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: People ops / recruiting Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$11 - $19 per hour
...Larry Summers and Jack Dorsey . Position: Music & Lyrics Expert - Bengali Type: Contract Compensation: $11$19... ...on quality creativity prompt adherence and originality. Evaluate whether lyrics sound natural including word choice slang and regional...Full timeContract workSummer workImmediate startRemote work$14 per hour
...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract Compensation: $14/... ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other standards...Remote jobContract workSummer workImmediate start$120 - $170 per hour
...Jack Dorsey . Position: Data Science Expert Type: Contract... ...~ Background in business operations, product, or growth data science at top-tier technology... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$60 - $100 per hour
...Jack Dorsey . Position: Marketing Expert — Product Marketing (AI Agent Environments)... ...strong from weak responses. Review and evaluate AI agent attempts against established standards... ...in product marketing, including launches and positioning. Comfortable with...Remote jobContract workSummer work$17 - $54 per hour
..., Larry Summers , and Jack Dorsey . Position: Music Production Expert - French Type: Contract Compensation: $17–$... ...Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music for musicality , creativity , prompt...Remote jobContract workSummer workImmediate startFlexible hours$70 - $80 per hour
...and Jack Dorsey . Position: Design Expert Type: Contract... ...system development, and cross-functional product-design-engineering collaboration. Build... ...centered design principles and heuristic evaluation for Design). Author rubrics that distinguish...Remote jobContract workSummer work$135k - $180k per year
...Andreessen Horowitz to accelerate this mission. About The Role As a Solutions Engineer at EliseAI, you will be integral to our product launch and support processes. You will work closely with clients, support engineers, and customer success managers to ensure smooth...Full timeWork at officeLocal areaRelocation package$50 - $125 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Product Design/UX Expert Type: Contract Compensation: $50–$125/... ...: 15+ hours/week Role Responsibilities Evaluate product design decisions using professional experience to enhance...Remote jobContract workSummer work- ...DAngelo Larry Summers and Jack Dorsey . Position: Sales Representatives Wholesale and Manufacturing Technical and Scientific Products Type: Contract Compensation: $1500/hour Location: Remote Duration: 45 weeks Commitment:...Hourly payFull timeContract workSummer workImmediate startRemote workFlexible hours
$80 - $90 per hour
...include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Product Management Expert Type: Contract Compensation: $80$90/hour Location: Remote Role Responsibilities Construct...Full timeContract workSummer workRemote work$70 - $100 per hour
...Larry Summers , and Jack Dorsey . Position: Office-Suite Experts Type: Contract Compensation: $70–$100/hour... ...Commitment: 10–20+ hours/week Role Responsibilities Evaluate AI-generated office artifacts across Excel , Word , and...Remote jobContract workSummer workWork at officeImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Product Launch Expert - Evaluator. Be the first to apply!
