Product Launch Expert - Evaluator
$80 - $120 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Product launch / experiment readiness Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents , spreadsheets , and slide decks .
- Provide clear, structured written feedback to improve AI model outputs .
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines and ensure high-quality evaluations.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Product launch / experiment readiness .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree ( Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Product Launch Expert - Evaluator in Toronto, ON vacancy
$80 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product management / roadmap / PRD Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at officeFlexible hours$50 - $70 per hour
...Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract... ...Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar... ...Work independently across common productivity tools with flexible hours . Qualifications...SuggestedRemote jobContract workSummer workFlexible hours$80 - $120 per hour
...Jack Dorsey . Position: Finance operations / audit support Evaluator Type: Contract Compensation: $80–$120/hour... ...asynchronously to meet deadlines and improve AI-generated work products. Qualifications Must-Have ~5+ years of relevant...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
.... Position: Healthcare operations Evaluator Type: Contract Compensation... ...errors in AI-generated work products . Provide clear, structured written... ...asynchronously to ensure high-quality evaluations. Qualifications Must-Have...SuggestedRemote jobContract workSummer workWork at office$100 - $150 per hour
...Position: Sales Engineering Expert Type: Contract... ...translating customer requirements into product solutions, delivering... ...supporting proofs of concept, and evaluating product fit and technical... ...experience with AI training , evaluation, or human-data projects....SuggestedRemote jobContract workSummer work$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Media / journalism / communications Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at officeFlexible hours$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobContract workSummer work$14 per hour
...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract Compensation: $14/... ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other standards...Remote jobContract workSummer workImmediate start$80 - $150 per hour
..., Larry Summers , and Jack Dorsey . Position: Design Expert Type: Contract Compensation: $80–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobContract workSummer work$120 - $170 per hour
...Jack Dorsey . Position: Data Science Expert Type: Contract... ...~ Background in business operations, product, or growth data science at top-tier technology... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$80 - $150 per hour
...Position: UI / UX Design Expert Type: Contract... ...criteria for real-world digital product and UX deliverables . Score... ...independently and asynchronously to evaluate and improve AI model... ...experience with AI training , evaluation, or human-data projects....Remote jobContract workSummer work$19 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Bengali Type: Contract Compensation: $11–$... ...on quality, creativity, prompt adherence, and originality. Evaluate whether lyrics sound natural, including word choice, slang, and...Remote jobContract workSummer workImmediate start$70 - $80 per hour
..., Larry Summers , and Jack Dorsey . Position: Design Expert Type: Contract Compensation: $70–$80/hour... ...rapid prototyping, design system development, and cross-functional product-design-engineering collaboration. Build tasks across AI-assisted...Remote jobContract workSummer work- ...Period: 06-Aug-2026 to 20-Aug-2026 Reporting to the Manager, Evaluation and Quality Improvement, the Program Evaluator works collaboratively... ...of program staff, management, senior management and technical experts. ~Credentialed Evaluator designation, is an asset....Hourly payFull timeTemporary workPart timeInternshipMonday to friday
- ...TSYS Deployment Lead Product Launch Conversion & Release Management Required Skills & Responsibilities Deployment Planning & Execution Lead deployment planning and execution for product launches and portfolio conversions from TSYS to TSYS. Own the integrated...Full time
$68k - $72k per year
...work together as a community—and you can be a part of that. Our team is looking to fill a new position of Manager, Planning and Evaluation. This is a full-time position working 35 hours per week anywhere in Canada. Please apply by August 18th, 2026. Discover. Innovate...Full timeInternshipWork at officeFlexible hoursWeekend work$14 - $42 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Hindi Type: Contract Compensation: $14–$42/... ...Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate against detailed...Remote jobContract workSummer workImmediate start$14 per hour
...Jack Dorsey . Position: Music Audio Expert - Punjabi Type: Contract... ...hours/week Role Responsibilities Evaluate AI model output for lyrics and voice generation... ...performance. Develop and refine evaluation standards for AI-generated music ....Remote jobContract workSummer workImmediate start$70 - $100 per hour
...Larry Summers , and Jack Dorsey . Position: Office-Suite Experts Type: Contract Compensation: $70–$100/hour... ...Commitment: 10–20+ hours/week Role Responsibilities Evaluate and compare AI-generated office artifacts in Excel , Word...Remote jobContract workSummer workWork at officeImmediate start$70 per hour
...Jack Dorsey . Position: Generalist Expert Type: Contract... ...Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning... ...detail and accurate application of structured evaluation guidelines. Work independently and...Remote jobContract workSummer work$122k - $192k per year
...Innovations is seeking an experienced DSM Evaluation Manager - EM&V to join our growing team.... ...engineers/analysts, and reviewing work product for client delivery, while ensuring on-time... ...of energy efficiency programs. ~ Expert level understanding of building systems,...Full timeWork at officeLocal area$80 - $120 per hour
...Customer success / support operations Evaluator Type: Contract Compensation... ...feedback to improve AI-generated work products. Apply deep subject-matter expertise... ...meet deadlines and ensure high-quality evaluations. Qualifications Must-Have...Remote jobContract workSummer workWork at office$80k - $180k per year
...work; the Zafin Banking Platform , which helps banks modernize product, pricing, offers, billing, loyalty, and relationship management;... ...responsibly and at scale. What’s the Opportunity? The AI Evaluation Engineer ensures AI agent solutions are accurate, reliable, safe...Full time$90 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product Management Expert Type: Contract Compensation: $80–$90/hour Location: Remote Role Responsibilities Construct...Remote jobContract workSummer work$80 - $120 per hour
...Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: General Sales / GTM Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role Responsibilities Evaluate...Full timeContract workSummer workWork at officeRemote workFlexible hours$85 per hour
...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-... ...solutions. Preferred ~ Experience supporting production-scale systems. Compensation & Legal ~$400 per...Remote jobContract workSummer work$100 - $150 per hour
...machine learning pipelines , and A/B test write-ups . Evaluate AI-generated or human-created work against established criteria... ...consistency. Provide detailed written justifications for evaluations and scores to maintain transparency and accountability. Apply...Remote jobContract workSummer work- ...looking for a strategic and customer-focused Product Manager to help shape the future of our... ...business objectives. Identify, evaluate, and prioritize new product opportunities... ...requirements through development, testing, launch, and post-launch optimization. Manage...Long term contractFull timeContract workFlexible hoursShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Product Launch Expert - Evaluator. Be the first to apply!
