Product Launch Expert - Evaluator
$80 - $120 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Product launch / experiment readiness Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI-generated work products.
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Product launch / experiment readiness .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree ( Master's or higher ) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Product Launch Expert - Evaluator in Toronto, ON vacancy
$80 - $120 per hour
...Larry Summers , and Jack Dorsey . Position: Product management / roadmap / PRD Evaluator Type: Contract Compensation: $80–$120... ...to meet deadlines and ensure high-quality evaluations. Qualifications Must-Have ~5+ years...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Market research / competitive intelligence Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobContract workSummer workWork at officeFlexible hours$80 - $120 per hour
...and Jack Dorsey . Position: Training / onboarding / L&D Evaluator Type: Contract Compensation: $80–$120/hour... ...structured written feedback. Collaborate with subject matter experts to ensure consistency and quality. Work independently and...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Summers , and Jack Dorsey . Position: Cybersecurity / IT GRC Evaluator Type: Contract Compensation: $80–$120/hour... ..., aesthetic, and presentation errors in AI-generated work products . Provide clear, structured written feedback to improve AI...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$15 - $20 per hour
...Responsibilities Conduct fact-checking using trusted public sources and external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies. Assess reasoning quality, clarity, tone...Remote jobContract workSummer work$80 - $120 per hour
.... Position: Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $80–$120/hour... ...and asynchronously to meet deadlines and ensure high-quality evaluations. Qualifications Must-Have ~5+ years of relevant...Remote jobContract workSummer workWork at office- ...TSYS Deployment Lead Product Launch Conversion & Release Management Required Skills & Responsibilities Deployment Planning & Execution Lead deployment planning and execution for product launches and portfolio conversions from TSYS to TSYS. Own the integrated...Full time
$122k - $192k per year
...Innovations is seeking an experienced DSM Evaluation Manager - EM&V to join our growing team.... ...engineers/analysts, and reviewing work product for client delivery, while ensuring on-time... ...of energy efficiency programs. ~ Expert level understanding of building systems,...Full timeWork at officeLocal area- Job Responsibility: Job title: HR Administrator Status: Full time, 35 hours per week Start Date: As soon as possible Reports to: Finance Manager Posting Date: April 25 Reference Number: CLNU-2025-06 Deadline to apply: Open till filled CultureLink Settlement...Full timeImmediate startMonday to fridayShift work
$80k - $180k per year
...work; the Zafin Banking Platform , which helps banks modernize product, pricing, offers, billing, loyalty, and relationship management;... ...responsibly and at scale. What’s the Opportunity? The AI Evaluation Engineer ensures AI agent solutions are accurate, reliable, safe...Full time$50 per hour
...and Jack Dorsey . Position: Internet-Native Bilingual Evaluator Expert (French) Type: Contract Compensation: $50/... ...cultural references, sarcasm, and code-switching. Build evaluation rubrics for bilingual internet communication and define expectations...Remote jobContract workSummer work10 hours per week$110k - $125k per year
...we believe the most important products of the next decade haven't... ...of AI-enabled experiences. We launch new products to market through... ...you’ll lead a team of product experts and be the go-to authority... ...human judgment. All interviews, evaluations, and hiring decisions are...Full timeWork at officeRemote work$86.34k per year
...Professional Practice & Quality Assurance, Health & Wellness, the Program Evaluation and Quality Improvement Coordinator provides direct research... ...(Outlook, Word, Excel, PowerPoint, Access - intermediate to expert). Proficient with SPSS (ANOVA, MANOVA, regression, etc.)....Full timeCasual workWork at office$120k - $140k per year
...we believe the most important products of the next decade haven't been... ...of AI-enabled experiences. We launch new products to market through... .... You'll be the go-to expert for analytics implementation,... ...human judgment. All interviews, evaluations, and hiring decisions are made...Long term contractFull timeWork at office$37.85 - $47.31 per hour
...structured interview administration, data input and analysis and report production; providing functional supervision for research assistant;... ...staff. Duties Plan and execute technology evaluation studies using validated frameworks such as the Technology Acceptance...Hourly payLong term contractRemplacementFull timeContract workTemporary workInternshipFlexible hours- ...Job Title: Product Owner Company: Green Tank Technologies Corp. (“Greentank”) Location: Toronto, ON (Liberty Village) Reporting... ...throughout the lifecycle, from concept through post-launch evaluation. Define and maintain success criteria, market positioning,...Long term contractFull timeInternshipWork at officeFlexible hours
$100k - $140k per year
...doubling revenue year over year. Founded by experts who’ve experienced the claims process... ...mission-driven team building intelligent products that cut through complexity, accelerate... ...confident in delivering it. From roadmap to launch to adoption, you’ll ensure our story is...Casual workInternshipImmediate startFlexible hours- ...construire. Nous pensons que les processus d’admission aux études supérieures ont un mandat d’aller au-delà des notes académiques, et d’évaluer le potentiel du candidat en considérant la personne dans son entièreté : son expérience personnelle, ses forces et ses qualités...Contract workApprenticeshipCasual workWork at officeFlexible hoursDay shift
- ...Role You'll be joining Beacon's Portfolio Product team, a cross-functional group of Product Managers, Engineers, Designers, GTM experts, and Data Scientists. We work directly with... ...roadmap decisions Coordinate feature launches across engineering, sales, marketing, and support...Full time1 day per week
- ...the Role We are seeking an Intermediate Product Manager to help build a best-in-class... ...end-to-end - discovery, delivery, and post-launch iteration Write clear, well-scoped briefs... ...fluency - you define success metrics, evaluate outcomes, and let data inform prioritization...Full timeInternshipWork at officeRemote workFlexible hours
- ...student base across both regions. We're launching a program for experienced engineers... ...system architecture roles. Many already write production code daily. They will spot shallow... ...of expertise We will bring on three Experts , each focused on one of the following areas...Work at officeRemote workFlexible hours
$85 per hour
...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-... ...solutions. Preferred ~ Experience supporting production-scale systems . Compensation & Legal ~$400 per...Remote jobContract workSummer work- ...We are seeking Audio Evaluators to participate in an exciting project focused on evaluating audio clips in English (Pakistani) . This... ...• Apply consistent and objective judgment based on provided evaluation guidelines. • Maintain high quality and timely completion of...Remote jobContract workFreelance
$70 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Generalist Expert Type: Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to ensure accuracy and depth in reasoning....Remote jobContract workSummer work$80 - $120 per hour
...Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour... ...to grade outputs. Review and assess AI-generated work products for accuracy, rigor, and domain quality. Work independently...Remote jobContract workSummer workWork at office- ...huge – more categories, more locations and more people. Dyson launched in Canada in 2006 with our headquarters in the heart of Toronto,... ...across the country. At Dyson, we sell by demonstration. Our Experts, Stylists and Retail Strategy and Operations team are Dyson advocates...Hourly payFull timeFlexible hoursWeekend workWeekday work
- ...loyal audiences, live operations, content, product innovation, and a deep understanding of... ...prioritization, execution, measurement, and post-launch learning. ● Bring structure, clarity,... ...to roadmap planning, feature evaluation, live operations planning, and product decision...Long term contractFull timeCasual workWork at office
- ...TEHORA est présentement à la recherche d’un(e) Technicien(ne) en informatique expert afin de contribuer aux orientations techniques et à la stabilité des environnements TI. La personne retenue jouera un rôle stratégique en tant que référence technique sur des environnements...Hourly payContract workApprenticeshipRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Product Launch Expert - Evaluator. Be the first to apply!
