Product Launch Expert - Evaluator
$80 - $120 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Product launch / experiment readiness Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI-generated work products.
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Product launch / experiment readiness .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree ( Master's or higher ) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 29 days ago
Similar jobs that could be interesting for youBased on the Product Launch Expert - Evaluator in Toronto, ON vacancy
$80 - $120 per hour
...Larry Summers , and Jack Dorsey . Position: Product management / roadmap / PRD Evaluator Type: Contract Compensation: $80–$120... ...to meet deadlines and ensure high-quality evaluations. Qualifications Must-Have ~5+ years...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Market research / competitive intelligence Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobContract workSummer workWork at officeFlexible hours$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...and Jack Dorsey . Position: Training / onboarding / L&D Evaluator Type: Contract Compensation: $80–$120/hour... ...structured written feedback. Collaborate with subject matter experts to ensure consistency and quality. Work independently and...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Summers , and Jack Dorsey . Position: Cybersecurity / IT GRC Evaluator Type: Contract Compensation: $80–$120/hour... ..., aesthetic, and presentation errors in AI-generated work products . Provide clear, structured written feedback to improve AI...Remote jobContract workSummer workWork at office$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Healthcare / clinical Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
.... Position: Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $80–$120/hour... ...and asynchronously to meet deadlines and ensure high-quality evaluations. Qualifications Must-Have ~5+ years of relevant...Remote jobContract workSummer workWork at office$15 - $20 per hour
...Responsibilities Conduct fact-checking using trusted public sources and external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies. Assess reasoning quality, clarity, tone...Remote jobContract workSummer work$135k - $180k per year
...Andreessen Horowitz to accelerate this mission. About The Role As a Solutions Engineer at EliseAI, you will be integral to our product launch and support processes. You will work closely with clients, support engineers, and customer success managers to ensure smooth...Full timeWork at officeLocal areaRelocation package- ...We are looking for a hands-on leader to build a new centralized Evaluation team. This team will be responsible for providing comprehensive... ...high signal on autonomy performance. - Design scalable production frameworks for sampling evaluation sets, developing and improving...Full time
$50 per hour
...and Jack Dorsey . Position: Internet-Native Bilingual Evaluator Expert (French) Type: Contract Compensation: $50/... ...cultural references, sarcasm, and code-switching. Build evaluation rubrics for bilingual internet communication and define expectations...Remote jobContract workSummer work10 hours per week- ...We are seeking Audio Evaluators to participate in an exciting project focused on evaluating audio clips in English (Pakistani) . This... ...• Apply consistent and objective judgment based on provided evaluation guidelines. • Maintain high quality and timely completion of...Remote jobContract workFreelance
$50 - $125 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Product Design/UX Expert Type: Contract Compensation: $50–$125/... ...: 15+ hours/week Role Responsibilities Evaluate product design decisions using professional experience to enhance...Remote jobContract workSummer work$85 per hour
...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-... ...solutions. Preferred ~ Experience supporting production-scale systems . Compensation & Legal ~$400 per...Remote jobContract workSummer work$70 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Generalist Expert Type: Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to ensure accuracy and depth in reasoning....Remote jobContract workSummer work$85 per hour
...Responsibilities Use frontier AI coding agents to complete and evaluate complex engineering tasks. Review model-generated mobile... ...experience. ~ Experience building and maintaining production iOS applications using Swift and modern iOS frameworks ....Remote jobContract workSummer work- ...looking for diverse, innovative and collaborative candidates who want to impact the world in a positive way. To learn more visit: The Evaluation Algorithms team is responsible for building the algorithms & tooling required to comprehensively evaluate our autonomy system’s...Full timeInternship
$80 - $120 per hour
...Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour... ...to grade outputs. Review and assess AI-generated work products for accuracy, rigor, and domain quality. Work independently...Remote jobContract workSummer workWork at office- ...huge – more categories, more locations and more people. Dyson launched in Canada in 2006 with our headquarters in the heart of Toronto,... ...across the country. At Dyson, we sell by demonstration. Our Experts, Stylists and Retail Strategy and Operations team are Dyson advocates...Hourly payFull timeFlexible hoursWeekend workWeekday work
- ...student base across both regions. We're launching a program for experienced engineers... ...system architecture roles. Many already write production code daily. They will spot shallow... ...of expertise We will bring on three Experts , each focused on one of the following areas...Work at officeRemote workFlexible hours
- ...Role You'll be joining Beacon's Portfolio Product team, a cross-functional group of Product Managers, Engineers, Designers, GTM experts, and Data Scientists. We work directly with... ...roadmap decisions Coordinate feature launches across engineering, sales, marketing, and support...Full time1 day per week
- ...the Role We are seeking an Intermediate Product Manager to help build a best-in-class... ...end-to-end - discovery, delivery, and post-launch iteration Write clear, well-scoped briefs... ...fluency - you define success metrics, evaluate outcomes, and let data inform prioritization...Full timeInternshipWork at officeRemote workFlexible hours
- ...title: Head of Data Governance Products Location: Toronto, ON... ...partners, vendors, and industry experts in the data governance space... ..., including demonstrated launches Technical Expertise... ...activities related to performance evaluation. Information collected and processed...Work at officeWork from home3 days per week
$100k - $125k per year
...subscription commerce platform to sell any product, through any channel, on any device - as... ...: Drive how partners and programs find, evaluate, and connect with each other across PartnerStack... ...data, defining success metrics before launching, and using quantitative signals (...Long term contractPermanent employmentTemporary workWorldwide- ...LotusFlare is a provider of cloud-native SaaS products based in the heart of Silicon Valley.... ...customers and prospects. Plan and lead in the launch of new offerings and services across... ...objectives. Become the subject-matter expert on the Nomad B2B technology stack, including...InternshipWork at officeWorldwideFlexible hours
$140k - $293k per year
...benefits that foster a culture of well-being and connectedness. Learn from deep subject matter experts through mentoring and on the job coaching -- The Role As Head of Product for Healix, you will own the product strategy, roadmap, and commercial trajectory. You are...Permanent employmentContract workFlexible hours$44k per year
...passion to achieve fantastic results. As the Retail Field Sale's Expert, you are the eyes and ears and hands at retail for Reckitt. You... ...skills and requirements: Proven ability to develop positive & productive working relationships Strong written and verbal communication...Full timeContract workFixed term contractMonday to fridayFlexible hours$110k - $150k per year
...Protect. Every single team member, from product & engineering to sales & marketing, finance... ...metrics and establish reporting to evaluate product performance, surface insights, and... ...operational readiness, marketing alignment, and launch execution. Growth & Funnel...Long term contractFull timeRemote workFlexible hours- ...About the Role We are seeking a Senior Product Manager to own and evolve critical areas... ...from opportunity identification through launch and iteration. You'll be expected to operate... ...Use quantitative and qualitative data to evaluate product performance, validate hypotheses,...Long term contractFull timeInternshipWork at officeRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Product Launch Expert - Evaluator. Be the first to apply!
