Product Launch Expert - Evaluator
$80 - $120 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Product launch / experiment readiness Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI-generated work products.
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Product launch / experiment readiness .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree ( Master's or higher ) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Product Launch Expert - Evaluator in Toronto, ON vacancy
$177.65k - $209k per year
...victims to get the justice they deserve. Our products enable law firms to secure faster... ...seeking a Senior Product Manager to lead our Launch Experience team, driving the development of... ...and deeply adopted by users. Become the expert on our customers’ legacy systems and how we...SuggestedLong term contractFull timeTemporary workWork at officeLocal areaHome officeFlexible hours3 days per week$80 - $120 per hour
...Summers , and Jack Dorsey . Position: Cybersecurity / IT GRC Evaluator Type: Contract Compensation: $80–$120/hour... ..., aesthetic, and presentation errors in AI-generated work products . Provide clear, structured written feedback to improve AI...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
.... Position: Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $80–$120/hour... ...and asynchronously to meet deadlines and ensure high-quality evaluations. Qualifications Must-Have ~5+ years of relevant...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobContract workSummer workWork at office$15 - $20 per hour
...Responsibilities Conduct fact-checking using trusted public sources and external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies. Assess reasoning quality, clarity, tone...SuggestedRemote jobContract workSummer work$50 - $125 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Product Design/UX Expert Type: Contract Compensation: $50–$125/... ...: 15+ hours/week Role Responsibilities Evaluate product design decisions using professional experience to enhance...Remote jobContract workSummer work$70 - $100 per hour
...Larry Summers , and Jack Dorsey . Position: Office-Suite Experts Type: Contract Compensation: $70–$100/hour... ...Commitment: 20–40 hours/week Role Responsibilities Evaluate AI-generated office artifacts in Excel , Word , and PowerPoint...Remote jobContract workSummer workWork at officeImmediate start$60 per hour
...Jack Dorsey . Position: Generalist Expert Type: Contract... ...Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning... ...and downstream performance. Develop evaluation rubrics and benchmarks for assessing AI...Remote jobContract workSummer work$80 - $120 per hour
...Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour... ...to grade outputs. Review and assess AI-generated work products for accuracy, rigor, and domain quality. Work independently...Remote jobContract workSummer workWork at office- ...names. About the Role As a luxury brand evaluator, you will step into the world of luxury... ..., purchasing online, or returning a product, your voice shapes the future of luxury.... ...market. Compensation • Non-Purchase Evaluations: Earn a fee based on mission complexity....Contract workWorldwideFlexible hours
$80 - $120 per hour
..., Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$122k - $192k per year
...Innovations is seeking an experienced DSM Evaluation Manager - EM&V to join our growing team.... ...engineers/analysts, and reviewing work product for client delivery, while ensuring on-time... ...of energy efficiency programs. ~ Expert level understanding of building systems,...Full timeWork at officeLocal area- ...is currently recruiting Freelance Brand Experts to join the team. This position will be part... ...in store. Always representing the ethos, products, and image of Charlotte Tilbury. Working... ...~ Assist with visual merchandising, new launch displays, and collateral placement through...Hourly payFreelance
- Accounting & Finance Expert (AI Training)About The RoleWhat if your expertise in accounting... ...controllers, and finance professionals — to evaluate and improve AI-generated finance content,... ...for ongoing work and contract extension as new finance-focused projects launchOngoing contractContract workRemote workFlexible hours
- ...physical world? We're looking for Robotics ML Experts in Canada's vibrant AI research hub to... ...dynamics, and scene configurations Evaluate trained policies for stability, generalization... ...Potential for ongoing work and contract extension as new projects launch...Hourly payOngoing contractContract workFreelanceRemote workFlexible hours
$65 per hour
...to me at (***) ***-****. Job Title AI Product Manager Location Toronto 4 days a... ...product execution from discovery through launch managing feature prioritization testing rollout... ...Data driven mindset familiar with system evaluation monitoring and optimization Experience...Contract work- ...diverse range of perspectives is a requirement for building great products. Join us on our mission and shape the future! Why this role? As a Member of Technical Staff in Data Analysis and Evaluation, you will play a pivotal role in ensuring the quality, reliability,...Full timeWork at officeRemote workFlexible hours
$10k per year
...Informatics (MHI) Sessional Dates of Appointment: Fall 2026, September to December Existing Vacancy: Yes Course Title: MHI2009H: Evaluation Methods for Health Informatics Course Description: There is little debate that health information systems have...Long term contract$140k - $160k per year
...Role: Sr Product Manager Location: Downtown Toronto (hybrid)... ...features move from discovery to launch. We've built a platform that... ...scoped, how AI capabilities are evaluated, and how the roadmap is... ...areas Build and maintain evaluation frameworks for AI features -...Full timeContract workWork at office- ...Overview Help shape how AI understands and speaks Canadian French. We're launching a short-term project that needs Canadian French speakers based in Canada to review, rewrite, and create French text that trains AI language models. You'll work from home on a flexible...Remote jobContract workTemporary workFreelanceLocal areaImmediate startWork from homeFlexible hours
- ...Position: Retail Banking Expert Type: Contract... ...Responsibilities Review and evaluate AI-generated outputs related... ...TILA , RESPA , BSA/AML ), product terms, and industry-specific terminology... ...with research teams to refine evaluation frameworks for banking-domain...Remote jobHourly payContract workSummer work
$89.7 - $107.67 per hour
...RQ11107 - Sr. Product Manager 1-year contract (246 business days... ...lifecycle from its inception to launch Extensive experience... ...product management team members Evaluate promotional plans to ensure that... ...and samples becoming an expert with respect to the competition...Contract workInternship- ...they do. We believe that a diverse range of perspectives is a requirement for building great products. Join us on our mission and shape the future! Why this role? Evaluation is critical to making progress in scaling intelligence. As models continue to become superhuman...Full timeWork at officeRemote workFlexible hours
$70 - $100 per hour
..., Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: STEM Computational Scientific Software & Evaluation Design - Astrophysics & Cosmology Type: Contract Compensation: $70–$100/hour Location: Remote Commitment...Remote jobContract workSummer work- ...meaningful because the work we do matters. Join us! Job Summary The Expert, Data Engineering is responsible to lead/mentor a team of... ...managing, and optimizing data pipelines, moving them effectively into production for key data and analytics consumers, shaping the enterprise...Full timeWork at officeRemote workMonday to friday
- ...possible, you belong on #TeamBell. Summary As a Product Owner, you will support one or more teams within our Agile Release... ...all phases of project and feature delivery: define, develop, test, launch, and support. You will take a design thinking approach to...Full timeWork at officeFlexible hoursAfternoon shift3 days per week
- ...life around twice per week. As a Senior Product Marketing Manager, you are responsible... ...strong market research practice. Be the expert in what motivates our buyers, what they... ...select our targeting criteria Product Launches: Measures of Success: A formalized,...Full timeWork at officeRemote workWork from home
- ...Manager, Product Design Location: Office-based/Hybrid - Toronto, Canada Team... ...Engineering to shape how users discover, evaluate, and purchase our products – from first touchpoint... ...solution — through research, usability evaluation, and talking to real users. Delivery...Daily paidFull timeApprenticeshipWork at officeLocal areaWorldwide
$140k - $160k per year
...Senior Product Manager ABOUT ODAIA ODAIA noun o·da·ia | \ 'oh-day-yeah \ An Ancient... ...and addressed early. Support post-launch activities, ensuring teams are successfully... ...planning, coordination, and post-release evaluation Balance long-term platform health with...Long term contractFull timeTemporary workInternshipWork at officeLocal areaImmediate startRemote workWork from homeFlexible hours- ...remote contractor role, you will work as an SEO & Digital Marketing Subject Matter Expert (SME) to review AI-generated SEO/marketing outputs and/or create expert digital marketing content, evaluating reasoning quality, strategy fit, and step-by-step decision-making while...Hourly payContract workPart timeFor contractorsImmediate startRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Product Launch Expert - Evaluator. Be the first to apply!
