L&D Evaluator - Training Expert
$80 - $120 per hourMercor
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Training / onboarding / L&D Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors.
- Provide clear, structured written feedback.
- Apply deep subject-matter expertise to grade outputs.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- 5+ years of relevant professional experience in Training / onboarding / L&D .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree ( Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$80 - $120 per hour
...Jack Dorsey . Position: Product management / roadmap / PRD Evaluator Type: Contract Compensation: $80–$120/hour... ...model outputs. Collaborate with AI research teams to enhance training data quality. Work independently and asynchronously to meet...TrainingRemote jobContract workSummer workWork at officeFlexible hours$80 - $120 per hour
...Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour... ...model outputs. Collaborate with AI research teams to enhance training data quality. Work independently and asynchronously to meet...TrainingRemote jobContract workSummer workWork at officeFlexible hours$80 - $120 per hour
...Jack Dorsey . Position: Government / public administration Evaluator Type: Contract Compensation: $80–$120/hour... ...outputs . Collaborate with AI research teams to enhance training data quality. Work independently and asynchronously to meet...TrainingRemote jobContract workSummer workWork at office$100 - $150 per hour
...Dorsey . Position: Sales Engineering Expert Type: Contract... ...objections, supporting proofs of concept, and evaluating product fit and technical risk. ~ Hands... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...TrainingRemote jobContract workSummer work$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/... ...judgment. Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20...TrainingRemote jobContract workSummer work$80 - $120 per hour
...Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour... .... Collaborate asynchronously to ensure high-quality evaluations. Work independently to meet deadlines and improve AI model...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at officeFlexible hours$80 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: Design Expert Type: Contract Compensation: $80–$150/hour... ...reviewed. Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20...TrainingRemote jobContract workSummer work$14 per hour
...Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract... ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation... ...quality. Score the quality of musical training data to ensure high standards in model...TrainingRemote jobContract workSummer workImmediate start$80 - $120 per hour
...Summers , and Jack Dorsey . Position: Healthcare operations Evaluator Type: Contract Compensation: $80–$120/hour... ...Work independently and asynchronously to ensure high-quality evaluations. Qualifications Must-Have ~5+ years of...Remote jobContract workSummer workWork at office$50 - $70 per hour
...Larry Summers , and Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation: $50–$... ...Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for...Remote jobContract workSummer workFlexible hours$120 - $170 per hour
...Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour... ...against peers. Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20...TrainingRemote jobContract workSummer work$80 - $150 per hour
...Dorsey . Position: UI / UX Design Expert Type: Contract... ...independently and asynchronously to evaluate and improve AI model performance .... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application...TrainingRemote jobContract workSummer work$19 per hour
...Dorsey . Position: Music & Lyrics Expert - Bengali Type: Contract... ...prompt adherence, and originality. Evaluate whether lyrics sound natural, including word... ...listening. Preferred Formal training in music performance , theory, or composition...TrainingRemote jobContract workSummer workImmediate start$68k - $72k per year
...team is looking to fill a new position of Manager, Planning and Evaluation. This is a full-time position working 35 hours per week... ...(is considered an asset). ~ Has formal project management training or certification (is considered an asset). Benefits What...TrainingFull timeInternshipWork at officeFlexible hoursWeekend work- ...Period: 06-Aug-2026 to 20-Aug-2026 Reporting to the Manager, Evaluation and Quality Improvement, the Program Evaluator works collaboratively... ...of program staff, management, senior management and technical experts. ~Credentialed Evaluator designation, is an asset....Hourly payFull timeTemporary workPart timeInternshipMonday to friday
$14 - $42 per hour
...Dorsey . Position: Music & Lyrics Expert - Hindi Type: Contract Compensation... .../week Role Responsibilities Evaluate AI-generated music across various genres.... ...listening. Preferred Formal training in music performance, theory, or...TrainingRemote jobContract workSummer workImmediate start$14 per hour
...Position: Music Audio Expert - Punjabi Type: Contract... ...Role Responsibilities Evaluate AI model output for lyrics... ...Score the quality of musical training data to enhance model performance... .... Develop and refine evaluation standards for AI-generated...TrainingFull timeContract workSummer workImmediate startRemote work$70 per hour
.... Position: Generalist Expert Type: Contract... ...Role Responsibilities Evaluate AI-generated responses to strengthen... ...written feedback to improve training data quality and downstream... ...application of structured evaluation guidelines. Work...TrainingRemote jobContract workSummer work$64.2k - $114.2k per year
...days a week in the office. The Senior Training & Quality Consultant – Programs & Affinity... ...with key stakeholders to update and work on L&D initiatives aligned to business strategy.... ...service standards. Serve as a subject matter expert on quality assurance matters, providing...TrainingMinimum wageWork at officeLocal areaRemote workFlexible hours3 days per week1 day per week$110k - $150k per year
...understand transport networks and what moves people. From high-speed trains, metros, monorails, and trams, to turnkey systems, services,... ...work closely with teams across the business (including technical experts, test and commissioning teams), foster cross-functional collaboration...Long term contractFull timeWorldwideFlexible hours$70 - $100 per hour
...Larry Summers , and Jack Dorsey . Position: Office-Suite Experts Type: Contract Compensation: $70–$100/hour... ...Commitment: 10–20+ hours/week Role Responsibilities Evaluate and compare AI-generated office artifacts in Excel , Word...Remote jobContract workSummer workWork at officeImmediate start$90k - $125k per year
...mobility solutions that provide the sustainable foundations for the future of transportation. Our product portfolio ranges from high-speed trains, metros, monorails, and trams to integrated systems, customized services, infrastructure, signalling and digital mobility solutions....TrainingLong term contractFull timeLocal areaWorldwideShift work$122k - $192k per year
...Resource Innovations is seeking an experienced DSM Evaluation Manager - EM&V to join our growing team. As a DSM Evaluation Manager - EM... ...experience with impact evaluation of energy efficiency programs. ~ Expert level understanding of building systems, energy end uses and...Full timeWork at officeLocal area$80k - $180k per year
...re building the platforms that help regulated organizations adopt AI responsibly and at scale. What’s the Opportunity? The AI Evaluation Engineer ensures AI agent solutions are accurate, reliable, safe, and production-ready within regulated banking environments. The role...Full time$80 - $120 per hour
...Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: General Sales / GTM Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role Responsibilities Evaluate...Full timeContract workSummer workWork at officeRemote workFlexible hours$100 - $150 per hour
...machine learning pipelines and A/B test write-ups . Evaluate AI-generated or human-created work against established criteria... ...consistency. Provide detailed written justifications for evaluations and scores to maintain transparency and accountability. Apply...Full timeContract workSummer workRemote work$80 - $120 per hour
...Dorsey . Position: Customer success / support operations Evaluator Type: Contract Compensation: $80–$120/hour... ...and asynchronously to meet deadlines and ensure high-quality evaluations. Qualifications Must-Have ~5+ years of relevant...Remote jobContract workSummer workWork at office$61k - $90k per year
...the role In this role, you will design and deliver engaging training programs, learning materials, and communications that support employee... ...for new and tenured employees where required and develop and evaluate training outcomes. Works closely with leadership and team...TrainingFull timeWork at officeFlexible hours- ...and conviction behind what we’re building. About the Platform Expert role When a customer hits a wall inside Motion, you're the... ...it than anyone at Motion. The downtime in between, you spend training Fin and Runneth (our AI agents) + building new systems. Joel, one...TrainingPermanent employmentFull timeSummer workInternshipWork at officeRemote workWork from homeNight shift
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to L&D Evaluator - Training Expert. Be the first to apply!
- test evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- estimateur structure Toronto, ON
- remote social media evaluator Toronto, ON
- chargé de projet estimateur Toronto, ON
- estimateur en bâtiment Toronto, ON
- admissions evaluator Toronto, ON
- estimateur automobile Toronto, ON
- expert batiment Toronto, ON
- expert automobile Toronto, ON

