AI Evaluator - Software Expert
$80 - $120 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Software / AI / IT / data Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in outputs.
- Provide clear, structured written feedback to improve quality.
- Work independently and asynchronously to meet deadlines.
- Utilize expertise in Microsoft Office and Google Workspace , especially Slides .
Qualifications
Must-Have
- 5+ years of relevant professional experience in Software / AI / IT / data .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree ( Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Evaluator - Software Expert in Toronto, ON vacancy
$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Angelo , Larry Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/...SoftwareRemote jobContract workSummer workWork at office$70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... .... Position: Mathematics PhD Coding Experts Type: Contract Compensation... ...-reviewed journals. Prior scientific software or research engineering experience. Start...SoftwareFull timeContract workSummer workImmediate startRemote work$120 - $170 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Data Science Expert Type: Contract Compensation... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...SuggestedRemote jobContract workSummer work$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Position: Sales Engineering Expert Type: Contract... ...supporting proofs of concept, and evaluating product fit and technical risk... ...with technically complex B2B software — SaaS , cloud infrastructure...SoftwareFull timeContract workSummer workRemote work$60 - $80 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type:...SuggestedHourly payFull timeContract workFor contractorsSummer workRemote work- ...Freelance English to Turkish Software Localization MT/LLM Evaluator Remote | US, Canada & Latin America Time Zones Are you a... ...specialists, MTPE professionals, and language quality experts who want to work on cutting-edge AI and machine translation initiatives while...SoftwareLong term contractFor contractorsFreelanceRemote workWorldwideFlexible hours
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Dorsey . Position: Customer success / support operations Evaluator Type: Contract Compensation: $80–$120/hour...Full timeContract workSummer workWork at officeRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Healthcare operations Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Program management / implementation planning Evaluator Type: Contract Compensation... ...asynchronously to ensure high-quality evaluations. Qualifications Must-Have...Remote jobContract workSummer workWork at office$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation... ...asynchronously to meet deadlines while improving evaluation processes. Qualifications Must-...Remote jobContract workSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Position: Real estate / hospitality / events Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at office$25 - $35 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., Larry Summers , and Jack Dorsey . Position: AI Model Evaluation Contractor Type: Contract Compensation: $25–$35...Full timeContract workFor contractorsSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors... ...Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80$120/hour...Full timeContract workSummer workWork at officeRemote work$50 - $70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract... ...Role Responsibilities Review and evaluate documents slides spreadsheets and similar...Full timeContract workSummer workRemote workFlexible hours$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Position: Finance operations / audit support Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors... ...Summers and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80$120/hour...Full timeContract workSummer workWork at officeRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors... ...and Jack Dorsey . Position: IP / trademark / copyright law Evaluator Type: Contract Compensation: $80$120/hour...Full timeContract workSummer workWork at officeRemote work$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...pipelines , and A/B test write-ups . Evaluate AI-generated or human-created work against... ...detailed written justifications for evaluations and scores to maintain transparency and accountability...Full timeContract workSummer workRemote work$80 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: Design Expert Type: Contract Compensation... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$14 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract Compensation... .../week Role Responsibilities Evaluate AI model output lyrics , voice...Remote jobContract workSummer workImmediate start$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: People ops / recruiting Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at office$11 - $19 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Music & Lyrics Expert - Bengali Type: Contract... ...creativity prompt adherence and originality. Evaluate whether lyrics sound natural including word...Full timeContract workSummer workImmediate startRemote work$80 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review model-generated...Full timeContract workSummer workRemote work- Our client is looking for a Lead Back -End Software Engineer (Expert Engineer) to join their Service Delivery team. \ \ As an Expert Engineer... ...candidates for technical positions \\\ Scout for and evaluate new technology and tools as opportunities for innovation...SoftwarePermanent employmentFull timeHome officeFlexible hours
$80 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Position: UI / UX Design Expert Type: Contract... ...independently and asynchronously to evaluate and improve AI model performance... ...with AI training , evaluation, or human-data projects....Remote jobContract workSummer work$70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Generalist Expert Type: Contract Compensation... ...Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning...Remote jobContract workSummer work$100 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Summers , and Jack Dorsey . Position: Software Engineer Type: Contract Compensation... ...teams to improve model training and evaluation. Work independently to meet deadlines...SoftwareHourly payFull timeContract workFor contractorsSummer workRemote work$70 per hour
...technical talent with leading AI research labs. Headquartered in... .... Position: Generalist Expert Type: Contract... ...Role Responsibilities Evaluate AI-generated responses to strengthen... ...application of structured evaluation guidelines. Work independently...Remote jobContract workSummer work- ...Responsibilities Run human and automated evaluations across large question sets and datasets. Statistically measure factual grounding and before-and-after accuracy improvements. Build metrics frameworks that quantify answer support and quality improvements. Design...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Evaluator - Software Expert. Be the first to apply!
Related searches
- admissions evaluator Toronto, ON
- test evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur structure Toronto, ON
- estimateur en bâtiment Toronto, ON
- chargé de projet estimateur Toronto, ON
- estimateur automobile Toronto, ON
- expert automobile Toronto, ON
- expert batiment Toronto, ON