AI Evaluator - Software Expert
$80 - $120 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Software / AI / IT / data Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks .
- Provide clear, structured written feedback to improve AI model outputs .
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Software / AI / IT / data .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree ( Master's or higher ) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the AI Evaluator - Software Expert in Toronto, ON vacancy
$120 - $170 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Data Science Expert Type: Contract Compensation... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...SuggestedFull timeContract workSummer workRemote workMercor
Toronto, ON11 hours ago$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Position: Sales Engineering Expert Type: Contract... ...supporting proofs of concept, and evaluating product fit and technical risk... ...with technically complex B2B software — SaaS , cloud infrastructure...SoftwareFull timeContract workSummer workRemote workMercor
Toronto, ON11 hours ago$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...and Jack Dorsey . Position: Data quality / CRM operations Evaluator Type: Contract Compensation: $80–$120/hour...SuggestedFull timeContract workSummer workWork at officeRemote workMercor
Toronto, ON11 hours ago$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour...SuggestedFull timeContract workSummer workWork at officeRemote workMercor
Toronto, ON11 hours ago$60 - $80 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type:...SuggestedHourly payFull timeContract workFor contractorsSummer workRemote workMercor
Toronto, ON11 hours ago$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Dorsey . Position: Customer success / support operations Evaluator Type: Contract Compensation: $80–$120/hour...Full timeContract workSummer workWork at officeRemote workMercor
Toronto, ON11 hours ago$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour...Full timeContract workSummer workWork at officeRemote workMercor
Toronto, ON11 hours ago$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Angelo , Larry Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/...SoftwareRemote jobContract workSummer workWork at office- ...service creation. The technology department is focused on delivering software solutions that enable rich consumer experiences, from mobile... ...digital experiences and client partnerships. As a QA / AI Evaluation Engineer, you will join a highly motivated and experienced team...SoftwareFull timeImmediate start
Appnovation Technologies
Toronto, ON11 hours ago $120 - $170 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Data Science Expert Type: Contract Compensation... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Full timeContract workSummer workRemote workMercor
Toronto, ON11 hours ago$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour...Full timeContract workSummer workWork at officeRemote workMercor
Toronto, ON11 hours ago$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...pipelines , and A/B test write-ups . Evaluate AI-generated or human-created work against... ...detailed written justifications for evaluations and scores to maintain transparency and accountability...Full timeContract workSummer workRemote workMercor
Toronto, ON11 hours ago- Our client is looking for a Lead Back -End Software Engineer (Expert Engineer) to join their Service Delivery team. \ \ As an Expert Engineer... ...candidates for technical positions \\\ Scout for and evaluate new technology and tools as opportunities for innovation...SoftwarePermanent employmentFull timeHome officeFlexible hours
Yoush Consulting
Toronto, ON11 hours ago $90k per year
...cloud platform, coupled with AI-driven analytics tools, unlocks... ...highly skilled and experienced Software Engineer, AI to perform a key... ...engineering, data pipelines, evaluation, and production operations. You... ...development from industry-leading experts ~ Cutting edge benefit...SoftwareFull timeFlexible hoursCalabrio, Inc.
Toronto, ON11 hours ago$85 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-...Full timeContract workSummer workRemote workMercor
Toronto, ON11 hours ago$80 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review model-generated...Full timeContract workSummer workRemote workMercor
Toronto, ON11 hours ago- ...without it. As a Senior Applied AI Engineer at Vanta, you will... ..., and security and compliance experts to implement, scale, and... ...adoption at Vanta Instrument evaluations, guardrails, and monitoring, and... ...years of industry experience as a software engineer You’ve shipped LLM...SoftwareFull timeInternshipRemote workFlexible hours
Vanta
Toronto, ON11 hours ago $65 - $85 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Role Responsibilities Review and evaluate AI-generated outputs related to solution... ...workshops, requirements gathering, and vendor evaluation. Annotate, label, and validate data across...Full timeContract workSummer workRemote workMercor
Toronto, ON11 hours ago- ...that will set the standards for software-defined vehicles around the... ...expertise across connectivity, AI, security and more, we’ll map... ...systems. Deep Understanding: Expert-level grasp of machine learning principles, algorithms, and evaluation metrics, as well as software...SoftwareLong term contractFull timeContract workLocal area
Rivian and Volkswagen Group Technologies
Toronto, ON11 hours ago - ...is hiring! We're looking for a Senior Software Engineer to join our team in Toronto, focusing... ...intelligence for our customers. Own evaluation of agentic systems at scale . You develop... ..., and high availability. You use AI coding tools to accelerate your own work...SoftwareFull timeWork at office
Klue Inc.
Toronto, ON11 hours ago $85 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex machine learning and AI engineering tasks....Full timeContract workSummer workRemote workMercor
Toronto, ON11 hours ago$70 - $90 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Summers , and Jack Dorsey . Position: Cybersecurity Experts Type: Contract Compensation: $70–$90/hour...Full timeContract workSummer workRemote workFlexible hoursMercor
Toronto, ON11 hours ago$167.5k - $235k per year
...autonomous cross-functional team to build AI agents that fundamentally transform how operations... ...work at scale. Instead of writing bespoke software for every workflow, we are developing an... ...driven operations. Contribute to agent evaluation and testing infrastructure, defining how...SoftwareLong term contractFull timeCasual workInternshipWork at officeLocal areaImmediate startJustworks
Toronto, ON11 hours ago$30 - $80 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...and prioritize effectively. Run the agent against scenarios, evaluate performance, and guide it to success through structured hints....Full timeContract workSummer workRemote workMercor
Toronto, ON11 hours ago$85 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex engineering tasks. Review model-generated frontend...Full timeContract workSummer workRemote workMercor
Toronto, ON11 hours ago$70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... .... Position: Mathematics PhD Coding Experts Type: Contract Compensation... ...-reviewed journals. Prior scientific software or research engineering experience. Start...SoftwareRemote jobContract workSummer workImmediate start$60 - $80 per hour
...About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position...Full timeContract workSummer workImmediate startRemote workMercor
Toronto, ON11 hours ago$123.3k - $159.5k per year
...your home — from personalized guidance to AI tools and a best-in-class hiring experience... ...engineering blog . Challenge As a Software Engineer on the ML Infrastructure team, you... ..., CI/CD, orchestration, deployment, and evaluation tooling. Work hands on across the stack...SoftwareFull timeSeasonal workLocal areaThumbtack
Toronto, ON11 hours ago$100k - $145k per year
...\ Senior Software Engineer â AI I \ \ Recruiter: Symbiotic Services \... ...validate innovative AI use cases \\ Evaluate existing systems and propose architectural... ...in machine learning principles, model evaluation, system design, and MLOps across the full...SoftwareLong term contractFull timeWork at officeRemote workFlexible hoursSymbiotic Services
Toronto, ON11 hours ago- ...Freelance English to Turkish Software Localization MT/LLM Evaluator Remote | US, Canada & Latin America Time Zones Are you a... ...specialists, MTPE professionals, and language quality experts who want to work on cutting-edge AI and machine translation initiatives while...SoftwareLong term contractFor contractorsFreelanceRemote workWorldwideFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Evaluator - Software Expert. Be the first to apply!
Related searches
- chargé de projet estimateur Toronto, ON
- estimateur en bâtiment Toronto, ON
- admissions evaluator Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur automobile Toronto, ON
- estimateur industriel Toronto, ON
- test evaluator Toronto, ON
- estimateur - dessinateur Toronto, ON
- estimateur structure Toronto, ON
- évaluateur-estimateur Toronto, ON