Engineering Evaluator - Domain Expert
$80 - $120 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Engineering / manufacturing / technical operations Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs.
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines and enhance domain quality.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Engineering / manufacturing / technical operations .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Engineering Evaluator - Domain Expert in Toronto, ON vacancy
$80 - $120 per hour
...Operations / inventory / capacity planning Evaluator Type: Contract... ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual... ...to meet deadlines and ensure high-quality evaluations. Qualifications Must-Have...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Jack Dorsey . Position: IP / trademark / copyright law Evaluator Type: Contract Compensation: $80–$120/hour... ...Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Dorsey . Position: Personal finance / consumer planning Evaluator Type: Contract Compensation: $80–$120/hour... ...Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and...SuggestedRemote jobContract workSummer workWork at office$15 - $20 per hour
...sources and external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and... ...Strong attention to detail . Background or experience in domains requiring structured analytical thinking . Preferred...SuggestedRemote jobContract workSummer work$90 - $110 per hour
...Commitment: 30–40 hours/week Role Responsibilities Create deliverables addressing common requests within the real estate domain. Review peer-developed deliverables to enhance AI research . Collaborate with AI research teams to diagnose and solve...SuggestedRemote jobContract workSummer workImmediate startFlexible hours$85k - $156k per year
...connectedness. Learn from deep subject matter experts through mentoring and on the job coaching... ...the quality of our data as our Contact Domain Steward. What will your typical day... ...or MIS, Computer Science or Software Engineering, Economics, Finance or Accounting, Industrial...Permanent employmentFlexible hours- ...Technology (I&T) team, a critical piece of the engine that keeps us in motion. From enterprise... ...we do matters. Join us! Job Summary The Expert, Data Engineering is responsible to lead/... ...and data scientists ~ Build data and domain event models, implement business rules,...Full timeWork at officeRemote workMonday to friday
$95k - $125k per year
...SYSTRA Canada is part of the SYSTRA group, an international consulting and engineering group, a world leader in the design of transport infrastructures. SYSTRA Canada is an engineering and consulting firm whose primary focus is to offer transportation solutions, whether...Local area$70 - $100 per hour
...Larry Summers , and Jack Dorsey . Position: Office-Suite Experts Type: Contract Compensation: $70–$100/hour... ...Commitment: 20–40 hours/week Role Responsibilities Evaluate AI-generated office artifacts in Excel , Word , and PowerPoint...Remote jobContract workSummer workWork at officeImmediate start$80 - $120 per hour
...Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour... ...Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour... ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and...Remote jobContract workSummer workWork at office- ...’s best for our customers. Cohere is a team of researchers, engineers, designers, and more, who are passionate about their craft. Each... ...us on our mission and shape the future! Why this role? Evaluation is critical to making progress in scaling intelligence. As models...Full timeWork at officeRemote workFlexible hours
$60 per hour
...Jack Dorsey . Position: Generalist Expert Type: Contract... ...Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning... ...and downstream performance. Develop evaluation rubrics and benchmarks for assessing AI...Remote jobContract workSummer work- ...alongside iconic brand names. About the Role As a luxury brand evaluator, you will step into the world of luxury to discreetly assess... ...in the luxury market. Compensation • Non-Purchase Evaluations: Earn a fee based on mission complexity. • Purchase-Based Evaluations...Contract workWorldwideFlexible hours
- ...access to an interactive platform, code reviews, and support from industry practitioners. We're building a program for experienced engineers transitioning into system architecture roles. We need AI Systems Engineering practitioners who can do more than just know their...Work at officeRemote workFlexible hours
$122k - $192k per year
...Innovations is seeking an experienced DSM Evaluation Manager - EM&V to join our growing team.... ...impact evaluations and providing engineering and analysis support. Specific responsibilities... ...of energy efficiency programs. ~ Expert level understanding of building systems,...Full timeWork at officeLocal area- ...Job Title: Test Manager (with Credit cards DOMAIN) Location: Toronto, ON Work Style: Hybrid (2 days per week in-person at Toronto office preferred) Skills: Agile Way of Working~Test Management~Functional Testing Experience Required: 6-8 Must Haves:...Contract workWork at office2 days per week
- ...Job Description Workday Domain Lead, Talent Acquisition What is the opportunity? We are seeking a resourceful and motivated professional... ...and have a keen attention to detail. As a subject matter expert, you will be responsible for staying up to date with best...Full timeFlexible hours
- ...Scrum Master and Delivery Manager - Commercial Banking Domain Role Summary We are seeking a high-impact Scrum Master with strong... ...Foster a culture of ownership, accountability, and engineering excellence Enable teams to adapt to changing regulatory requirements...Contract work
- ...days a week in-office Detailed Job Description: We are looking for an experienced Test Lead with strong expertise in Mortgage domain testing and hands-on experience in database validation and test automation. The candidate will be responsible for leading testing...Contract workWork at office2 days per week
$70 - $100 per hour
...Dorsey . Position: STEM Computational Scientific Software & Evaluation Design - Astrophysics & Cosmology Type: Contract... ...Responsibilities Design graduate-level computational problems using domain-specific scientific software libraries. Evaluate AI systems...Remote jobContract workSummer work- ...Ensure quality, risk mitigation, and governance Lead cross-functional teams Required Skills Project Program Management Stakeholder communication Delivery governance Preferred Skills BFSI domain Agile Scrum methodology Risk management...Contract workWork at office2 days per week
- ...’s best for our customers. Cohere is a team of researchers, engineers, designers, and more, who are passionate about their craft. Each... ...role? As a Member of Technical Staff in Data Analysis and Evaluation, you will play a pivotal role in ensuring the quality, reliability...Full timeWork at officeRemote workFlexible hours
- ...Dorsey . Position: Retail Banking Expert Type: Contract... ...Responsibilities Review and evaluate AI-generated outputs related to consumer... ...asynchronously with research teams to refine evaluation frameworks for banking-domain AI . Qualifications Must...Remote jobHourly payContract workSummer work
- ...physical world? We're looking for Robotics ML Experts in Canada's vibrant AI research hub to... ...dynamics, and scene configurations Evaluate trained policies for stability, generalization... ...with sim-to-real transfer techniques (domain randomization, system identification)...Hourly payOngoing contractContract workFreelanceRemote workFlexible hours
$10k per year
...Informatics (MHI) Sessional Dates of Appointment: Fall 2026, September to December Existing Vacancy: Yes Course Title: MHI2009H: Evaluation Methods for Health Informatics Course Description: There is little debate that health information systems have...Long term contract$80 - $120 per hour
...Remote Duration: 3–4 weeks Role Responsibilities Create deliverables for common requests within your professional domain. Review peer-developed deliverables to improve AI research . Diagnose and solve real issues in your domain....Remote jobContract workSummer workWork at officeImmediate start- ...Project Manager / Scrum Master - Banking Domain Location : Toronto, ON (Hybrid – 4 days WFO) Role Summary The Project Manager / Scrum Master is responsible for leading the end-to-end delivery of projects, ensuring successful execution within scope, timeline, and...Contract work
- ...Create deliverables for common requests in the real estate domain. Review peer-developed deliverables to improve AI research... ...~ Immediate Compensation & Legal Payment : All experts receive a $100 onboarding payment for completing the onboarding...Remote jobHourly payContract workSummer workImmediate startTrial periodFlexible hoursShift work
$70 - $90 per hour
...Larry Summers , and Jack Dorsey . Position: Cybersecurity Experts Type: Contract Compensation: $70–$90/hour... ...Interview Process Short interview and questionnaire to assess domain expertise. Paid for up to 1 hour of onboarding time,...Remote jobContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Engineering Evaluator - Domain Expert. Be the first to apply!
Related searches
- évaluateur-estimateur Toronto, ON
- web search evaluator Toronto, ON
- estimateur structure Toronto, ON
- test evaluator Toronto, ON
- admissions evaluator Toronto, ON
- estimateur automobile Toronto, ON
- chargé de projet estimateur Toronto, ON
- estimateur en bâtiment Toronto, ON
- remote social media evaluator Toronto, ON
- expert batiment Toronto, ON