Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineering Evaluator - Expert

$100 - $150 per hour

Mercor

Toronto, ON
  • Remote job

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Software Engineer Expert

Type: Contract

Compensation: $100–$150/hour

Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts for usability in a software engineering context.
  • Identify factual, aesthetic, and presentation errors in slides , spreadsheets , and documents .
  • Provide clear, structured written feedback to improve AI model outputs .
  • Apply deep subject-matter expertise to grade outputs and enhance quality.
  • Work independently and asynchronously to meet deadlines while improving AI model performance .

Qualifications

Must-Have

  • 5+ years of relevant professional experience in Software Engineering at a top firm in the United States , United Kingdom , Canada , Australia , or New Zealand .
  • Native or professional fluency in English .
  • Highly proficient in Microsoft Office and Google Workspace (PowerPoint, Excel, Word).

Preferred

  • Advanced degree ( Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check:
  • For any help or support, reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Software Engineering Evaluator - Expert in Toronto, ON vacancy
  • $149k - $168k per year

     ...supports over 3,500 dealerships nationwide, delivering cutting-edge software tools to simplify operations, boost marketing, and drive...  ...The opportunity We are looking for a hands-on Engineering Expert who will be: setting technical direction across product boundaries... 
    Suggested
    Internship

    AutoTrader.ca

    Toronto, ON
    20 hours ago
  • $80 - $120 per hour

     ...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities... 
    Suggested
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 - $120 per hour

     ...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities... 
    Suggested
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $100 - $150 per hour

     ...Jack Dorsey . Position: Sales Engineering Expert Type: Contract Compensation...  ...with technically complex B2B software such as SaaS , cloud infrastructure...  ...Prior experience with AI training , evaluation, or human-data projects. Application... 
    Suggested
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 - $120 per hour

     ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Engineering / manufacturing / technical operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role... 
    Suggested
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $39 per hour

     ...answering questions, and correcting errors. Rate the experience and deliverables, providing concise notes on performance. Evaluate AI model interactions to ensure alignment with professional healthcare standards. Work independently and asynchronously to meet... 
    Remote job

    Mercor

    Toronto, ON
    10 days ago
  • $39 per hour

    About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Healthcare...
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Toronto, ON
    5 days ago
  • $50 per hour

     ...Larry Summers , and Jack Dorsey . Position: English Linguistic Experts Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated English text across... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    20 days ago
  • $57 per hour

    About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position...
    Remote job
    Hourly pay
    Contract work
    For contractors
    Summer work

    Mercor

    Toronto, ON
    16 days ago
  • $150 per hour

     ...Larry Summers , and Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation: $150/hour...  ...Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses on challenging medical problems... 
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    20 days ago
  • $170k per year

     ...Role: Software Engineering Expert (EE) Location: Toronto, ON  Rates: up to $170k per year  Structure: Full time   ​​​​​​-- We have a...  ...or technical decision support. Demonstrated ability to  evaluate, introduce and drive adoption of new technologies . Understands... 
    Full time
    Contract work

    CorGTA

    Toronto, ON
    26 days ago
  • $150 per hour

     ...Larry Summers , and Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation: $150/hour...  ...Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses to challenging medical problems... 
    Remote job
    Contract work
    Summer work
    Immediate start
    Flexible hours

    Mercor

    Toronto, ON
    a month ago
  •  ...seamlessly transfer the question to our care experts team. We build the cockpit for that...  ...Influence product direction, mentor other engineers, and lead technical initiatives that shape...  ...Requirements: ~5+ years building scalable software systems ~ Full-stack experience (... 
    Full time
    Live In
    Immediate start
    Remote work

    Alan

    Toronto, ON
    9 days ago
  • $180 per hour

     ...Larry Summers , and Jack Dorsey . Position: Senior Software Engineering Experts Type: Contract Compensation: $120–$180/...  ...engineering work, collaborating with AI coding agents to evaluate success and failure. Apply consistent, evidence-based... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    19 days ago
  • $100 - $150 per hour

     ...Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $100–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in data science contexts.... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    a month ago
  • $14 per hour

     ...Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract...  ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation...  ...years experience as a music producer, audio engineer, or sound mixer. ~ College degree in... 
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    more than 2 months ago
  • $70 per hour

     ...and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour...  ...Publications in peer-reviewed journals. Prior scientific software or research engineering experience. Start Date ~ Immediate... 
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    a month ago
  • $100 - $150 per hour

     ...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/hour...  ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 - $120 per hour

     ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Healthcare operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 - $120 per hour

     ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: People ops / recruiting Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 - $120 per hour

     ...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Finance operations / audit support Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $70 - $100 per hour

     ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type: Contract Compensation: $70–$100/hour Location:... 
    Remote job
    Contract work
    Summer work
    Internship

    Mercor

    Toronto, ON
    more than 2 months ago
  • $140k - $175k per year

     ...Reuters Labs is seeking a Lead Research Engineer to lead the design and delivery of production-ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build...  ...Human Resources Department at HR.Leave-Expert@thomsonreuters.com. Disability accommodations... 
    Full time
    Internship
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Toronto, ON
    9 days ago
  • $50 - $70 per hour

     ...Larry Summers , and Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation: $50–$...  ...Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for... 
    Remote job
    Contract work
    Summer work
    Flexible hours

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 - $150 per hour

     ..., Larry Summers , and Jack Dorsey . Position: Design Expert Type: Contract Compensation: $80–$150/hour...  ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $50 per hour

     ...Position: English Language and Literature Expert Type: Contract...  ...Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated...  ...writing, linguistic annotation, language evaluation, or NLP data work in English. Strong... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $80 - $120 per hour

     ...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  •  ...resilient businesses. Our Engineering team is at the heart of building...  ..., impact-driven Senior Software Engineer (Voyager) to join our...  ...exploratory initiatives that evaluate and validate emerging technologies...  ...product teams as the AI expert in the room, helping them make... 
    Long term contract
    Work from home

    Relay Fi

    Toronto, ON
    6 days ago
  •  ...The Software Engineer is an intermediate level position responsible for participation in the establishment and implementation of new or revised...  ...analysts Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions Resolve... 
    Full time

    Citigroup

    Toronto, ON
    2 days ago
  • $80 - $150 per hour

     ...Angelo , Larry Summers , and Jack Dorsey . Position: Software Engineer — Agentic Search Systems Type: Contract...  ...independently and asynchronously to enhance search quality and evaluation. Qualifications Must-Have Experience with production... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    9 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineering Evaluator - Expert. Be the first to apply!