Software Engineering Evaluator - Expert

$100 - $150 per hour

Mercor

Remote job

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Software Engineer Expert

Type: Contract

Compensation: $100–$150/hour

Location: Remote

Role Responsibilities

Evaluate AI-generated artifacts for usability in a software engineering context.
Identify factual, aesthetic, and presentation errors in slides , spreadsheets , and documents .
Provide clear, structured written feedback to improve AI model outputs .
Apply deep subject-matter expertise to grade outputs and enhance quality.
Work independently and asynchronously to meet deadlines while improving AI model performance .

Qualifications

Must-Have

5+ years of relevant professional experience in Software Engineering at a top firm in the United States , United Kingdom , Canada , Australia , or New Zealand .
Native or professional fluency in English .
Highly proficient in Microsoft Office and Google Workspace (PowerPoint, Excel, Word).

Preferred

Advanced degree ( Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

Upload resume
AI interview based on your resume
Submit form

Resources & Support

For details about the interview process and platform information, please check:
For any help or support, reach out to: Show email

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 6 hours ago

Similar jobs that could be interesting for youBased on the Software Engineering Evaluator - Expert in Toronto, ON vacancy

Sales Engineering Expert - Evaluator
$100 - $150 per hour
...Jack Dorsey . Position: Sales Engineering Expert Type: Contract Compensation... ..., supporting proofs of concept, and evaluating product fit and technical risk. ~ Hands... ...with technically complex B2B software — SaaS , cloud infrastructure, cybersecurity...
Suggested
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
13 hours ago
Expert Software Engineer
Our client is looking for a Lead Back -End Software Engineer (Expert Engineer) to join their Service Delivery team. \ \ As an Expert Engineer... ...candidates for technical positions \\\ Scout for and evaluate new technology and tools as opportunities for innovation...
Suggested
Permanent employment
Full time
Home office
Flexible hours
Yoush Consulting
Toronto, ON
13 hours ago
Privacy Compliance Expert - Evaluator
$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...
Suggested
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
13 hours ago
Customer Success Evaluator - Expert
$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Customer success / support operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...
Suggested
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
13 hours ago
Data Quality Expert - Evaluator
$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data quality / CRM operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...
Suggested
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
13 hours ago
Business Operations Expert - Evaluator
$60 - $80 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type: Contract Compensation: $60–$80/hour Location:...
Hourly pay
Full time
Contract work
For contractors
Summer work
Remote work
Mercor
Toronto, ON
13 hours ago
Legal Compliance Expert - Evaluator
$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
13 hours ago
Legal Compliance Evaluator - Expert
$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
13 hours ago
Data Science Expert - AI Evaluation
$120 - $170 per hour
...Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
13 hours ago
AI Evaluation Engineer (QA)
...combines Strategy, Experience & Design, Engineering and Managed Services. We build digital solutions... ...department is focused on delivering software solutions that enable rich consumer... ...and client partnerships. As a QA / AI Evaluation Engineer, you will join a highly motivated...
Full time
Immediate start
Appnovation Technologies
Toronto, ON
13 hours ago
Data Science Expert - Evaluation Specialist
$120 - $170 per hour
...Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
13 hours ago
Software Engineer - Compiler
...potential. Our founding team is made up of experts in AI, compilers, and ML hardware and has... ...tests and benchmarks to validate and evaluate our solutions. Who you are:... ...or higher degree in Computer Science or Engineering. Excellent communication skills and the...
Full time
Flexible hours
Centml
Toronto, ON
13 hours ago
Software Engineer, AI
$90k per year
...looking for a highly skilled and experienced Software Engineer, AI to perform a key role in our... ..., backend engineering, data pipelines, evaluation, and production operations. You will turn... ...and development from industry-leading experts ~ Cutting edge benefit programs that...
Full time
Flexible hours
Calabrio, Inc.
Toronto, ON
13 hours ago
Software Engineer - Platform
...potential. Our founding team is made up of experts in AI, compilers, and ML hardware and has... ...highly motivated and skilled systems engineers to join our team to help in developing... ...and develop methodology & benchmarks to evaluate different approaches. Qualifications...
Full time
Flexible hours
Centml
Toronto, ON
13 hours ago
Software Engineer, CTO
...are looking for a talented full stack software engineer to build SaaS application. You are an energetic... ...2+ years of Software Engineering * Expert in Ruby on Rails and/or Java *... ...Angular JS; scripting * Experience evaluating, procuring and using new technologies...
Remote job
Contract work
Topolio
Toronto, ON
13 hours ago
Software Engineer
...The founding team brings deep experience from both finance and engineering, having overseen finance organizations at leading tech companies... ...with financial systems including ERPs, HRIS, procurement software, and CRMs - Design and implement core components of the backend...
Full time
Internship
Work at office
Flexible hours
Rockstar
Toronto, ON
13 hours ago
Software Engineer
...Weâre looking for a passionate Software Engineer to design, develop and install software solutions. Ideally, the candidate should be able... ...tools, processes and metrics Serving as a subject matter expert Complying with project plans and industry standards Requirements...
Full time
Work at office
Zoho Limited
Toronto, ON
13 hours ago
Propulsion Systems Engineer - Expert
$65 - $75 per hour
.... Position: Propulsion & Effects Engineer Type: Contract Compensation... ...benign, dual-use, or adversarial. Evaluate AI model responses against policy standards... ...correct responses. Collaborate with experts to ensure AI models distinguish between...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
13 hours ago
Search Systems Engineer - Expert
$80 - $150 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Software Engineer — Agentic Search Systems Type: Contract... ...Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated content in search systems...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
13 hours ago
DevOps Engineer - AI Model Evaluator
$85 per hour
...Summers , and Jack Dorsey . Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type: Contract... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
13 hours ago
Software Engineer
...the Company We are on a mission to build and strengthen our engineering teams to match the accelerating success of our Street Context acquisition... ...the Role Are you looking for your next challenge in your Software Engineering journey? Are you a curious and driven engineer...
Full time
Blue Matrix Limited
Toronto, ON
13 hours ago
Data Engineer - AI Model Evaluation
$80 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Data Engineer (Coding Agent Experience) Type: Contract... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review model-generated implementations...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
13 hours ago
Scientific Software Engineer
...Computing, Inc. seeks a creative and collaborative Scientific Software Engineer to help solve the unique software challenges of integrating high... ...collaborators and to help our growing team of diverse experts address fascinating challenges, ranging from classical compiler...
Full time
Quera Computing Inc.
Toronto, ON
13 hours ago
Senior Software Engineer
$120k - $180k per year
...requirements Requirements ~4+ years experience as a Full Stack Engineer or similar role ~ Knowledge of multiple back-end languages (... ...MySQL, MongoDB) and devOps (GitHub, Docker, AWS, Google Compute Engine) ~ Experience building dev infrastructure preferred ~...
Remote job
Full time
Work at office
Visa sponsorship
Hired Recruiters
Toronto, ON
13 hours ago
Measurement Software Engineer
...in high-stakes scientific and engineering workflows. Our mission, 30... ...We are seeking a Measurement Software Engineer to architect AX-... ...Implement high-concurrency execution engines to orchestrate parallel... ...collaborative opportunities with leading experts in artificial intelligence,...
Full time
Flexible hours
Axiomatic_AI
Toronto, ON
13 hours ago
Senior Software Engineer
$100 per hour
...Summers , and Jack Dorsey . Position: Special Projects Software Engineers Type: Contract Compensation: $100–$200/... ...team on special projects to enhance software solutions. Evaluate and improve AI model training and performance. Develop...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
13 hours ago
Backend Software Engineer
...can build the best team! Design, develop and execute innovative software solutions to address business needs Ensure software... ...architecture meets all performance, quality, and security requirements Evaluate and recommend tools, technologies, and processes to ensure the...
Full time
#legend
Toronto, ON
13 hours ago
Software Engineer, Testing
$72k - $75k per year
...what they love. The Role We're looking for an experienced Software Engineer in Testing to join our growing Engineering team! If you have... ...environments to mirror production conditions Continuously evaluate and enhance QA workflows, tooling (including modern AI tools),...
Full time
Internship
Work at office
Remote work
Push Operations
Toronto, ON
13 hours ago
Software Engineer
$100k - $150k per year
...here to leave our clients better than we found them, and to create a place where our people are proud to Build. Better. As a Software Engineer at RAVL, you’ll design, build, and deliver secure, scalable, and high-performance services that form the backbone of modern digital...
Full time
Flexible hours
RAVL
Toronto, ON
13 hours ago
Software Engineer
...Description of the demo job posting Engineers on the Engineering team are responsible for the entire software development lifecycle for our products and services which include both internal and customer-facing software. Whether closing gaps in our pipeline, extending our...
Full time
Work at office
Remote work
Partner Experience Xml Feed
Toronto, ON
13 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineering Evaluator - Expert. Be the first to apply!