Software Engineering Evaluator - Expert

$100 - $150 per hour

Full-time

Mercor

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Software Engineer Expert

Type: Contract

Compensation: $100–$150/hour

Location: Remote

Role Responsibilities

Evaluate AI-generated artifacts for usability in a software engineering context.
Identify factual, aesthetic, and presentation errors in slides , spreadsheets , and documents .
Provide clear, structured written feedback to improve AI model outputs .
Apply deep subject-matter expertise to grade outputs and enhance quality.
Work independently and asynchronously to meet deadlines while improving AI model performance .

Qualifications

Must-Have

5+ years of relevant professional experience in Software Engineering at a top firm in the United States , United Kingdom , Canada , Australia , or New Zealand .
Native or professional fluency in English .
Highly proficient in Microsoft Office and Google Workspace (PowerPoint, Excel, Word).

Preferred

Advanced degree ( Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

Upload resume
AI interview based on your resume
Submit form

Resources & Support

For details about the interview process and platform information, please check:
For any help or support, reach out to: View email address on jobs.jobcopilot.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Apply

Vacancy posted 1 day ago

Similar jobs that could be interesting for youBased on the Software Engineering Evaluator - Expert in Toronto, ON vacancy

Sales Engineering Expert - Evaluator
$100 - $150 per hour
...Jack Dorsey . Position: Sales Engineering Expert Type: Contract Compensation... ..., supporting proofs of concept, and evaluating product fit and technical risk. ~ Hands... ...with technically complex B2B software — SaaS , cloud infrastructure, cybersecurity...
Suggested
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
a month ago
Expert Software Engineer
Our client is looking for a Lead Back -End Software Engineer (Expert Engineer) to join their Service Delivery team. \ \ As an Expert Engineer... ...candidates for technical positions \\\ Scout for and evaluate new technology and tools as opportunities for innovation...
Suggested
Permanent employment
Full time
Home office
Flexible hours
Yoush Consulting
Toronto, ON
more than 2 months ago
Data Science Evaluator - Expert
$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $100–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in data science contexts....
Suggested
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
1 day ago
Legal Compliance Expert - Evaluator
$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...
Suggested
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
more than 2 months ago
Privacy Compliance Evaluator - Expert
$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...
Suggested
Full time
Contract work
Summer work
Work at office
Remote work
Flexible hours
Mercor
Toronto, ON
a month ago
Privacy Compliance Expert - Evaluator
$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
more than 2 months ago
Business Operations Expert - Evaluator
$60 - $80 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type: Contract Compensation: $60–$80/hour Location:...
Hourly pay
Full time
Contract work
For contractors
Summer work
Remote work
Mercor
Toronto, ON
a month ago
Data Quality Expert - Evaluator
$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data quality / CRM operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
a month ago
Customer Success Evaluator - Expert
$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Customer success / support operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
a month ago
AI Evaluation Engineer (QA)
...combines Strategy, Experience & Design, Engineering and Managed Services. We build digital solutions... ...department is focused on delivering software solutions that enable rich consumer... ...and client partnerships. As a QA / AI Evaluation Engineer, you will join a highly motivated...
Full time
Immediate start
Appnovation Technologies
Toronto, ON
27 days ago
Data Science Expert - AI Evaluation
$120 - $170 per hour
...Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
a month ago
Data Science Expert - Evaluation Specialist
$120 - $170 per hour
...Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
26 days ago
Software Engineer, AI
$90k per year
...looking for a highly skilled and experienced Software Engineer, AI to perform a key role in our... ..., backend engineering, data pipelines, evaluation, and production operations. You will turn... ...and development from industry-leading experts ~ Cutting edge benefit programs that...
Full time
Flexible hours
Calabrio, Inc.
Toronto, ON
more than 2 months ago
Software Engineer
...The founding team brings deep experience from both finance and engineering, having overseen finance organizations at leading tech companies... ...with financial systems including ERPs, HRIS, procurement software, and CRMs - Design and implement core components of the backend...
Full time
Internship
Work at office
Flexible hours
Rockstar
Toronto, ON
7 days ago
Software Engineer
...Weâre looking for a passionate Software Engineer to design, develop and install software solutions. Ideally, the candidate should be able... ...tools, processes and metrics Serving as a subject matter expert Complying with project plans and industry standards Requirements...
Full time
Work at office
Zoho Limited
Toronto, ON
more than 2 months ago
Data Engineer - AI Model Evaluation
$80 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Data Engineer (Coding Agent Experience) Type: Contract... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review model-generated implementations...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
a month ago
DevOps Engineer - AI Model Evaluator
$85 per hour
...Summers , and Jack Dorsey . Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type: Contract... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
more than 2 months ago
Software Engineer
...the Company We are on a mission to build and strengthen our engineering teams to match the accelerating success of our Street Context acquisition... ...the Role Are you looking for your next challenge in your Software Engineering journey? Are you a curious and driven engineer...
Full time
Blue Matrix Limited
Toronto, ON
18 days ago
Search Systems Engineer - Expert
$80 - $150 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Software Engineer — Agentic Search Systems Type: Contract... ...Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated content in search systems...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
a month ago
Software Engineer
...solid enough that customers are comfortable staking their compliance on it. That tension is the job. We're looking for a full-stack engineer who can move quickly without leaving a mess behind — someone who owns what they build all the way to production and treats "it works...
Full time
Work at office
Mycroft Llc
Toronto, ON
a month ago
Scientific Software Engineer
...Computing, Inc. seeks a creative and collaborative Scientific Software Engineer to help solve the unique software challenges of integrating high... ...collaborators and to help our growing team of diverse experts address fascinating challenges, ranging from classical compiler...
Full time
Quera Computing Inc.
Toronto, ON
more than 2 months ago
Propulsion Systems Engineer - Expert
$65 - $75 per hour
.... Position: Propulsion & Effects Engineer Type: Contract Compensation... ...benign, dual-use, or adversarial. Evaluate AI model responses against policy standards... ...correct responses. Collaborate with experts to ensure AI models distinguish between...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
8 days ago
Software Engineer, Simulation
...Why Join Doppel Doppel is building the future of social engineering defense. Our AI-native platform uses agentic AI to protect executives,... ...daily and deploy continuously adaptive AI SOC agents, paired with expert human analysts, to uncover and disrupt the infrastructure behind...
Full time
Work at office
Flexible hours
Doppel
Toronto, ON
more than 2 months ago
Software Engineer - Data Science
$90 - $110 per hour
...and Jack Dorsey . Position: Software & Data Science Expert Type: Contract Compensation... ...over technical documentation. Evaluate AI models on professional document... ...3+ years of experience in software engineering or data science & analytics ....
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
more than 2 months ago
Senior Software Engineer
$148k - $185k per year
...Institutional Page About the role Our Engineering team helps Nubank to create and use the... .... We strive for state-of-the-art software development practices that currently include... ...and analysis, to support the evaluation process. Artificial intelligence is not...
Full time
Nubank
Toronto, ON
a month ago
Backend Software Engineer
...can build the best team! Design, develop and execute innovative software solutions to address business needs Ensure software... ...architecture meets all performance, quality, and security requirements Evaluate and recommend tools, technologies, and processes to ensure the...
Full time
#legend
Toronto, ON
more than 2 months ago
Senior Software Engineer
$100 per hour
...Summers , and Jack Dorsey . Position: Special Projects Software Engineers Type: Contract Compensation: $100–$200/... ...team on special projects to enhance software solutions. Evaluate and improve AI model training and performance. Develop...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
more than 2 months ago
Software Engineer, Testing
$72k - $75k per year
...what they love. The Role We're looking for an experienced Software Engineer in Testing to join our growing Engineering team! If you have... ...environments to mirror production conditions Continuously evaluate and enhance QA workflows, tooling (including modern AI tools),...
Full time
Internship
Work at office
Remote work
Push Operations
Toronto, ON
a month ago
Software Engineer - Data
$65k - $85k per year
...Forum Asset Management – Software Engineer - Data Location: 181 Bay Street, Toronto Work Schedule: Full-time, in-office (5 days/week... ...analysis, classification, or prediction tasks. ~ Proven ability to evaluate, prototype, and deploy emerging AI/ML solutions that create...
Long term contract
Full time
Work at office
Forum Asset Management,llc
Toronto, ON
more than 2 months ago
Software Engineer Intern
$30 - $50 per hour
...to take ownership and move fast. About the Role As a Software Engineer Intern , you’ll build systems that power real-time, AI-... ...– extracting insights from millions of conversations AI Evaluation & Reliability – improving quality, consistency, and observability...
Full time
Internship
Work at office
Remote work
Cresta
Toronto, ON
a month ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineering Evaluator - Expert. Be the first to apply!