Software Engineering Evaluator - Expert
$100 - $150 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Software Engineer Expert
Type: Contract
Compensation: $100–$150/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts for usability in a software engineering context.
- Identify factual, aesthetic, and presentation errors in slides , spreadsheets , and documents .
- Provide clear, structured written feedback to improve AI model outputs .
- Apply deep subject-matter expertise to grade outputs and enhance quality.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- 5+ years of relevant professional experience in Software Engineering at a top firm in the United States , United Kingdom , Canada , Australia , or New Zealand .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace (PowerPoint, Excel, Word).
Preferred
- Advanced degree ( Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 9 days ago
Similar jobs that could be interesting for youBased on the Software Engineering Evaluator - Expert in Toronto, ON vacancy
$100 - $150 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $100–$150/... ...Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a software engineering...SuggestedContract workSummer workWork at officeRemote work$100 - $150 per hour
...Jack Dorsey . Position: Sales Engineering Expert Type: Contract Compensation... ..., supporting proofs of concept, and evaluating product fit and technical risk. ~ Hands... ...with technically complex B2B software — SaaS , cloud infrastructure, cybersecurity...SuggestedFull timeContract workSummer workRemote work$80 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at office- Our client is looking for a Lead Back -End Software Engineer (Expert Engineer) to join their Service Delivery team. \ \ As an Expert Engineer... ...candidates for technical positions \\\ Scout for and evaluate new technology and tools as opportunities for innovation...SuggestedPermanent employmentFull timeHome officeFlexible hours
$80 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at office$149k - $168k per year
...supports over 3,500 dealerships nationwide, delivering cutting-edge software tools to simplify operations, boost marketing, and drive... ...The opportunity We are looking for a hands-on Engineering Expert who will be: setting technical direction across product boundaries...Internship$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Engineering / manufacturing / technical operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role...Remote jobContract workSummer workWork at office$100 per hour
...based in Canada. Pay: $100$200/hr Role Title: AI Software Engineering Domain Expert Role Type: Contractor (Part Time) Location: Remote... ...practices in software engineering. # Create refine and evaluate prompts and instructions designed to guide AI models in producing...Full timePart timeFor contractorsRemote work$70 per hour
...and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour... ...Publications in peer-reviewed journals. Prior scientific software or research engineering experience. Start Date ~ Immediate...Remote jobContract workSummer workImmediate start$132k - $179k per year
...team. LinkedIns Core AI is building the Evaluation Operating System (EOS) a foundational Agent... ...all LinkedIn AI Agents. As a Senior Engineer you will own the end-to-end technical vision... ...with distributed data processing engines like Flink Beam Spark etc. feature engineering...Full timeWork at officeFlexible hours$100 - $150 per hour
...Summers , and Jack Dorsey . Position: Management Consulting Expert Type: Contract Compensation: $100–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a consulting context....Remote jobContract workSummer workWork at office$100 - $150 per hour
...Summers and Jack Dorsey . Position: Management Consulting Expert Type: Contract Compensation: $100$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a consulting context. Identify...Full timeContract workSummer workWork at officeRemote work$50 per hour
...Position: English Language and Literature Expert Type: Contract... ...Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated... ...writing, linguistic annotation, language evaluation, or NLP data work in English. Strong...Remote jobContract workSummer work$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Full timeContract workSummer workWork at officeRemote work$80 - $120 per hour
..., Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Full timeContract workSummer workWork at officeRemote workFlexible hours$80 - $120 per hour
...and Jack Dorsey . Position: Training / onboarding / L&D Evaluator Type: Contract Compensation: $80–$120/hour... ...and asynchronously to meet deadlines and ensure high-quality evaluations. Qualifications Must-Have ~5+ years of relevant...Remote jobContract workSummer workWork at office$60 - $80 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type: Contract Compensation: $60–$80/hour Location:...Hourly payFull timeContract workFor contractorsSummer workRemote work$170k per year
...Role: Software Engineering Expert (EE) Location: Toronto, ON Rates: up to $170k per year Structure: Full time -- We have a... ...or technical decision support. Demonstrated ability to evaluate, introduce and drive adoption of new technologies . Understands...Full timeContract work$80 - $120 per hour
..., Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$120 - $170 per hour
...Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Full timeContract workSummer workRemote work- ...combines Strategy, Experience & Design, Engineering and Managed Services. We build digital solutions... ...department is focused on delivering software solutions that enable rich consumer... ...and client partnerships. As a QA / AI Evaluation Engineer, you will join a highly motivated...Full timeImmediate start
$120 - $170 per hour
...Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Full timeContract workSummer workRemote work$50 - $70 per hour
...Larry Summers , and Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation: $50–$... ...Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for...Remote jobContract workSummer workFlexible hours$130k - $170k per year
...intelligence, powerful decision engine, and investigation tools work together... ...the globe. Our award-winning software platform is powered by a team of world-class experts in big data, machine learning,... ...safe usage practices. Build, evaluate, and improve LLM- and agent-...Full time$80 - $120 per hour
...General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role Responsibilities Evaluate AI...Full timeContract workSummer workWork at officeRemote work$111.4k - $161.4k per year
...Senior Software Engineer — Content Tools Content Tools • CoCounsel Legal Integrations Overview... ...the acceptance criteria and utilize evaluation datasets that specify a tool’s behavior... ..., serve as the team’s subject-matter expert in at least one area, and mentor more...Full timeContract workWork at officeLocal areaFlexible hours$135k - $170k per year
...customers . The Opportunity: As a Senior Software Engineer at Vivid Seats, you’ll play a critical... ..., development methods, and technology evaluations. ~ Strengthen relationships across... ..., and act as a subject matter expert across architecture, implementation, deployment...Full timeWork at officeRemote workFlexible hours3 days per week$130k - $140k per year
...HUB office. Job Description Are you a passionate Senior Software Engineer looking to make a significant impact in the fintech space? Join... ...development Work with industry leading Subject Matter Experts and specialist products Regular social events and networking...Part timeWork at officeRemote workWork from homeFlexible hoursCurinos Inc
Toronto, ONmore than 2 months ago$50 - $100 per hour
...$50$100/hr Role Title: Research Engineer - Code Generation & Model Evaluation Role Type: Contractor Location... ...or participation in collaborative software projects. # Strong analytical abilities... ...Compensation is output-based; experts are paid per task that meets the...Full timeFor contractorsRemote work$50 - $100 per hour
...candidates based in Canada. Pay: $50$100/hr Role Title: Senior Software Engineer Role Type : Contractor (15 hrs a week) Location: Remote... ...is required your domain knowledge is what matters. As an expert you will be creating Reinforcement Learning Environments which...Full timeFor contractorsRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineering Evaluator - Expert. Be the first to apply!
Related searches
- test evaluator Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur structure Toronto, ON
- estimateur automobile Toronto, ON
- admissions evaluator Toronto, ON
- estimateur - dessinateur Toronto, ON
- chargé de projet estimateur Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur industriel Toronto, ON
- évaluateur-estimateur Toronto, ON