Software Engineering Evaluator - Expert
$100 - $150 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Software Engineer Expert
Type: Contract
Compensation: $100–$150/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts for usability in a software engineering context.
- Identify factual, aesthetic, and presentation errors in slides , spreadsheets , and documents .
- Provide clear, structured written feedback to improve AI model outputs .
- Apply deep subject-matter expertise to grade outputs and enhance quality.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- 5+ years of relevant professional experience in Software Engineering at a top firm in the United States , United Kingdom , Canada , Australia , or New Zealand .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace (PowerPoint, Excel, Word).
Preferred
- Advanced degree ( Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Software Engineering Evaluator - Expert in Toronto, ON vacancy
$80 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at office$100 - $150 per hour
...Jack Dorsey . Position: Sales Engineering Expert Type: Contract Compensation... ...with technically complex B2B software such as SaaS , cloud infrastructure... ...Prior experience with AI training , evaluation, or human-data projects. Application...SuggestedRemote jobContract workSummer work$170k per year
...Role: Software Engineering Expert (EE) Location: Toronto, ON Rates: up to $170k per year Structure: Full time -- We have a... ...or technical decision support. Demonstrated ability to evaluate, introduce and drive adoption of new technologies . Understands...SuggestedFull timeContract work$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Engineering / manufacturing / technical operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role...SuggestedRemote jobContract workSummer workWork at office$50 per hour
...Larry Summers , and Jack Dorsey . Position: French Linguistic Experts Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated French text across various...Remote jobContract workSummer work$149k - $168k per year
...supports over 3,500 dealerships nationwide, delivering cutting-edge software tools to simplify operations, boost marketing, and drive... ...The opportunity We are looking for a hands-on Engineering Expert who will be: setting technical direction across product boundaries...Internship$150 per hour
...Larry Summers , and Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation: $150/hour... ...Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses to challenging medical problems...Remote jobContract workSummer workImmediate startFlexible hours$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $100–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in data science contexts....Remote jobContract workSummer workWork at office$50 per hour
...Position: English Language and Literature Expert Type: Contract... ...Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated... ...writing, linguistic annotation, language evaluation, or NLP data work in English. Strong...Remote jobContract workSummer work$70 per hour
...and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour... ...Publications in peer-reviewed journals. Prior scientific software or research engineering experience. Start Date ~ Immediate...Remote jobContract workSummer workImmediate start$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Finance operations / audit support Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$14 per hour
...Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract... ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation... ...years experience as a music producer, audio engineer, or sound mixer. ~ College degree in...Remote jobContract workSummer workImmediate start$87.4k - $137.4k per year
...Job Description As a Software Engineer on the Litigation Drafting team you will be building the next generation of AI agentic product for... ..., you may contact our Human Resources Department at HR.Leave-Expert@thomsonreuters.com . Disability accommodations in the recruiting...Work at officeLocal areaFlexible hours- ...Technology (I&T) team, a critical piece of the engine that keeps us in motion. From enterprise... ...we do matters. Join us! Job Summary The Expert, Data Engineering is responsible to lead/... ...analyze data pipelines ~ Help unify software development and operations seamlessly, efficiently...Full timeWork at officeRemote workMonday to friday
- ...At Foundation AI, we are looking for a Software Enginee r to help design, develop, and optimize... ...learn and adapt. You’ll collaborate with engineers, product managers, and designers to build... ...complex systems; optimizes performance; evaluates trade-offs. Additional Skills:...Full timeFor contractorsInternshipRemote work
$80 - $120 per hour
...and Jack Dorsey . Position: Training / onboarding / L&D Evaluator Type: Contract Compensation: $80–$120/hour... ...and asynchronously to meet deadlines and ensure high-quality evaluations. Qualifications Must-Have ~5+ years of relevant...Remote jobContract workSummer workWork at office$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Healthcare / clinical Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: General Sales / GTM Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$50 - $70 per hour
...Larry Summers , and Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation: $50–$... ...Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for...Remote jobContract workSummer workFlexible hours$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Cybersecurity / IT GRC Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$60 - $80 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type: Contract Compensation: $60–$80/hour Location:...Remote jobHourly payContract workFor contractorsSummer work$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at officeFlexible hours$80 - $150 per hour
..., Larry Summers , and Jack Dorsey . Position: Design Expert Type: Contract Compensation: $80–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobContract workSummer work$96.56k - $128.74k per year
...Canada and the world better through trade. Position: Senior Software Engineer, Edge Delivery Services, Design Systems & AI-Enabled... ...Crown corporation, we offer innovative financial solutions and expert insights to help businesses explore new markets, mitigate risks...Permanent employmentFull timeContract workSummer workWork at officeRelocation package3 days per week$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobContract workSummer work$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/hour... ...independently and asynchronously to meet deadlines while improving evaluation processes. Qualifications Must-Have ~5+ years...Remote jobContract workSummer work- ...Principal Software Engineer The global capital markets are among the largest markets in the world valued at $50T+ and growing. Transactions... ..., you may contact our Human Resources Department at HR.Leave-Expert@thomsonreuters.com . Disability accommodations in the recruiting...Long term contractFull timeWork at officeLocal areaFlexible hours
$180k - $220k per year
...Xello is looking for a Principal Engineer Please note that this is a remote role open to... ...partnership with our DevOps team, ensuring our software solutions are highly available,... ...ability to navigate disagreement respectfully, evaluate competing ideas fairly, and drive...Long term contractFull timeRemote workFlexible hours$88.82k - $106.59k per year
...warehouses, canonical and ready to query, with no engineering or maintenance required. We’re proud that... ...movement across the systems, clouds, engines, and tools they rely on. dbt Labs... ...thousands of companies. We’re looking for a Software Engineer I enthusiastic to join our fast-...Contract workInternshipWork at officeRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineering Evaluator - Expert. Be the first to apply!
Related searches
- estimateur structure Toronto, ON
- admissions evaluator Toronto, ON
- chargé de projet estimateur Toronto, ON
- évaluateur-estimateur Toronto, ON
- test evaluator Toronto, ON
- estimateur automobile Toronto, ON
- estimateur - dessinateur Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur industriel Toronto, ON