Software Engineering Evaluator - Expert
$100 - $150 per hourMercor
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Software Engineer Expert
Type: Contract
Compensation: $100–$150/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts for usability in a software engineering context.
- Identify factual, aesthetic, and presentation errors in slides , spreadsheets , and documents .
- Provide clear, structured written feedback to improve AI model outputs .
- Apply deep subject-matter expertise to grade outputs and enhance quality.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- 5+ years of relevant professional experience in Software Engineering at a top firm in the United States , United Kingdom , Canada , Australia , or New Zealand .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace (PowerPoint, Excel, Word).
Preferred
- Advanced degree ( Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$149k - $168k per year
...supports over 3,500 dealerships nationwide, delivering cutting-edge software tools to simplify operations, boost marketing, and drive... ...The opportunity We are looking for a hands-on Engineering Expert who will be: setting technical direction across product boundaries...SuggestedInternship$80 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at office$100 - $150 per hour
...Jack Dorsey . Position: Sales Engineering Expert Type: Contract Compensation... ...with technically complex B2B software such as SaaS , cloud infrastructure... ...Prior experience with AI training , evaluation, or human-data projects. Application...SuggestedRemote jobContract workSummer work$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Engineering / manufacturing / technical operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role...SuggestedRemote jobContract workSummer workWork at office$39 per hour
...answering questions, and correcting errors. Rate the experience and deliverables, providing concise notes on performance. Evaluate AI model interactions to ensure alignment with professional healthcare standards. Work independently and asynchronously to meet...Remote job$39 per hour
About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Healthcare...Full timeContract workSummer workRemote work$50 per hour
...Larry Summers , and Jack Dorsey . Position: English Linguistic Experts Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated English text across...Remote jobContract workSummer work$57 per hour
About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position...Remote jobHourly payContract workFor contractorsSummer work$150 per hour
...Larry Summers , and Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation: $150/hour... ...Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses on challenging medical problems...Remote jobContract workSummer workImmediate start$170k per year
...Role: Software Engineering Expert (EE) Location: Toronto, ON Rates: up to $170k per year Structure: Full time -- We have a... ...or technical decision support. Demonstrated ability to evaluate, introduce and drive adoption of new technologies . Understands...Full timeContract work$150 per hour
...Larry Summers , and Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation: $150/hour... ...Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses to challenging medical problems...Remote jobContract workSummer workImmediate startFlexible hours- ...seamlessly transfer the question to our care experts team. We build the cockpit for that... ...Influence product direction, mentor other engineers, and lead technical initiatives that shape... ...Requirements: ~5+ years building scalable software systems ~ Full-stack experience (...Full timeLive InImmediate startRemote work
$180 per hour
...Larry Summers , and Jack Dorsey . Position: Senior Software Engineering Experts Type: Contract Compensation: $120–$180/... ...engineering work, collaborating with AI coding agents to evaluate success and failure. Apply consistent, evidence-based...Remote jobContract workSummer work$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $100–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in data science contexts....Remote jobContract workSummer workWork at office$14 per hour
...Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract... ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation... ...years experience as a music producer, audio engineer, or sound mixer. ~ College degree in...Remote jobContract workSummer workImmediate start$70 per hour
...and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour... ...Publications in peer-reviewed journals. Prior scientific software or research engineering experience. Start Date ~ Immediate...Remote jobContract workSummer workImmediate start$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobContract workSummer work$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Healthcare operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: People ops / recruiting Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Finance operations / audit support Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$70 - $100 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type: Contract Compensation: $70–$100/hour Location:...Remote jobContract workSummer workInternship$140k - $175k per year
...Reuters Labs is seeking a Lead Research Engineer to lead the design and delivery of production-ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build... ...Human Resources Department at HR.Leave-Expert@thomsonreuters.com. Disability accommodations...Full timeInternshipWork at officeLocal areaFlexible hours$50 - $70 per hour
...Larry Summers , and Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation: $50–$... ...Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for...Remote jobContract workSummer workFlexible hours$80 - $150 per hour
..., Larry Summers , and Jack Dorsey . Position: Design Expert Type: Contract Compensation: $80–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobContract workSummer work$50 per hour
...Position: English Language and Literature Expert Type: Contract... ...Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated... ...writing, linguistic annotation, language evaluation, or NLP data work in English. Strong...Remote jobContract workSummer work$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office- ...resilient businesses. Our Engineering team is at the heart of building... ..., impact-driven Senior Software Engineer (Voyager) to join our... ...exploratory initiatives that evaluate and validate emerging technologies... ...product teams as the AI expert in the room, helping them make...Long term contractWork from home
- ...The Software Engineer is an intermediate level position responsible for participation in the establishment and implementation of new or revised... ...analysts Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions Resolve...Full time
$80 - $150 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Software Engineer — Agentic Search Systems Type: Contract... ...independently and asynchronously to enhance search quality and evaluation. Qualifications Must-Have Experience with production...Remote jobContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineering Evaluator - Expert. Be the first to apply!
- admissions evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur - dessinateur Toronto, ON
- test evaluator Toronto, ON
- estimateur automobile Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur structure Toronto, ON
- estimateur industriel Toronto, ON
- chargé de projet estimateur Toronto, ON
