Software Engineer - AI Reviewer Expert
$150 per hourEthos
Requirements
Must be eligible to work in Remote
Fluent proficiency in English (Written & Verbal)
Reliable high-speed internet connection
Bachelor's degree or equivalent professional experience
Demonstrated expertise in Software Engineering
How long hiring takes
Across the AI training platforms we refer candidates to, the median gap between
referral and hire is about
30 days
.
It varies by platform and role, so treat it as a rough guide for this one.
Within 2 weeks
~25%
Within 6 weeks
~60%
Within 3 months
~80%
Why this role
At $150/hr, this Software Engineer - AI Reviewer Expert position compensates Software Engineering expertise on its own terms, the kind of rate that would otherwise only show up inside a law firm, hospital, or research lab.
Skills and categories
Explore other opportunities in related specializations:
Software Engineering
High-Pay ($100+/hr)
No Degree Required
Software Engineering & Coding
Engineering & Robotics
RLHF & AI Evaluation
Expert
Related jobs
AI Engineer (LLMs & Agents) Expert
ethos ⢠Software Engineering
$100
/hr
Data Scientist Expert
ethos ⢠Software Engineering
$100
/hr
Head of AI & Engineering Expert
ethos ⢠Software Engineering
$150
/hr
Senior Machine Learning Engineer / Model Evaluations Expert
ethos ⢠Software Engineering
$125
/hr
Browse All Jobs from Ethos
Discover more opportunities on Ethos that match your skills and interests.
View All Ethos Jobs â
Verified Reviews
Loading reviewsâ¦
Community Reviews
Loading reviewsâ¦
ð¬
Share your experience with Ethos
Help other candidates make better decisions by leaving a review.
Sign in to leave a review
Common questions
Is Ethos regular AI training work like rating chatbot responses?
No. Ethos is an expert network, not a task queue. AI labs, investment funds, and Fortune 500s pay to access your specific domain knowledge (deal analysis, clinical reasoning, legal logic, financial modeling) through three formats: multi-week consulting engagements, 30-60 minute advisory calls, and targeted research surveys.
Do I need to keep applying for projects on Ethos?
No. Once your profile is live, Ethos's algorithm matches you to inbound opportunities based on your career history, so companies find you instead of you hunting for listings. Your Expert Score rises with each completed engagement and unlocks higher-value work over time. Ethos already works with 25+ private equity firms, hedge funds, and consultancies, so the deal flow behind this is real.
Why do these AI training roles pay so much?
Because general knowledge isn't what's being tested. The model already knows the basics; what it needs is expertise on edge cases, the rare, difficult, highly technical judgment calls only a senior professional in the field would make correctly.
What does the day-to-day workload look like for elite-expert AI training roles?
Slow and deep, not fast and repetitive. A single task can take 45-60 minutes of researching citations or verifying complex calculations. Quality is what's being measured here, not throughput.
What does Software Engineering work look like for a Software Engineer - AI Reviewer Expert?
Tasks here are scoped to Software Engineering, not generic labeling. As a Software Engineer - AI Reviewer Expert, expect to draw on real domain judgment (evaluating outputs, correcting errors, or providing expert reasoning specific to Software Engineering) rather than following a one-size-fits-all rubric. If you don't have hands-on Software Engineering background, this is likely not the right listing to start with.
What specific skills does this listing call for?
Expert is named directly in the listing. If you don't have hands-on experience with this, expect the screening process to test for it directly rather than accepting adjacent experience as a substitute.
How much does this specific role pay?
This listing is posted at $150/hr, an hourly rate. Pay can change between when we last checked the listing and when you apply, so confirm the current number on the platform's own application page before committing time.
What happens when I click Apply on this listing?
You'll be taken to Ethos's external site to complete your application there. This listing links through a referral, but the process is identical to applying directly; the link just routes you correctly. Create an account on their site and follow their onboarding steps.
Who built Ethos and is it legitimate?
Yes, it's legitimate and well-funded: Ethos raised $3.5M from General Catalyst and was co-founded by Daniel Mankowitz (Google DeepMind research scientist and lead author of AlphaDev) and James Lo (McKinsey, SoftBank Vision Fund). Over 17,000 experts have signed up, and it's actively working with 25+ PE firms, hedge funds, and consultancies. The referral link on this page is an affiliate link; it doesn't affect your pay or opportunities.
$150 per hour
...STEM How long hiring takes Across the AI training platforms we refer candidates to... ...this role This Data Scientist - AI Reviewer Expert role pays $150/hr for your STEM judgment... ...Scientist Expert ethos ⢠STEM $90 /hr Software / AI / IT & Data Generalist Expert...SuggestedHourly payRemote work- ...What You'll Do Review realistic programming tasks for accuracy and difficulty Verify the logic and test cases within provided... ...harnesses Assess whether coding environments effectively measure software engineering skills Walk us through your thought process while analyzing...SuggestedContract workFor contractorsRemote work
$80 - $100 per hour
...seeking an experienced legal professional to support a short-term AI content evaluation project. You’ll use your legal judgment to assess... ...feedback that improves its quality. What you’ll do Review legal content for accuracy, consistency, and appropriate context....SuggestedContract workTemporary workImmediate startRemote work$60 - $120 per hour
...RealTrainAI is recruiting experts for its Software architecture reviewer AI training project. Experts help train and evaluate AI models by reviewing, rating and writing responses in their field of expertise. The work is remote and paid hourly. Pay: $60–$120/hr (industry...SuggestedHourly payContract workRemote work- ...This is a remote, project-based role for software engineers with 1–3 years of professional experience. You will complete tasks spanning software development, debugging, code review, and technical implementation across a variety of stacks and applications. Work is over the...SuggestedContract workRemote work10 hours per week
- ...applications and next steps. Our partner is looking for an AI-Directed Software Engineer based in Canada. As an AI-Directed Software Engineer, you will... ...AI systems can execute efficiently and consistently. - Review, test, debug, and harden AI-generated code to ensure correctness...Full time
$128.5k - $160.6k per year
...daily at Coalition. About the role We are hiring a Software Engineer for the Automation team to use AI to solve and automate manual work across Coalition.... ...We utilize AI-assisted tools to help us organize and review the high volume of applications we receive. However, our...Full timeFixed term contractLive InWork at officeRemote workHome officeFlexible hours$100 - $120 per hour
...Commitment: Part time, ~40 h/week Field: Software Engineering Mercor is seeking experienced... ...to support an advanced engineering and AI research initiative with a leading technology... ...involving real physical systems. Review and evaluate embedded firmware, FPGA/RTL...Part timeRemote workFlexible hours$70 - $150 per hour
...Commitment: Part time, ~40 h/week Field: Software Engineering The research teams behind the best-known AI models come to Mercor for software engineering judgment... ...claims to Flagging where a model's code passes review and would fail in production, given concurrency,...Part time- ...automation that supports Telnyx's growth engine. Historically, that meant administering GTM... ...changing. Telnyx is increasingly building AI agents and automation that interact directly... ...About the Role We're looking for a Software Engineer who builds and operates the AI-native...
- ...AfterQuery is seeking College Software Engineer Experts to create and refine software development challenges for training AI models. In this remote, flexible role, you will design and evaluate coding scenarios that test the AI's ability to interpret and apply complex programming...Contract workRemote workFlexible hours
$100 per hour
...Pay: up to $100/hour In this hourly, remote contractor role, you will work as a Contract Review Subject Matter Expert (SME) to review AI-generated contract analyses and drafting outputs and/or create expert contract content, evaluating reasoning quality and step-by-step...Hourly payContract workFor contractorsFor subcontractorImmediate startRemote work- ...applications and next steps. Our partner is looking for an AI First iOS Software Engineer based in Canada. We are seeking an AI-driven iOS Software Engineer... ..., root-cause analysis, and technical documentation. - Review and validate AI-generated code and recommendations to...Full timeRemote work
- ...Who we are: Process Street is an AI software and compliance operations platform startup from San Francisco. We help our customers build,... ...you! The Opportunity We’re looking for a Senior Software Engineer to help architect and evolve Process Street into an AI-native product...Full timeSummer workInternshipLive InRemote work
- ...position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Software Engineer | AI SaaS Software based in Canada. Join an innovative, remote-first engineering team transforming how software is designed,...Full timeRemote work
$75 - $90 per hour
...States | Canada + 21 more Help a top AI lab evaluate and improve large language... ...security-focused coding tasks. Bring your software-engineering judgment and hands-on security... ...Helpful, not required Professional code review, coding annotation, LLM/code evaluation...Long term contractContract workRemote work- ...Key Responsibilities Train and improve AI models by annotating and labeling data specific to mechanical engineering. Review and validate AI-generated content for accuracy and domain relevance. Provide expert insights to enhance AI model performance in the mechanical...Contract workFlexible hours
$100 per hour
...Qualifications Current or recent CTO, Head of AI, or equivalent technology leader... ...About Ethos Ethos is a new expert network built by a McKinsey/SoftBank/DeepMind... ...~80% Why this role Few outlets pay Software Engineering specialists what the leading AI labs pay...Hourly payContract workRemote work- ...Review AI-generated claims in French (FR) and flag uncertainty, gaps, inaccuracies, or overconfidence. Research and compare multiple sources, including news, official statements, databases, and other reliable references. Assess source credibility and determine whether...Part timeFreelanceRemote work
$85 per hour
...months ~80% Why this role At $85/hr, this Utilization Review Nurse / Managed Care Expert position compensates Healthcare expertise on its own terms,... ...networks, but it's slower than the weekly payouts some AI training platforms offer, so plan your cash flow around it....Hourly payContract workManual laborRemote work- ...people with a Philosophy background to help AI models become more logical and ethical. You don't need to be a tech expert. Your job is to read what the AI writes and make... ...then B must be A"—is that actually true?). Review Ethics: Look at how the AI handles "right vs....Part time
- ...NMI is looking for a passionate Senior Software Engineer to join our Development team as a result of... ...you will join a team of industry-leading experts that are talented, ambitious and want to... ...systems is preferred for this specific role. AI-assisted development is core to how we...Full time
- ...Required Skills System Design Code Review Debugging Algorithms Data Structures Software Architecture About micro1 micro1 is a data lab that helps AI labs & Enterprises train... ...recruiting agent sources and vets domain experts for our data platform that enables...For contractorsRemote work
- ...Cloud leaders, architects, and engineers. We are seeking candidates... ...including public cloud platforms, AI and LLMs, Kubernetes, data... ...years of experience working in a Software Engineering capacity ~ Excellent... .... You are the subject matter experts for our customers. We are...Full timeContract workTemporary workRemote work
$40 - $150 per hour
...agentic coding sessions on real engineering tasks, analyze what the models... ...on its own. Analyze the AI's work against production standards... ...fits Common backgrounds: Software Engineer, Backend Engineer,... ...DataAnnotation is where 100k+ experts train the world’s leading AI models...Weekly payFull timeContract workFor contractorsRemote workFlexible hours$114.5k - $148k per year
...disease in one billion people. As a Backend Engineer, you’ll build reliable systems, improve... ...also excited to find someone who brings an AI-augmented mindset, using modern tools and... ...recruiting process, including application review, candidate screening, and interview note taking...Long term contractWork at officeRemote work- ...micro1 micro1 is the leading AI data lab for training frontier... ...and evaluating AI agents. Experts contribute their diverse subject... ...as finance, healthcare, STEM engineering, and more. micro1 transforms that... ...testing Solid code review instincts Preferred Qualifications...Part timeFor contractorsInternshipRemote workFlexible hours
- ...Hol' dir den Kick als DocCheck Software Engineer – AI-Assisted Development (m/w/d) Seit Jahrzehnten ist DocCheck im DACH-Raum und darüber hinaus eine bekannte Healthcare-Größe. Nun gehen wir technologisch den nächsten Schritt. DocCheck Schweiz realisiert das Entwicklungssetup...Full timeFixed term contractRemote work
- ...micro1 micro1 is the leading AI data lab for training frontier... ...and evaluating AI agents. Experts contribute their diverse subject... ...as finance, healthcare, STEM engineering, and more. micro1 transforms that... ...AI. Role Title: Senior Software Engineer Role Type: Contractor...Part timeFor contractorsRemote work
- ...About the Role We are looking for experienced software engineers to help train and evaluate AI models on real-world programming work. You will build and validate coding tasks, review AI-generated code, and write the reference solutions and tests that models are measured...Hourly payFor contractorsRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer - AI Reviewer Expert. Be the first to apply!
- software developer no experience Remote
- junior software developer Remote
- software developer entry level Remote
- software developer intern Remote
- software developer internship no experience Remote
- software developer Remote
- software development engineer Remote
- part time software developer Remote
- software design engineer Remote
- software engineer salary in canada Remote
