Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer - AI Reviewer Expert

$150 per hour
Temporary

Ethos

Requirements

Must be eligible to work in Remote
Fluent proficiency in English (Written & Verbal)
Reliable high-speed internet connection
Bachelor's degree or equivalent professional experience
Demonstrated expertise in Software Engineering
How long hiring takes
Across the AI training platforms we refer candidates to, the median gap between
referral and hire is about
30 days
.
It varies by platform and role, so treat it as a rough guide for this one.
Within 2 weeks
~25%
Within 6 weeks
~60%
Within 3 months
~80%
Why this role
At $150/hr, this Software Engineer - AI Reviewer Expert position compensates Software Engineering expertise on its own terms, the kind of rate that would otherwise only show up inside a law firm, hospital, or research lab.
Skills and categories
Explore other opportunities in related specializations:
Software Engineering
High-Pay ($100+/hr)
No Degree Required
Software Engineering & Coding
Engineering & Robotics
RLHF & AI Evaluation
Expert
Related jobs
AI Engineer (LLMs & Agents) Expert
ethos • Software Engineering
$100
/hr
Data Scientist Expert
ethos • Software Engineering
$100
/hr
Head of AI & Engineering Expert
ethos • Software Engineering
$150
/hr
Senior Machine Learning Engineer / Model Evaluations Expert
ethos • Software Engineering
$125
/hr
Browse All Jobs from Ethos
Discover more opportunities on Ethos that match your skills and interests.
View All Ethos Jobs →
Verified Reviews
Loading reviews…
Community Reviews
Loading reviews…
💬
Share your experience with Ethos
Help other candidates make better decisions by leaving a review.
Sign in to leave a review
Common questions
Is Ethos regular AI training work like rating chatbot responses?
No. Ethos is an expert network, not a task queue. AI labs, investment funds, and Fortune 500s pay to access your specific domain knowledge (deal analysis, clinical reasoning, legal logic, financial modeling) through three formats: multi-week consulting engagements, 30-60 minute advisory calls, and targeted research surveys.
Do I need to keep applying for projects on Ethos?
No. Once your profile is live, Ethos's algorithm matches you to inbound opportunities based on your career history, so companies find you instead of you hunting for listings. Your Expert Score rises with each completed engagement and unlocks higher-value work over time. Ethos already works with 25+ private equity firms, hedge funds, and consultancies, so the deal flow behind this is real.
Why do these AI training roles pay so much?
Because general knowledge isn't what's being tested. The model already knows the basics; what it needs is expertise on edge cases, the rare, difficult, highly technical judgment calls only a senior professional in the field would make correctly.
What does the day-to-day workload look like for elite-expert AI training roles?
Slow and deep, not fast and repetitive. A single task can take 45-60 minutes of researching citations or verifying complex calculations. Quality is what's being measured here, not throughput.
What does Software Engineering work look like for a Software Engineer - AI Reviewer Expert?
Tasks here are scoped to Software Engineering, not generic labeling. As a Software Engineer - AI Reviewer Expert, expect to draw on real domain judgment (evaluating outputs, correcting errors, or providing expert reasoning specific to Software Engineering) rather than following a one-size-fits-all rubric. If you don't have hands-on Software Engineering background, this is likely not the right listing to start with.
What specific skills does this listing call for?
Expert is named directly in the listing. If you don't have hands-on experience with this, expect the screening process to test for it directly rather than accepting adjacent experience as a substitute.
How much does this specific role pay?
This listing is posted at $150/hr, an hourly rate. Pay can change between when we last checked the listing and when you apply, so confirm the current number on the platform's own application page before committing time.
What happens when I click Apply on this listing?
You'll be taken to Ethos's external site to complete your application there. This listing links through a referral, but the process is identical to applying directly; the link just routes you correctly. Create an account on their site and follow their onboarding steps.
Who built Ethos and is it legitimate?
Yes, it's legitimate and well-funded: Ethos raised $3.5M from General Catalyst and was co-founded by Daniel Mankowitz (Google DeepMind research scientist and lead author of AlphaDev) and James Lo (McKinsey, SoftBank Vision Fund). Over 17,000 experts have signed up, and it's actively working with 25+ PE firms, hedge funds, and consultancies. The referral link on this page is an affiliate link; it doesn't affect your pay or opportunities.

Vacancy posted 14 days ago
Similar jobs that could be interesting for youBased on the Software Engineer - AI Reviewer Expert in Remote vacancy
  • $150 per hour

     ...STEM How long hiring takes Across the AI training platforms we refer candidates to...  ...this role This Data Scientist - AI Reviewer Expert role pays $150/hr for your STEM judgment...  ...Scientist Expert ethos • STEM $90 /hr Software / AI / IT & Data Generalist Expert... 
    Suggested
    Hourly pay
    Remote work

    Ethos

    Remote
    14 days ago
  •  ...What You'll Do Review realistic programming tasks for accuracy and difficulty Verify the logic and test cases within provided...  ...harnesses Assess whether coding environments effectively measure software engineering skills Walk us through your thought process while analyzing... 
    Suggested
    Contract work
    For contractors
    Remote work

    Terac

    Remote
    14 days ago
  • $80 - $100 per hour

     ...seeking an experienced legal professional to support a short-term AI content evaluation project. You’ll use your legal judgment to assess...  ...feedback that improves its quality. What you’ll do Review legal content for accuracy, consistency, and appropriate context.... 
    Suggested
    Contract work
    Temporary work
    Immediate start
    Remote work

    Braintrust

    Remote
    14 days ago
  • $60 - $120 per hour

     ...RealTrainAI is recruiting experts for its Software architecture reviewer AI training project. Experts help train and evaluate AI models by reviewing, rating and writing responses in their field of expertise. The work is remote and paid hourly. Pay: $60–$120/hr (industry... 
    Suggested
    Hourly pay
    Contract work
    Remote work

    RealTrainAI

    Remote
    9 days ago
  •  ...This is a remote, project-based role for software engineers with 1–3 years of professional experience. You will complete tasks spanning software development, debugging, code review, and technical implementation across a variety of stacks and applications. Work is over the... 
    Suggested
    Contract work
    Remote work
    10 hours per week

    AfterQuery

    Remote
    14 days ago
  •  ...applications and next steps. Our partner is looking for an AI-Directed Software Engineer based in Canada. As an AI-Directed Software Engineer, you will...  ...AI systems can execute efficiently and consistently. - Review, test, debug, and harden AI-generated code to ensure correctness... 
    Full time

    Jobgether

    Remote
    4 days ago
  • $128.5k - $160.6k per year

     ...daily at Coalition. About the role We are hiring a Software Engineer for the Automation team to use AI to solve and automate manual work across Coalition....  ...We utilize AI-assisted tools to help us organize and review the high volume of applications we receive. However, our... 
    Full time
    Fixed term contract
    Live In
    Work at office
    Remote work
    Home office
    Flexible hours

    Coalition, Inc.

    Remote
    9 days ago
  • $100 - $120 per hour

     ...Commitment: Part time, ~40 h/week Field: Software Engineering Mercor is seeking experienced...  ...to support an advanced engineering and AI research initiative with a leading technology...  ...involving real physical systems. Review and evaluate embedded firmware, FPGA/RTL... 
    Part time
    Remote work
    Flexible hours

    Mercor

    Remote
    21 days ago
  • $70 - $150 per hour

     ...Commitment: Part time, ~40 h/week Field: Software Engineering The research teams behind the best-known AI models come to Mercor for software engineering judgment...  ...claims to Flagging where a model's code passes review and would fail in production, given concurrency,... 
    Part time

    Mercor

    Remote
    a month ago
  •  ...automation that supports Telnyx's growth engine. Historically, that meant administering GTM...  ...changing. Telnyx is increasingly building AI agents and automation that interact directly...  ...About the Role We're looking for a Software Engineer who builds and operates the AI-native... 

    Telnyx

    Remote
    4 days ago
  •  ...AfterQuery is seeking College Software Engineer Experts to create and refine software development challenges for training AI models. In this remote, flexible role, you will design and evaluate coding scenarios that test the AI's ability to interpret and apply complex programming... 
    Contract work
    Remote work
    Flexible hours

    AfterQuery

    Remote
    14 days ago
  • $100 per hour

     ...Pay: up to $100/hour In this hourly, remote contractor role, you will work as a Contract Review Subject Matter Expert (SME) to review AI-generated contract analyses and drafting outputs and/or create expert contract content, evaluating reasoning quality and step-by-step... 
    Hourly pay
    Contract work
    For contractors
    For subcontractor
    Immediate start
    Remote work

    SuperAnnotate

    Remote
    11 days ago
  •  ...applications and next steps. Our partner is looking for an AI First iOS Software Engineer based in Canada. We are seeking an AI-driven iOS Software Engineer...  ..., root-cause analysis, and technical documentation. - Review and validate AI-generated code and recommendations to... 
    Full time
    Remote work

    Jobgether

    Remote
    4 days ago
  •  ...Who we are: Process Street is an AI software and compliance operations platform startup from San Francisco. We help our customers build,...  ...you! The Opportunity We’re looking for a Senior Software Engineer to help architect and evolve Process Street into an AI-native product... 
    Full time
    Summer work
    Internship
    Live In
    Remote work

    Process Street

    Remote
    2 days ago
  •  ...position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Software Engineer | AI SaaS Software based in Canada. Join an innovative, remote-first engineering team transforming how software is designed,... 
    Full time
    Remote work

    Jobgether

    Remote
    7 days ago
  • $75 - $90 per hour

     ...States | Canada + 21 more Help a top AI lab evaluate and improve large language...  ...security-focused coding tasks. Bring your software-engineering judgment and hands-on security...  ...Helpful, not required Professional code review, coding annotation, LLM/code evaluation... 
    Long term contract
    Contract work
    Remote work

    Braintrust

    Remote
    14 days ago
  •  ...Key Responsibilities Train and improve AI models by annotating and labeling data specific to mechanical engineering. Review and validate AI-generated content for accuracy and domain relevance. Provide expert insights to enhance AI model performance in the mechanical... 
    Contract work
    Flexible hours

    Rise Data Labs

    Remote
    14 days ago
  • $100 per hour

     ...Qualifications Current or recent CTO, Head of AI, or equivalent technology leader...  ...About Ethos Ethos is a new expert network built by a McKinsey/SoftBank/DeepMind...  ...~80% Why this role Few outlets pay Software Engineering specialists what the leading AI labs pay... 
    Hourly pay
    Contract work
    Remote work

    Ethos

    Remote
    5 days ago
  •  ...Review AI-generated claims in French (FR) and flag uncertainty, gaps, inaccuracies, or overconfidence. Research and compare multiple sources, including news, official statements, databases, and other reliable references. Assess source credibility and determine whether... 
    Part time
    Freelance
    Remote work

    e2f

    Remote
    14 days ago
  • $85 per hour

     ...months ~80% Why this role At $85/hr, this Utilization Review Nurse / Managed Care Expert position compensates Healthcare expertise on its own terms,...  ...networks, but it's slower than the weekly payouts some AI training platforms offer, so plan your cash flow around it.... 
    Hourly pay
    Contract work
    Manual labor
    Remote work

    Ethos

    Remote
    7 days ago
  •  ...people with a Philosophy background to help AI models become more logical and ethical. You don't need to be a tech expert. Your job is to read what the AI writes and make...  ...then B must be A"—is that actually true?). Review Ethics: Look at how the AI handles "right vs.... 
    Part time

    TELUS International

    Remote
    15 days ago
  •  ...NMI is looking for a passionate Senior Software Engineer to join our Development team as a result of...  ...you will join a team of industry-leading experts that are talented, ambitious and want to...  ...systems is preferred for this specific role. AI-assisted development is core to how we... 
    Full time

    Nmi

    Remote
    3 days ago
  •  ...Required Skills System Design Code Review Debugging Algorithms Data Structures Software Architecture About micro1 micro1 is a data lab that helps AI labs & Enterprises train...  ...recruiting agent sources and vets domain experts for our data platform that enables... 
    For contractors
    Remote work

    micro1

    Remote
    4 days ago
  •  ...Cloud leaders, architects, and engineers. We are seeking candidates...  ...including public cloud platforms, AI and LLMs, Kubernetes, data...  ...years of experience working in a Software Engineering capacity ~ Excellent...  .... You are the subject matter experts for our customers.  We are... 
    Full time
    Contract work
    Temporary work
    Remote work

    Zencore

    Remote
    5 days ago
  • $40 - $150 per hour

     ...agentic coding sessions on real engineering tasks, analyze what the models...  ...on its own. Analyze the AI's work against production standards...  ...fits Common backgrounds: Software Engineer, Backend Engineer,...  ...DataAnnotation is where 100k+ experts train the world’s leading AI models... 
    Weekly pay
    Full time
    Contract work
    For contractors
    Remote work
    Flexible hours

    DataAnnotation

    Remote
    9 days ago
  • $114.5k - $148k per year

     ...disease in one billion people. As a Backend Engineer, you’ll build reliable systems, improve...  ...also excited to find someone who brings an AI-augmented mindset, using modern tools and...  ...recruiting process, including application review, candidate screening, and interview note taking... 
    Long term contract
    Work at office
    Remote work

    Virta Health

    Remote
    2 days ago
  •  ...micro1 micro1 is the leading AI data lab for training frontier...  ...and evaluating AI agents. Experts contribute their diverse subject...  ...as finance, healthcare, STEM engineering, and more. micro1 transforms that...  ...testing Solid code review instincts Preferred Qualifications... 
    Part time
    For contractors
    Internship
    Remote work
    Flexible hours

    micro1

    Remote
    11 days ago
  •  ...Hol' dir den Kick als DocCheck Software Engineer – AI-Assisted Development (m/w/d) Seit Jahrzehnten ist DocCheck im DACH-Raum und darüber hinaus eine bekannte Healthcare-Größe. Nun gehen wir technologisch den nächsten Schritt. DocCheck Schweiz realisiert das Entwicklungssetup... 
    Full time
    Fixed term contract
    Remote work

    DocCheck AG

    Remote
    a month ago
  •  ...micro1 micro1 is the leading AI data lab for training frontier...  ...and evaluating AI agents. Experts contribute their diverse subject...  ...as finance, healthcare, STEM engineering, and more. micro1 transforms that...  ...AI. Role Title: Senior Software Engineer Role Type: Contractor... 
    Part time
    For contractors
    Remote work

    micro1

    Remote
    14 days ago
  •  ...About the Role We are looking for experienced software engineers to help train and evaluate AI models on real-world programming work. You will build and validate coding tasks, review AI-generated code, and write the reference solutions and tests that models are measured... 
    Hourly pay
    For contractors
    Remote work

    RemoExperts

    Remote
    14 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer - AI Reviewer Expert. Be the first to apply!