Software engineer: review and rate AI-written code
$40 - $90 per hourTemporary
HUMXN
Pay: $40–$90/hr
The work
Read code produced by AI systems and judge whether it is correct, safe and idiomatic. Write short, precise explanations of what is wrong and how you would fix it. Some tasks compare two solutions to the same problem; some ask you to write a reference solution of your own.
Who it suits
- Professional experience shipping production code; most tasks are in Python, TypeScript or Java.
- Comfortable reading unfamiliar code quickly and spotting subtle bugs.
- Clear written English.
How it works
- Apply with your background and the hours you can give (10 to 30 hours a week suits most people).
- We check your credentials and identity before any paid work.
- A short paid qualification task shows you the guidelines and shows us you understand them.
- You work remotely, on your own schedule, and are paid for the hours you work.
HUMXN is a new expert network (launched 2026). Payouts go through Stripe after identity and tax verification. Never pay to apply.
Vacancy posted 27 days ago
Similar jobs that could be interesting for youBased on the Software engineer: review and rate AI-written code in Remote vacancy
- ...What You'll Do Review realistic programming tasks for accuracy and difficulty Verify the logic and test cases... ...provided evaluation harnesses Assess whether coding environments effectively measure software engineering skills Walk us through your thought process while analyzing...SuggestedContract workFor contractorsRemote work
$55 - $110 per hour
...RealTrainAI is recruiting experts for its AI coding & SWE reviewer AI training project. Experts help train and evaluate AI models by reviewing, rating and writing responses in their field of expertise. The work is remote and paid hourly. Pay: $55–$110/hr (industry-reported...SuggestedHourly payContract workRemote work$150 per hour
...to work in Remote Fluent proficiency in English (Written & Verbal) Reliable high-speed internet connection... ...experience Demonstrated expertise in Software Engineering How long hiring takes Across the AI training platforms we refer candidates to, the median...SuggestedHourly payRemote work$80 per hour
...Paid, remote contract work turning published software engineering research research into coding tasks for frontier AI agents. For PhD-level researchers and research engineers who publish and ship code. Domain: Software Engineering Research (test generation, program repair,...SuggestedContract workRemote work$90 per hour
...Pay: Up to $90+/hr Experienced software engineers review and score AI-written code for frontier AI research teams. Remote and flexible, up to 40 hours a week. Pay is up to $90+ per hour for the most experienced engineers. Requirements: several years of professional...SuggestedHourly payContract workFor contractorsLive InRemote workFlexible hours- ...Responsibilities Build and ship AI agent features, including... ...that turn telemetry findings into code fixes across customer... ...context enabling agents to safely review and modify Go, Java, Kotlin, TypeScript... .... Partner with customer engineers on deliveries alongside the Customer...Full timeRemote work
- ...GitLab to ship better, more secure software faster. The same principles built into... ...in how our team works: we embrace AI as a core productivity multiplier, with... ...of this role As a Senior Backend Engineer on GitLab's Security Factory: Code Security team, you help developers find...Full timeLive In
- ...What You'll Do Review proposed coding tasks and programming environments for realism Provide technical feedback on the structure and difficulty... ...suites more robust Who Should Apply Professional software engineer based in South Asia Experience building or reviewing...Contract workFor contractorsRemote work
$35 - $55 per hour
...: $35–55/hour Your primary work is reviewing Python code produced by language models in response... ...occur. Tasks arrive through a web-based review interface. You'll encounter a mix of... ...'t need deep ML knowledge — the job is software quality review, not model development....Hourly payContract work- ...applications and next steps. Our partner is looking for a Senior Software Engineer (OpenAI Codex, Claude Code or Cursor) based in Canada. We are seeking a highly... ...the quality of interactions produced by advanced AI coding agents. Rather than developing production software...Hourly payFull timeRemote workFlexible hours
$100 per hour
...details: We're looking for highly experienced software engineer (SR+) to help evaluate the quality of interactions with modern coding agents such as OpenAI Codex and Claude Code.... ...this role actually is You will assess how AI coding agents behave in real-world scenarios,...Contract workRemote workWorldwideFlexible hours- ...Alpheva AI is looking for experienced software engineers to help train and evaluate AI coding systems through realistic repositories and engineering workflows. Projects capture the practical judgment behind reliable software, including understanding unfamiliar systems,...Contract work
- ...About Aleph Aleph is an AI-native platform for Financial Planning... ...(FP&A), an established software category with a multi-billion... ...optimization loop: prompt and context engineering, caching, parallel tool calls,... ...Craft: you care deeply about code quality and write code that's...Full timeApprenticeshipLocal areaRemote work
$100 per hour
...STAFF SOFTWARE ENGINEER (AI EVALS) Contract | $100–$200/hour | 20-40 hrs/week | Start ASAP We’re looking for highly experienced software engineer... ...to help evaluate the quality of interactions with modern coding agents such as OpenAI Codex and Claude Code. This is not a...Full timeContract workImmediate start$100 - $150 per hour
...Evaluate and improve AI coding models by reviewing generated code. Freelance · Remote · North America (only) About Turing Turing is one of... ...development through high-quality training data, evaluations, and engineering talent. Engagement Details Compensation: $100-$...Hourly payFor contractorsFreelanceImmediate startRemote work- ...applications and next steps. Our partner is looking for a Senior Software Engineer, AI/ML based in Canada. Join a product-focused engineering team... ..., prototype, and integrate AI/ML solutions, including writing code and configuring external components. - Produce clean, maintainable...Full time
$125k - $135k per year
...plenty of reasons to SMILE! The Senior Software Developer ( AI/ML) is part of the Smile Labs team in... ...solutions with the development team; write code, configure external components and... ...to the team. In-depth in-person code reviews, pair programming, and collaborative problem...RemplacementFull timeRemote workFlexible hours- ..., and shoppers to thrive. The Enterprise AI team develops intelligent systems and capabilities... ...the company. We are seeking a Senior Software Engineer to join the Enterprise AI team and help... ...to engineering excellence through code reviews, design discussions, automated testing...Long term contractFull timeWork at officeWork from homeFlexible hours
- ...applications and next steps. Our partner is looking for a Python Senior Software Engineer, AI Training based in Canada. We are seeking an experienced... ...contribute to the evaluation and improvement of advanced AI coding agents. Rather than developing production software, you will...Hourly payFull timeContract workRemote workWorldwide10 hours per weekFlexible hours
$149.6k - $199.6k per year
...About the role Coalition is building an AI Automation team to eliminate manual work... ...across the company operate. As a Senior Software Engineer, AI Automation, you will lead the design... ...controls for permissions, auditability, human review, and rollback. Responsibilities...Full timeFixed term contractWork at officeRemote workHome officeFlexible hours- ...campaigns themselves. Teams move faster, stay on brand, and get AI marketing that actually works. Founded in 2019 and headquartered... .... About the Role We’re looking to add a product-minded AI engineer to the team. The ideal candidate will have strong customer and...Full timeRemote work
$125 - $190 per hour
...: $125–$190/hr The work Review model-generated structural and... ...member sizing, load paths and code interpretations against IBC, ASCE... ...suits ~ Licensed professional engineer (PE, CEng or equivalent) with... ...first. You are paid at the rate on this page for every hour of...Contract workRemote work$199.8k - $244.2k per year
...without mandatory fees, interest rates, or credit checks. We’re... ...and resourceful senior backend engineer to own the design, development,... ...drive. At EarnIn, working with AI is expected, not optional. This... ...a high bar for correctness, review, and safety on systems that move...Full timeWork at officeLocal area2 days per week- ...tradeoffs on what matters most. Affirm's engineering team is building a large-scale, fault-tolerant... ...before large changes to systems. The AI Platform team owns Affirm's paved path... ...runbooks, and on-call. - Set and improve code review and design standards, and advocate for them...Full time
$240 per day
...Fully remote, project-based work checking how well AI coding agents handle real software engineering. You write tasks based on your own experience and grade where the agent gets it wrong. $40 to $125 USD an hour, at least 10 hours a week, as an independent contractor. For...Full timeContract workPart timeFor contractorsRemote work10 hours per week$149.6k - $199.6k per year
...technical design and delivery of AI agents, reusable skills, and... ...cases into reliable, maintainable software. Design integrations between... ..., human-in-the-loop review, failure containment, and rollback. Partner with data engineering and business stakeholders to ensure...Full timeRemote workHome officeFlexible hours- ...infrastructure, and developer workflows that make AI-powered engineering more useful, reliable, and easy for... ...the foundations for a more autonomous software development experience at Vanta,... ...systems improve over time through regular review, tuning, and correction. - Improve how...Full time
- ...GitLab to ship better, more secure software faster. The same principles... ...how our team works: we embrace AI as a core productivity multiplier... ...As an Intermediate Backend Engineer, you will take backend features... ...maintainability of shared backend code and services. You will be...Full timeContract workRemote work
$155k - $190k per year
...expanding across desktop, mobile, paid services, AI offerings, and enterprise-facing work to... ..., visit The opportunity As a Staff Software Engineer, Services, you’ll help shape the... ...engineers, and community members to write code, build prototypes, solve complex problems...Long term contractPermanent employmentFull timeLocal areaRemote work- ...client is an energy solutions provider. Our AI-enabled platform supports operations,... ...have Mid-to-senior engineer with strong backend and data fundamentals... ...native development: daily use of agentic AI coding tools, and experience scaling shared AI workflows...Remote job
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software engineer: review and rate AI-written code. Be the first to apply!
Related searches
- software developer remote Remote
- software design engineer Remote
- software engineer devops Remote
- ingénieur logiciel Remote
- part time software developer Remote
- director software engineering Remote
- software engineer - ai machine learning Remote
- software engineer salary in canada Remote
- software engineer - computer Remote
- software developer internship Remote