SWE Coding Benchmarks & RL Environments
Temporary
Terac
Contract & Payment Terms
You will be engaged as an independent contractor. This is a fully remote opportunity that can be completed on your own schedule. Opportunities can be extended, shortened, or concluded early depending on needs and performance. Your participation will not involve access to confidential or proprietary information from any employer, client, or institution. Payments are processed weekly based on services rendered. We are unable to support H1-B or STEM OPT candidates at this time.
Pay: $75
Vacancy posted 13 days ago
Similar jobs that could be interesting for youBased on the SWE Coding Benchmarks & RL Environments in Remote vacancy
$55 - $110 per hour
...RealTrainAI is recruiting experts for its AI coding & SWE reviewer AI training project. Experts help train and evaluate AI models by reviewing, rating and writing responses in their field of expertise. The work is remote and paid hourly. Pay: $55–$110/hr (industry-reported...SuggestedHourly payContract workRemote work- What You'll Do Interact with a reinforcement learning platform built for these fields Map out realistic scenarios from your field using platform tools Define the variables, constraints, and logic behind real scenarios in your field Provide feedback on the accuracy and usability...SuggestedContract workFor contractorsRemote work
- ...materials, practice tasks, and certification benchmark tasks; manage certifications and... ...and prioritize effectively in a fast-paced environment. Strong track record of reviewing domain... ...one of the following areas: Finance, STEM, Coding/Software Engineering, or other technical...SuggestedLong term contractFull timeTemporary workFor contractorsWork at officeRemote work
- ...researchers who specialize in coding, reasoning, STEM, multilinguality... ...Software Engineers (SWE Bench – Data Engineer / Data Science) to contribute to benchmark-driven evaluation projects focused... ...Turing Work in a fully remote environment. Opportunity to work on cutting...SuggestedContract workPart timeFor contractorsFreelanceManual laborRemote work
$1 350 per unit
...experienced professionals to develop challenging tasks for an AI benchmark. You’ll draw on problems from your own field and turn them into... ...professional experience in a technical domain. Expertise in coding, machine learning, systems, cybersecurity or hardware. At least...SuggestedContract work$70 - $85 per hour
...model reliability, reasoning, and code quality. You will design... ...outputs against rigorous benchmarks, identify failure modes, and contribute... ...(benchmark-style, e.g. SWE-Bench-like problems). Evaluate... ...Build or configure coding environments to support evaluation and reinforcement...Long term contractContract workPart timeRemote work- ...plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality,... ...scale datasets and reinforcement learning environments that power post-training for leading AI... ...learning, post-training, model understanding, benchmarks, and evaluation. What You’ll Do...Contract workPart timeFor contractors
- What You'll Do Build and evaluate complex financial models based on provided corporate data. Document your analytical process and strategic forecasting decisions. Walk us through your methodology using asynchronous screen sharing. Commit around 20 hours per week to complete...Contract workFor contractorsRemote work
- ...Write and validate complex scientific coding tasks in Python for AI training. Role Overview: Turing is building one of the most... ...writing ~ Familiarity with LLM evaluation frameworks or coding benchmarks ~ Experience with libraries such as NumPy, SciPy, SymPy, or...Contract workPart timeFor contractorsFreelance
$50 - $80 per hour
...the human intelligence layer for frontier AI. Puzzle Solver (Coding) Pay: $50–$80/hour Location: Global, fully remote Job Type... ...task may require exploring an unfamiliar codebase or terminal environment, understanding a precise objective, implementing a solution, testing...Part timeFor contractorsImmediate startRemote workFlexible hours- ...are hiring experienced software engineers to design long-horizon coding tasks: realistic, investigation-heavy engineering problems... ...ripples across modules, and building reproducible, containerized environments backed by rigorous tests. You should be able to author a problem...Contract work
$56.7k - $67k per year
...leading brands and agencies. About the Role: The Qualitative Coding Program Manager is responsible for the day to day operations of... ...makes open-ended analysis a delight. You work well in a remote environment; are a self starter known for your high standards of excellence...Full timePart timeCasual workRemote workWork from homeHome officeMonday to fridayFlexible hours- ...Virtualization ~ PyCharm — on macOS About These Applications PyCharm | Python IDE with debugging, refactoring and virtual-environment management | Python developers, backend engineers, data and ML practitioners | Technology Requirement Must be able to capture...Part time
$35 - $55 per hour
...Pay: $35–55/hour Your primary work is reviewing Python code produced by language models in response to natural-language coding prompts. For each task you'll receive the original prompt, one or more model-generated code snippets, and a rubric covering correctness, efficiency...Hourly payContract work- ...Paid, remote work authoring and validating research-grade ML benchmark tasks. For Master's or PhD-level ML researchers with at least one first... ...across machine learning. We are looking for people who write ML code and publish results, not for annotation or data-labelling...Contract workRemote work
$125k - $145k per year
...where everyone has the opportunity to learn, grow and succeed together. Job Overview Jensen Hughes is seeking a Hazardous Materials Code Consultant to join our Canadian Team. We are open to remote work for candidates with demonstrated experience and capability. A...Full timeTemporary workInternshipRemote work$26.5 per hour
...About the Role: The primary function of the Weekend Qualitative Coding Specialist is to work with Fathom's AI to generate, revise, and... ...are process focused, detail oriented and work well in a remote environment, holding yourself accountable to high standards of excellence....Hourly payPart timeRemote workWork from homeFlexible hoursWeekend work- ...experience We are seeking experienced Front-End, UI, and Design Engineers for a project focused on recreating visual references through code with extremely high visual accuracy. Engineers receive an image or visual reference, recreate it using code, render the result, compare...Hourly payContract workFor contractorsRemote work
- ...Review and improve AI-generated code for quality and security. About Turing: Turing is one of the world's leading AGI infrastructure... ...with researchers and engineering teams to design coding benchmarks and improve LLM evaluation methodologies. Required Qualifications...Contract workPart timeFor contractors
- ...role As a Senior Backend Engineer on GitLab's Security Factory: Code Security team, you help developers find and fix security issues.... ...harnesses that measure their false positives and missed findings against benchmark applications with known vulnerabilities, raising the bar for what...Full timeLive In
- ...: $75 · Location: Bahrain · Canada Data Collection Bilingual Code-Switching Conversation Contributor Available in . Apply now on OneForma... ...that you complete from your own location. You will need a quiet environment and a device capable of making clear audio recordings. Each...Part timeRemote work
$55 - $100 per hour
...Pay: $55–100/hour You'll review AI-generated code across the full web stack — JavaScript, TypeScript, Java backend services, and... ...produced. You run the code (in a provided sandbox or your local environment), verify it works as specified, and score it on multiple rubric...Contract workLocal area$80 - $150 per hour
...Job Application for SWE Infrastructure Specialist (Java) – Freelance AI Trainer Project at Meridial Back to jobs SWE Infrastructure... ...? As language models are increasingly applied to enterprise environments, their ability to reason about performance, reliability, and...Hourly payContract workPart timeFor contractorsFreelanceImmediate startRemote work- ...AI, machine learning, or data science. What We Offer At Rise Data Labs, we value our team members and offer a supportive work environment. You will have the opportunity to work on cutting-edge AI projects, develop your skills, and contribute to impactful solutions that...Contract work
- ...applications. Required Skills and Qualifications Proficiency in HTML coding and an understanding of web technologies. Strong attention to... ..., we value our team members and offer a collaborative working environment. You will have opportunities for professional growth and...Contract workFlexible hours
- ...Community as a Bioinformatics AI Expert specializing in advanced benchmark dataset creation and AI model evaluation. In this role, you... ...software, differential expression pipelines) rather than simple code execution or direct text lookups. Chain of Thought (CoT) & Rubric...Part time
- ...position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Senior Environment Artist based in Canada. The Senior Environment Artist will play a key role in building immersive, high-quality environments for a...Full timeInternshipRemote work
$75 - $90 per hour
...language models through security-focused coding tasks. Bring your software-engineering... ...coding prompts and reference answers for benchmark-style problems. Evaluate model outputs... ...models. Build or configure coding environments for evaluation and reinforcement learning...Long term contractContract workRemote work$60 per hour
...Job Application for SWE-Bench AI Task Auditor - Freelance AI Trainer Project at Meridial Back to jobs SWE-Bench AI Task Auditor - Freelance AI Trainer Project World Wide - Remote Project Overview We are sourcing experienced technical specialists in Software...Hourly payContract workPart timeFor contractorsFreelanceRemote work- ...quality assurance. Experience in data annotation and AI model training. Ability to work effectively in a fast-paced, collaborative environment. Excellent communication skills to articulate findings and suggestions. Preferred Qualifications Experience in machine...Hourly payContract workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to SWE Coding Benchmarks & RL Environments. Be the first to apply!
