South Asian Software Engineers: Coding Tasks for AI Evaluation
Temporary
Terac
What You'll Do
Review proposed coding tasks and programming environments for realism Provide technical feedback on the structure and difficulty of evaluation harnesses Walk us through your approach to verifying complex code challenges Suggest improvements to make the test suites more robust
Who Should Apply
Professional software engineer based in South Asia Experience building or reviewing realistic programming tasks Familiarity with coding evaluation harnesses or test automation Comfortable discussing technical workflows in an interview setting
Contract & Payment Terms
You will be engaged as an independent contractor. This is a fully remote opportunity that can be completed on your own schedule. Opportunities can be extended, shortened, or concluded early depending on needs and performance. Your participation will not involve access to confidential or proprietary information from any employer, client, or institution. Payments are processed weekly based on services rendered. We are unable to support H1-B or STEM OPT candidates at this time.
Pay: $40
Vacancy posted 12 days ago
Similar jobs that could be interesting for youBased on the South Asian Software Engineers: Coding Tasks for AI Evaluation in Remote vacancy
- ...What You'll Do Review realistic programming tasks for accuracy and difficulty Verify the logic and test cases within provided evaluation harnesses Assess whether coding environments effectively measure software engineering skills Walk us through your thought process while...SuggestedContract workFor contractorsRemote work
$75 - $90 per hour
...week Experience: 5 - 10 years Location: United States | Canada + 21 more Help a top AI lab evaluate and improve large language models through security-focused coding tasks. Bring your software-engineering judgment and hands-on security experience to work involving...SuggestedLong term contractContract workRemote work- ...About micro1 micro1 is the leading AI data lab for training frontier models and evaluating AI agents. Experts contribute... ...such as finance, healthcare, STEM engineering, and more. micro1 transforms that... ...Role Title: Research Engineer - Code Generation & Model Evaluation...SuggestedPart timeFor contractorsRemote work
- ...Review and improve AI-generated code for quality and security. About Turing: Turing is one of the world's leading AGI infrastructure... ...model development through high-quality training data, evaluations, and engineering talent. About the Role We are looking for senior...SuggestedContract workPart timeFor contractors
- ...provide Choose which model to use for each task, and switch whenever you naturally would... ...Qualifications Actively building a verifiable software project (side project, startup, or LLM-powered feature) Regular user of AI coding tools such as Cursor, Claude Code, Codex, or...SuggestedPart timeImmediate startRemote workFlexible hours
- ...Evaluate and refine AI-generated code for efficiency and reliability. About Turing Based in San Francisco, California, Turing is the world’s leading... ...lasting results on the P&L Role Overview As a Software Engineering evaluator, you will create cutting-edge datasets...Full timePart timeFor contractorsFlexible hours
- ...applications and next steps. Our partner is looking for an AI-Directed Software Engineer based in Canada. As an AI-Directed Software Engineer, you will... ..., databases, and cloud infrastructure. Using AI coding tools as your primary implementation engine, you will transform...Full time
- ...GitLab to ship better, more secure software faster. The same principles built into... ...in how our team works: we embrace AI as a core productivity multiplier, with... ...of this role As a Senior Backend Engineer on GitLab's Security Factory: Code Security team, you help developers find...Full timeLive In
$70 - $85 per hour
...strong candidates We are building and evaluating state-of-the-art large language models (LLMs) and are looking for experienced software engineers to join our evaluation and annotation... ...engineering, model evaluation, and applied AI , and is critical to improving model reliability...Long term contractContract workPart timeRemote work- ...that supports Telnyx's growth engine. Historically, that meant administering... ...is increasingly building AI agents and automation that... ...the Role We're looking for a Software Engineer who builds and operates... ...deeply about what happens after code merges. Responsibilities...
$85 per hour
...Do Review pairs of images presented on our digital platform. Evaluate each image against a specific set of brand guidelines. Select... ...applying written brand guidelines Ability to make clear, decisive evaluations between similar visual assets Access to a reliable computer and...Ongoing contractContract workFor contractorsRemote work$55 - $100 per hour
...Pay: $55–100/hour You'll review AI-generated code across the full web stack — JavaScript, TypeScript... ..., maintainability, and adherence to the task specification. For each task, you... ...encounter backend architecture tasks where you evaluate whether a Node.js or Java service is...Contract workLocal area- ...About the Role We are looking for software engineers to validate real-world repositories used to evaluate large language models. You will triage issues, set up reproducible... ...well written the unit tests are. Edit and run code locally to see how LLMs perform on bug-fixing...Hourly payFor contractorsRemote work
$128.5k - $160.6k per year
...daily at Coalition. About the role We are hiring a Software Engineer for the Automation team to use AI to solve and automate manual work across Coalition.... ...make decisions, not just to make a slide look good. Coding agents: Fluent with agentic coding tools like Cursor....Full timeFixed term contractLive InWork at officeRemote workHome officeFlexible hours- ...Who we are: Process Street is an AI software and compliance operations platform startup from... ...Opportunity We’re looking for a Senior Software Engineer to help architect and evolve Process... ...comfortable working in multi-session coding environments, leveraging tools like Claude...Full timeSummer workInternshipLive InRemote work
- ...applications and next steps. Our partner is looking for an AI First iOS Software Engineer based in Canada. We are seeking an AI-driven iOS Software Engineer... ...an essential part of your workflow, helping you accelerate coding, testing, debugging, and documentation. Working closely...Full timeRemote work
- ...applications and next steps. Our partner is looking for a Senior Software Engineer | AI SaaS Software based in Canada. Join an innovative, remote-... ...AI-assisted engineering systems, using tools such as Claude Code and Codex to accelerate implementation and problem-solving. Beyond...Full timeRemote work
- ...What You'll Do Author task scenarios grounded in real work —... ...deliverable should include Grade AI-generated deliverables (often... ...sessions with other evaluators to align scoring standards... ...experience with AI model training, evaluation, or benchmark development is a...Contract workFlexible hours
- ...Analyze GitHub issues and evaluate LLM performance on real code. Job Title: Senior Software Engineer – LLM Evaluation & Repository Validation About the projects: we are building LLM evaluation and training datasets to train LLM to work on realistic software engineering...Contract workPart timeFor contractorsFreelanceManual laborRemote work
$60 - $100 per hour
...Hourly, ~20 h/week Field: Other Engineering About the Role Mercor is partnering with a leading AI lab to measure how well frontier... ...realistic, difficult design tasks that expose where AI still falls... ...highly valued. Tasks are built with code-based CAD (build123d, CadQuery,...Hourly payContract workFreelanceImmediate start- ...develop systems to enhance frontier AI capabilities. About Turing:... ...researchers who specialize in coding, reasoning, STEM,... ...enterprises. Our environments evaluate and improve AI models on complex... ...Experience. Our work includes: Software engineering environments for...Contract workPart timeFor contractors
- ...We are hiring skilled software engineers with strong full-stack experience. The ideal candidate is comfortable architecting and working across multi-file codebases, structuring realistic development environments, and building reproducible setups supported by clear documentation...Contract work
$55 - $110 per hour
...RealTrainAI is recruiting experts for its AI coding & SWE reviewer AI training project. Experts help train and evaluate AI models by reviewing, rating and writing responses in their field of expertise. The work is remote and paid hourly. Pay: $55–$110/hr (industry-reported...Hourly payContract workRemote work- ...Evaluate AI model safety by designing adversarial test prompts and classifications. About... ...plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality,... ...approach: experience in red teaming, prompt engineering, or designing challenge prompts intended...Ongoing contractPart timeFor contractors
- ...Lead teams to create and evaluate realistic LLM conversational data.... ...Turing Turing is a leading AI company accelerating the advancement... ...capabilities in reasoning, coding, agentic behavior,... ...Overview We are looking for an Engineering Manager to lead teams creating...Contract workPart timeFreelanceRemote work
- ...a global community of experts to evaluate, challenge and improve advanced AI systems . We are looking for... ...Learning, LLMs, Mathematics, Science, Engineering, Linguistics, Cybersecurity,... ...Data and technical accuracy Coding and computational outputs LLM &...Part time
- ...About the Role We are looking for experienced software engineers to help train and evaluate AI models on real-world programming work. You will build and validate coding tasks, review AI-generated code, and write the reference solutions and tests that models are measured...Hourly payFor contractorsRemote work
- ...place. Work is paid hourly or per task depending on the engagement.... ...Front-End, UI, and Design Engineers for a project focused on recreating... ...visual references through code with extremely high visual accuracy... ...Requirements •3+ years of software engineering experience •...Hourly payContract workFor contractorsRemote work
- ...lifecycle. They work closely with AI teams to provide intelligent... ...Reddit’s mission. As a backend engineer on the team, candidates might work... ...at this level must be able to code independently, but may work... ...day to day project management tasks including communicating project...RemplacementFull timeFor contractorsWork at officeRemote workFlexible hours
- ...Radiological Science · Health Physics · AI Safety · CBRN What this... .... Work is paid hourly or per task depending on the engagement.... ...About the Role AI Safety Evaluation Project | Remote | Contract... ...may include Physics, Nuclear Engineering, Nuclear Physics, Radiological...Hourly payContract workFor contractorsRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to South Asian Software Engineers: Coding Tasks for AI Evaluation. Be the first to apply!
Related searches
- software developer no experience Remote
- junior software developer Remote
- software developer entry level Remote
- software developer intern Remote
- software developer internship no experience Remote
- software developer Remote
- software development engineer Remote
- part time software developer Remote
- ingénieur logiciel Remote
- software design engineer Remote