Average salary: $152,280 /yearly
More statsGet new jobs by email
- ...Create and evaluate security tasks for GenAI applications. About Turing Based in San... ...looking for experienced GenAI Security Engineers to create and evaluate security tasks for... ...~ Experience with AI red teaming or LLM evaluation. Skills: Cyber Security, LLM,...SuggestedPart timeFor contractors
- ...Evaluate and refine AI-generated code for efficiency and reliability. About Turing... ...P&L Role Overview As a Software Engineering evaluator, you will create cutting-edge... ...communication skills for clear, structured evaluation rationales. Offer Details Commitment...SuggestedFull timePart timeFor contractorsFlexible hours
usd15 per hour
...to influence the future of global AI search? If so, we want you on board! Working on behalf of RWS, you will test and evaluate how our clients’ search engine responds to everyday searches from everyday people. Using your search expertise, you will work through a variety of...SuggestedWeekly payFull timePart timeFreelanceSecond jobRemote workWork from homeHome officeFlexible hours- ...Analyze GitHub issues and evaluate LLM performance in real-world code. About the Role... ...We are looking for experienced software engineers (tech lead level) who are familiar with... ...Previous participation in LLM research or evaluation projects. Experience building or testing...SuggestedContract workPart timeFor contractorsFreelanceManual laborRemote work
$90 per hour
...Pay: Up to $90+/hr Experienced software engineers review and score AI-written code for frontier AI research teams. Remote and flexible, up to 40 hours a week. Pay is up to $90+ per hour for the most experienced engineers. Requirements: several years of professional...SuggestedHourly payContract workFor contractorsLive InRemote workFlexible hours- ...We are hiring skilled software engineers with strong full-stack experience. The ideal candidate is comfortable architecting and working across multi-file codebases, structuring realistic development environments, and building reproducible setups supported by clear documentation...SuggestedContract work
- ...About the Role We are looking for software engineers to validate real-world repositories used to evaluate large language models. You will triage issues, set up... ...source GitHub projects. Prepare repositories for evaluation, including containerisation and environment...SuggestedHourly payFor contractorsRemote work
$125 per hour
...professional experience Demonstrated expertise in Software Engineering How long hiring takes Across the platforms we work with,... ...this role $125/hr for Senior Machine Learning Engineer / Model Evaluations Expert work puts your Software Engineering expertise on the...SuggestedHourly payContract workRemote work- ...This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an Evaluation Consultant based in Canada. This opportunity offers experienced evaluation professionals the chance to contribute to international development...SuggestedFull timeRemote work
- ...Analyze GitHub issues and evaluate LLM performance on real code. Job Title: Senior Software Engineer – LLM Evaluation & Repository Validation About the projects: we are building LLM evaluation and training datasets to train LLM to work on realistic software engineering...SuggestedContract workPart timeFor contractorsFreelanceManual laborRemote work
- ...across seven domains (among others): - **Natural sciences and engineering:** biology, chemistry, physics, earth sciences, robotics, math,... ...programming languages - **Machine learning:** training, inference, evaluation, and kernels - **Security:** cryptography, reverse engineering,...SuggestedShift work
- ...Notez et comparez des réponses d'IA et justifiez vos évaluations, dans le cadre d'un travail rémunéré depuis chez vous. Ce poste convient aux lecteurs attentifs, capables de dire pourquoi une réponse est fausse, et pas seulement qu'elle l'est. À quoi sert ce travail...SuggestedContract workLocal area
- ...Compare AI responses and select your preferred experience. Evaluate conversational quality, helpfulness, clarity, tone, and overall... ...moments. Follow simple testing guidelines and document your evaluations accurately. Who we're looking for Active ChatGPT user, using...SuggestedHourly payTemporary workPart timeRemote work
- ...Main Activities As a Research Specialist in LLM Training, you will engage in qualitative and structured evaluations to enhance AI performance. Your key activities will include: Prompt Analysis: Reviewing user prompts to assess clarity, relevance, research context, and...SuggestedContract workFreelanceFlexible hours
$40 - $60 per hour
...Pay: $40 - $60/hour Required Skills image evaluation visual content imagen editing constructive feedback About micro1 micro1 is a data lab that helps AI labs & Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement...SuggestedPart timeFor contractorsRemote work- ...Resource Innovations is looking for an experienced DSM Evaluation Manager to join our expanding team. In this role, you will provide technical... ...will include leading impact evaluations and offering engineering and analytical support. Your specific duties will involve overseeing...Full timeInternshipWork at office
$10 - $24 per hour
...a ready class kit, remotely, and you are paid for each class you teach. What the work is for YPAI Learn trains people for AI evaluation work in live classes. Your classes take learners from a gut feeling about one AI response to a rating they can back with evidence, and...Contract workRemote work- ...programming tasks for accuracy and difficulty Verify the logic and test cases within provided evaluation harnesses Assess whether coding environments effectively measure software engineering skills Walk us through your thought process while analyzing complex code structures...Contract workFor contractorsRemote work
- ...Provide technical feedback on the structure and difficulty of evaluation harnesses Walk us through your approach to verifying complex code... ...more robust Who Should Apply Professional software engineer based in South Asia Experience building or reviewing realistic...Contract workFor contractorsRemote work
- ...Main Activities As an Entertainment & Pop Culture Evaluator, you will help refine AI models to ensure they accurately understand media... ...clarity, context, and domain relevance. Content & Response Evaluation: Assessing AI-generated summaries, trivia, reviews, creative writing...Contract workFreelanceFlexible hours
- ...ability to accurately interpret content and assess linguistic issues. Detail-oriented and comfortable with linguistic and stylistic evaluation tasks as well as the technical aspect of this evaluation (synchronicity mainly). Basic understanding of transcription formats and...Part time
$20 - $60 per hour
...About micro1 micro1 is a data lab that helps AI labs & Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM capabilities, as well as contextual evaluations to monitor and improve AI agents...Part timeFor contractorsRemote work- ...As a Health & Fitness Specialist in LLM Training, you will evaluate AI-generated health, wellness, and exercise content to ensure safety... ...health to confirm clarity and domain alignment. Response Evaluation: Assessing AI-generated fitness advice, workout programs, meal...Contract workFreelanceFlexible hours
- ...Reviewing learning prompts, lesson plans, study guides, and educational scenarios to evaluate clarity, target audience alignment, and instructional relevance. Response & Content Evaluation: Assessing AI-generated explanations, tutorials, practice exercises, and study...Contract workFreelanceFlexible hours
- ...artificial intelligence understands complex healthcare information, evaluates medical scenarios, and delivers more accurate, reliable... ...advanced healthcare trainees with opportunities to contribute to the evaluation and improvement of advanced Artificial Intelligence (AI) models...Contract workFor contractorsTraineeshipRemote work
$30 - $60 per hour
...Pay: $30 - $60/hour Required Skills Domain depth Source verification Reasoning clarity Evaluation expertise About micro1 micro1 is a data lab that helps AI labs & Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement...Part timeFor contractorsRemote workFlexible hours- ...AI-related projects? We're currently looking for detail-oriented individuals to join our talent pool for an upcoming AI Response Evaluation and Fact-Checking project . This freelance, remote opportunity is ideal for candidates with experience in AI data annotation, fact...Contract workFreelanceRemote workFlexible hours
$55 - $100 per hour
...will be shared during onboarding. Skills & requirements Physics problem solving Graduate-level mechanics and electromagnetism Technical written communication Critical evaluation of mathematical derivations Meta-level scientific reasoning Category: RLHF...Contract workusd16 per hour
...We are looking for AI Linguistic Evaluators to assess how effectively an AI application performs in Marathi for a short collaboration. Job... ..., and cultural appropriateness. - Providing structured evaluations and feedback following the project instructions and quality standards...Hourly payDaily paidFull timeFreelanceImmediate startRemote workFlexible hours- ...Key Responsibilities • Design and implement evaluation metrics for AI models • Conduct thorough testing of model performance across... ...outputs for bias, fairness, and accuracy • Collaborate with ML engineers to implement improvements • Document findings and recommendations...Contract work