Average salary: $149,437 /yearly
More statsGet new jobs by email
- ...position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for an AI Evaluation Engineer based in Canada. As a founding AI Evaluation Engineer, you will design and build the evaluation, testing, and observability...SuggestedFull timeRemote work
- ...Evaluate and refine AI-generated code for efficiency and reliability. About Turing... ...P&L Role Overview As a Software Engineering evaluator, you will create cutting-edge... ...communication skills for clear, structured evaluation rationales. Offer Details Commitment...SuggestedFull timePart timeFor contractorsFlexible hours
usd15 per hour
...to influence the future of global AI search? If so, we want you on board! Working on behalf of RWS, you will test and evaluate how our clients’ search engine responds to everyday searches from everyday people. Using your search expertise, you will work through a variety of...SuggestedWeekly payFull timePart timeFreelanceSecond jobRemote workWork from homeHome officeFlexible hours$150 per hour
...Evaluate security tools for vulnerabilities in GenAI applications. About Turing Based... ...Pay up to $150/hr depending on internal evaluation and location. About the Role We’re looking for experienced security engineers to evaluate how effectively static analysis...SuggestedPart timeFor contractors$75 - $90 per hour
...| Canada + 21 more Help a top AI lab evaluate and improve large language models through... ...coding tasks. Bring your software-engineering judgment and hands-on security experience... ...Build or configure coding environments for evaluation and reinforcement learning. Follow detailed...SuggestedLong term contractContract workRemote work- ...We are hiring skilled software engineers with strong full-stack experience. The ideal candidate is comfortable architecting and working across multi-file codebases, structuring realistic development environments, and building reproducible setups supported by clear documentation...SuggestedContract work
- ...data lab for training frontier models and evaluating AI agents. Experts contribute their... ...domains such as finance, healthcare, STEM engineering, and more. micro1 transforms that real-world... ...into high-quality training data, evaluations, and feedback loops that improve how AI...SuggestedPart timeFor contractorsRemote work
- ...About the Role We are looking for software engineers to validate real-world repositories used to evaluate large language models. You will triage issues, set up... ...source GitHub projects. Prepare repositories for evaluation, including containerisation and environment...SuggestedHourly payFor contractorsRemote work
$35 - $49 per hour
...Put frontier AI models through real process engineering problems and mark where their reasoning breaks. Remote, hourly, first batch about... ...hands-on industry work. About the role Sovrano AI builds evaluation and training data for frontier AI labs, and this project tests...SuggestedHourly payContract workPart timeFor contractorsManual laborRemote workShift work$125 per hour
...professional experience Demonstrated expertise in Software Engineering How long hiring takes Across the platforms we work with,... ...this role $125/hr for Senior Machine Learning Engineer / Model Evaluations Expert work puts your Software Engineering expertise on the...SuggestedHourly payContract workRemote work- ...infrastructure companies, working with frontier AI labs to accelerate model development through high-quality training data, evaluations, and engineering talent. About the Role We are looking for senior software engineers with 7+ years of industry experience to support...SuggestedContract workPart timeFor contractors
- ...Analyze GitHub issues and evaluate LLM performance on real code. Job Title: Senior Software Engineer – LLM Evaluation & Repository Validation About the projects: we are building LLM evaluation and training datasets to train LLM to work on realistic software engineering...SuggestedContract workPart timeFor contractorsFreelanceManual laborRemote work
- ...labs and enterprises. Our environments evaluate and improve AI models on complex, long-range... .... Our work includes: Software engineering environments for coding agents UI environments... ...innovations in data, algorithms, evaluation, and training. This role sits at the...SuggestedContract workPart timeFor contractors
- ...programming tasks for accuracy and difficulty Verify the logic and test cases within provided evaluation harnesses Assess whether coding environments effectively measure software engineering skills Walk us through your thought process while analyzing complex code structures...SuggestedContract workFor contractorsRemote work
- ...Provide technical feedback on the structure and difficulty of evaluation harnesses Walk us through your approach to verifying complex code... ...more robust Who Should Apply Professional software engineer based in South Asia Experience building or reviewing realistic...SuggestedContract workFor contractorsRemote work
$70 - $85 per hour
...alternatively Europe remote for strong candidates We are building and evaluating state-of-the-art large language models (LLMs) and are looking for experienced software engineers to join our evaluation and annotation team. This role sits at the intersection of real-world...Long term contractContract workPart timeRemote work- ...data lab for training frontier models and evaluating AI agents. Experts contribute their... ...domains such as finance, healthcare, STEM engineering, and more. micro1 transforms that real-world... ...into high-quality training data, evaluations, and feedback loops that improve how AI...Part timeFor contractorsRemote work
- ...ability to accurately interpret content and assess linguistic issues. Detail-oriented and comfortable with linguistic and stylistic evaluation tasks as well as the technical aspect of this evaluation (synchronicity mainly). Basic understanding of transcription formats and...Part time
- ...Evaluate AI model safety by designing adversarial test prompts and classifications. About... ...: This project supports the evaluation and improvement of safety behavior in large... ...approach: experience in red teaming, prompt engineering, or designing challenge prompts intended...Ongoing contractPart timeFor contractors
$55 - $100 per hour
...will be shared during onboarding. Skills & requirements Physics problem solving Graduate-level mechanics and electromagnetism Technical written communication Critical evaluation of mathematical derivations Meta-level scientific reasoning Category: RLHF...Contract work- ...’re looking for contract, remote French-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance... ...: This is a short-term engagement that starts ASAP Rôle : Évaluateur(trice) de langue française À propos du poste Nous...Contract workTemporary workFreelanceImmediate startRemote work
- ...building a global community of experts to evaluate, challenge and improve advanced AI... ...Machine Learning, LLMs, Mathematics, Science, Engineering, Linguistics, Cybersecurity, Psychology,... ...AI behaviour Domain-Specific AI Evaluation Healthcare & Medicine Law Finance...Part time
- ...About the Role We’re looking for contract, remote Italian-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll assess whether outputs make sense, are consistent, and reflect real-world expectations in Italian. What...Contract workTemporary workFreelanceImmediate startRemote work
- ...Key Responsibilities • Design and implement evaluation metrics for AI models • Conduct thorough testing of model performance across... ...outputs for bias, fairness, and accuracy • Collaborate with ML engineers to implement improvements • Document findings and recommendations...Contract work
- ...About the Role We’re looking for contract, remote German-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll evaluate whether outputs are accurate, consistent, and aligned with real-world expectations in German....Contract workTemporary workImmediate startRemote work
- ...About the Role We’re looking for contract, remote Turkish-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll evaluate whether outputs are coherent, consistent, and aligned with real-world expectations in Turkish....Contract workTemporary workFreelanceImmediate startRemote work
- ...About the Role We’re looking for contract, remote Swedish-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll assess whether outputs are coherent, consistent, and aligned with real-world expectations in Swedish....Contract workTemporary workImmediate startRemote work
- ...pay Required Skills Domain depth Source verification Reasoning clarity Evaluation expertise About micro1 micro1 is a data lab that helps AI labs & Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning...Part timeFor contractorsRemote workFlexible hours
- ...About the Role We’re looking for contract, remote Portuguese-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll be making judgment calls on whether outputs make sense and reflect real-world expectations in Portuguese...Contract workTemporary workFreelanceImmediate startRemote work
- ...figure we cannot stand behind. About the Role AI Safety Evaluation Project | Remote | Contract Locations: US, Canada, UK, Europe,... ...technical field. Strong backgrounds may include Physics, Nuclear Engineering, Nuclear Physics, Radiological Science, Radiation Physics, Health...Hourly payContract workFor contractorsRemote work