Average salary: $89,511 /yearly
More statsGet new jobs by email
- ...users. That's where you come in. You'll test different AI experiences using your own... ...and select your preferred experience. Evaluate conversational quality, helpfulness, clarity... ...testing guidelines and document your evaluations accurately. Who we're looking for Active...SuggestedHourly payTemporary workPart timeRemote work
- ...Notez et comparez des réponses d'IA et justifiez vos évaluations, dans le cadre d'un travail rémunéré depuis chez vous. Ce poste convient aux... ...justifications écrites aident à entraîner des modèles d'IA et à tester leurs réponses. Le travail Notez et comparez des réponses...SuggestedContract workLocal area
- ...in LLM Training, you will engage in qualitative and structured evaluations to enhance AI performance. Your key activities will include:... ...improve AI models. You'll work on tasks like evaluating code, testing AI-generated solutions, and providing feedback that directly teaches...SuggestedContract workFreelanceFlexible hours
- ...teach. What the work is for YPAI Learn trains people for AI evaluation work in live classes. Your classes take learners from a gut... ...browser for the grading exercise. You take and pass the instructor test for a class before you teach it for the first time. Before a...SuggestedContract workRemote work
- .... That’s you. As our first AI Agent Evaluation Engineer, you define what quality means for... ...-mode coverage map: which behaviors are tested, partially tested, or unmeasured; close the... ...measure whether they do. ~ Able to design a test from an open-ended quality question: you...SuggestedFull timeWork at officeRemote workHome officeFlexible hours
- ...This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an Evaluation Consultant based in Canada. This opportunity offers experienced evaluation professionals the chance to contribute to international development...SuggestedFull timeRemote work
- ...compiler pass that miscompiles an edge case, a consensus protocol that splits on a network partition, or a CI build that flakes because of test ordering. Specialties We're Looking For We're building depth across: Algorithms and data structures Distributed and operating...SuggestedContract work
- ...Activities As an Entertainment & Pop Culture Evaluator, you will help refine AI models to ensure... ...domain relevance. Content & Response Evaluation: Assessing AI-generated summaries, trivia... ...'ll work on tasks like evaluating code, testing AI-generated solutions, and providing...SuggestedContract workFreelanceFlexible hours
- ...Create and evaluate security tasks for GenAI applications. About Turing Based in San... ...versions, document security findings, and write tests for each vulnerability mechanism. Where... ...~ Experience with AI red teaming or LLM evaluation. Skills: Cyber Security, LLM,...SuggestedPart timeFor contractors
- ...position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for an AI Voice Evaluation Specialist based in Canada. Join an innovative AI-focused environment as an AI Voice Evaluation Specialist, where you will...Suggested
- ...actually good is the single most important question in the business, and it deserves a full-time owner. That’s you. As our first AI Agent Evaluation Engineer, you define what quality means for every agent we run, you build the systems that measure it across every conversation, and...SuggestedFull time
$40 - $60 per hour
...Pay: $40 - $60/hour Required Skills image evaluation visual content imagen editing constructive feedback About micro1 micro1 is a data lab that helps AI labs & Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement...SuggestedPart timeFor contractorsRemote work- ...Fitness Specialist in LLM Training, you will evaluate AI-generated health, wellness, and... ...clarity and domain alignment. Response Evaluation: Assessing AI-generated fitness advice, workout... ...'ll work on tasks like evaluating code, testing AI-generated solutions, and providing...SuggestedContract workFreelanceFlexible hours
- ...study guides, and educational scenarios to evaluate clarity, target audience alignment, and... ...instructional relevance. Response & Content Evaluation: Assessing AI-generated explanations,... ...'ll work on tasks like evaluating code, testing AI-generated solutions, and providing...SuggestedContract workFreelanceFlexible hours
- ...individuals to join our talent pool for an upcoming AI Response Evaluation and Fact-Checking project . This freelance, remote... ...will be required to complete a short French Language & Reasoning Test designed to assess French language proficiency and reasoning skills...SuggestedContract workFreelanceRemote workFlexible hours
- ...companies. Role Overview: We are seeking detail-oriented evaluators to support the evaluation and benchmarking of 2D and 3D embodied AI agents. In this... ...in animation, motion capture, biomechanics, game testing, or visual annotation. Experience evaluating motion quality...Part time
$75 - $90 per hour
...professionals to create realistic cases for testing AI. You’ll draw on the kinds of files you... ...that matter to the outcome, so each case tests whether the AI applied the rules... ...plus. Experience writing or reviewing AI evaluation cases or training data is a plus. Contract...Contract workFreelanceManual laborRemote work- ...What You'll Do Design benchmark evaluations based on real-world data analytics scenarios. Format complex data problems for systematic testing and review. Commit 20 or more hours per week to continuous project work. Who Should Apply Professional experience in data...Permanent employmentContract workFor contractorsRemote work
- ...applications and next steps. Our partner is looking for a Search Engine Evaluator - Chinese Simplified based in Canada. In this flexible, remote... ...and assessing its significance. - Complete a variety of evaluation assignments to help improve AI training data and search engine...Hourly payFull timeContract workTemporary workPart timeFreelanceLocal areaRemote workWork from homeHome officeFlexible hours
- ...Design and execute evaluations for Large Language Models and agentic workflows. About Turing Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced...Contract workPart timeFor contractorsFreelanceRemote work
- ...steps. Our partner is looking for a Senior Test and Quality Analyst based in Canada. We... ...connectivity, security, load, and stress testing to evaluate application behavior under different... ..., particularly performance testing and evaluation. - Strong analytical and problem-solving...Remote work
- ...This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Test Engineer based in Canada. Join a specialized testing initiative focused on modernizing document generation and Customer Communication Management...Full timePart time
- ...This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Test Automation Engineer based in Canada . As a Test Automation Engineer, you will play a key role in ensuring the reliability, performance, and...Full timeRemote work
- ...Korea, India, Malaysia, Singapore, Canada, and the U.S. Want to know more details, please click on the website. Machine Learning Test Developer Location: Markham ON Key Responsibilities Test development for Computer Vision / Machine Learning (CVML) applications...
- ...ability to accurately interpret content and assess linguistic issues. Detail-oriented and comfortable with linguistic and stylistic evaluation tasks as well as the technical aspect of this evaluation (synchronicity mainly). Basic understanding of transcription formats and...Part time
- ...Resource Innovations is looking for an experienced DSM Evaluation Manager to join our expanding team. In this role, you will provide technical support and project management services within the Advisory Services Group business unit, focusing on energy efficiency program planning...Full timeInternshipWork at office
- ...deployment. Learn more at veracode. com , on the Veracode blog , and on LinkedIn and Twitter . We are looking for a motivated Performance Test Engineer with 3–5 years of experience to join our Quality Engineering team. The ideal candidate will have hands-on experience in...Full timeWorldwide
- ...artificial intelligence understands complex healthcare information, evaluates medical scenarios, and delivers more accurate, reliable... ...advanced healthcare trainees with opportunities to contribute to the evaluation and improvement of advanced Artificial Intelligence (AI) models...Contract workFor contractorsTraineeshipRemote work
$10 - $30 per hour
...About micro1 micro1 is a data lab that helps AI labs & Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM capabilities, as well as contextual evaluations to monitor and improve AI agents...Part timeFor contractorsRemote workShift work- ...Curate and evaluate code in Rust to enhance AI training datasets. About Us Based in San Francisco, California, Turing is the world... ...oral and written communication skills for clear, structured evaluation rationales. Engagement Details Commitment: flexible engagement...Part timeFor contractorsFlexible hours
