Average salary: $89,511 /yearly

More stats
Get new jobs by email
  •  ...users. That's where you come in. You'll test different AI experiences using your own...  ...and select your preferred experience. Evaluate conversational quality, helpfulness, clarity...  ...testing guidelines and document your evaluations accurately. Who we're looking for Active... 
    Suggested
    Hourly pay
    Temporary work
    Part time
    Remote work

    micro1

    Remote
    9 days ago
  •  ...Notez et comparez des réponses d'IA et justifiez vos évaluations, dans le cadre d'un travail rémunéré depuis chez vous. Ce poste convient aux...  ...justifications écrites aident à entraîner des modèles d'IA et à tester leurs réponses. Le travail Notez et comparez des réponses... 
    Suggested
    Contract work
    Local area

    YPAI

    Remote
    11 days ago
  •  ...in LLM Training, you will engage in qualitative and structured evaluations to enhance AI performance. Your key activities will include:...  ...improve AI models. You'll work on tasks like evaluating code, testing AI-generated solutions, and providing feedback that directly teaches... 
    Suggested
    Contract work
    Freelance
    Flexible hours

    Revelo

    Remote
    15 days ago
  •  ...teach. What the work is for YPAI Learn trains people for AI evaluation work in live classes. Your classes take learners from a gut...  ...browser for the grading exercise. You take and pass the instructor test for a class before you teach it for the first time. Before a... 
    Suggested
    Contract work
    Remote work

    YPAI

    Remote
    9 days ago
  •  .... That’s you.   As our first AI Agent Evaluation Engineer, you define what quality means for...  ...-mode coverage map: which behaviors are tested, partially tested, or unmeasured; close the...  ...measure whether they do. ~ Able to design a test from an open-ended quality question: you... 
    Suggested
    Full time
    Work at office
    Remote work
    Home office
    Flexible hours

    Cresta

    Remote
    8 days ago
  •  ...This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an Evaluation Consultant based in Canada. This opportunity offers experienced evaluation professionals the chance to contribute to international development... 
    Suggested
    Full time
    Remote work

    Jobgether

    Remote
    18 days ago
  •  ...compiler pass that miscompiles an edge case, a consensus protocol that splits on a network partition, or a CI build that flakes because of test ordering. Specialties We're Looking For We're building depth across: Algorithms and data structures Distributed and operating... 
    Suggested
    Contract work

    Workada

    Remote
    1 day ago
  •  ...Activities As an Entertainment & Pop Culture Evaluator, you will help refine AI models to ensure...  ...domain relevance. Content & Response Evaluation: Assessing AI-generated summaries, trivia...  ...'ll work on tasks like evaluating code, testing AI-generated solutions, and providing... 
    Suggested
    Contract work
    Freelance
    Flexible hours

    Revelo

    Remote
    15 days ago
  •  ...Create and evaluate security tasks for GenAI applications. About Turing Based in San...  ...versions, document security findings, and write tests for each vulnerability mechanism. Where...  ...~ Experience with AI red teaming or LLM evaluation. Skills: Cyber Security, LLM,... 
    Suggested
    Part time
    For contractors

    Turing

    Remote
    16 days ago
  •  ...position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for an AI Voice Evaluation Specialist based in Canada. Join an innovative AI-focused environment as an AI Voice Evaluation Specialist, where you will... 
    Suggested

    Jobgether

    Remote
    4 days ago
  •  ...actually good is the single most important question in the business, and it deserves a full-time owner. That’s you. As our first AI Agent Evaluation Engineer, you define what quality means for every agent we run, you build the systems that measure it across every conversation, and... 
    Suggested
    Full time

    Cresta

    Remote
    8 days ago
  • $40 - $60 per hour

     ...Pay: $40 - $60/hour Required Skills image evaluation visual content imagen editing constructive feedback About micro1 micro1 is a data lab that helps AI labs & Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement... 
    Suggested
    Part time
    For contractors
    Remote work

    micro1

    Remote
    17 days ago
  •  ...Fitness Specialist in LLM Training, you will evaluate AI-generated health, wellness, and...  ...clarity and domain alignment. Response Evaluation: Assessing AI-generated fitness advice, workout...  ...'ll work on tasks like evaluating code, testing AI-generated solutions, and providing... 
    Suggested
    Contract work
    Freelance
    Flexible hours

    Revelo

    Remote
    15 days ago
  •  ...study guides, and educational scenarios to evaluate clarity, target audience alignment, and...  ...instructional relevance. Response & Content Evaluation: Assessing AI-generated explanations,...  ...'ll work on tasks like evaluating code, testing AI-generated solutions, and providing... 
    Suggested
    Contract work
    Freelance
    Flexible hours

    Revelo

    Remote
    15 days ago
  •  ...individuals to join our talent pool for an upcoming AI Response Evaluation and Fact-Checking project . This freelance, remote...  ...will be required to complete a short French Language & Reasoning Test designed to assess French language proficiency and reasoning skills... 
    Suggested
    Contract work
    Freelance
    Remote work
    Flexible hours

    e2f

    Remote
    19 days ago
  •  ...companies. Role Overview: We are seeking detail-oriented evaluators to support the evaluation and benchmarking of 2D and 3D embodied AI agents. In this...  ...in animation, motion capture, biomechanics, game testing, or visual annotation. Experience evaluating motion quality... 
    Part time

    Turing

    Remote
    4 days ago
  • $75 - $90 per hour

     ...professionals to create realistic cases for testing AI. You’ll draw on the kinds of files you...  ...that matter to the outcome, so each case tests whether the AI applied the rules...  ...plus. Experience writing or reviewing AI evaluation cases or training data is a plus. Contract... 
    Contract work
    Freelance
    Manual labor
    Remote work

    Braintrust

    Remote
    2 days ago
  •  ...What You'll Do Design benchmark evaluations based on real-world data analytics scenarios. Format complex data problems for systematic testing and review. Commit 20 or more hours per week to continuous project work. Who Should Apply Professional experience in data... 
    Permanent employment
    Contract work
    For contractors
    Remote work

    Terac

    Remote
    3 days ago
  •  ...applications and next steps. Our partner is looking for a Search Engine Evaluator - Chinese Simplified based in Canada. In this flexible, remote...  ...and assessing its significance. - Complete a variety of evaluation assignments to help improve AI training data and search engine... 
    Hourly pay
    Full time
    Contract work
    Temporary work
    Part time
    Freelance
    Local area
    Remote work
    Work from home
    Home office
    Flexible hours

    Jobgether

    Remote
    3 days ago
  •  ...Design and execute evaluations for Large Language Models and agentic workflows. About Turing Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced... 
    Contract work
    Part time
    For contractors
    Freelance
    Remote work

    Turing

    Remote
    3 days ago
  •  ...steps. Our partner is looking for a Senior Test and Quality Analyst based in Canada. We...  ...connectivity, security, load, and stress testing to evaluate application behavior under different...  ..., particularly performance testing and evaluation. - Strong analytical and problem-solving... 
    Remote work

    Jobgether

    Remote
    9 days ago
  •  ...This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Test Engineer based in Canada. Join a specialized testing initiative focused on modernizing document generation and Customer Communication Management... 
    Full time
    Part time

    Jobgether

    Remote
    15 days ago
  •  ...This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Test Automation Engineer based in Canada . As a Test Automation Engineer, you will play a key role in ensuring the reliability, performance, and... 
    Full time
    Remote work

    Jobgether

    Remote
    3 days ago
  •  ...Korea, India, Malaysia, Singapore, Canada, and the U.S. Want to know more details, please click on the website. Machine Learning Test Developer Location: Markham ON Key Responsibilities Test development for Computer Vision / Machine Learning (CVML) applications... 

    Thundersoft

    Remote
    15 days ago
  •  ...ability to accurately interpret content and assess linguistic issues. Detail-oriented and comfortable with linguistic and stylistic evaluation tasks as well as the technical aspect of this evaluation (synchronicity mainly). Basic understanding of transcription formats and... 
    Part time

    OneForma

    Remote
    a month ago
  •  ...Resource Innovations is looking for an experienced DSM Evaluation Manager to join our expanding team. In this role, you will provide technical support and project management services within the Advisory Services Group business unit, focusing on energy efficiency program planning... 
    Full time
    Internship
    Work at office

    Resource Innovations

    Remote
    12 days ago
  •  ...deployment. Learn more at veracode. com , on the Veracode blog , and on LinkedIn and Twitter . We are looking for a motivated Performance Test Engineer with 3–5 years of experience to join our Quality Engineering team. The ideal candidate will have hands-on experience in... 
    Full time
    Worldwide

    Veracode

    Remote
    4 days ago
  •  ...artificial intelligence understands complex healthcare information, evaluates medical scenarios, and delivers more accurate, reliable...  ...advanced healthcare trainees with opportunities to contribute to the evaluation and improvement of advanced Artificial Intelligence (AI) models... 
    Contract work
    For contractors
    Traineeship
    Remote work

    Volga Partners

    Remote
    16 days ago
  • $10 - $30 per hour

     ...About micro1 micro1 is a data lab that helps AI labs & Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM capabilities, as well as contextual evaluations to monitor and improve AI agents... 
    Part time
    For contractors
    Remote work
    Shift work

    micro1

    Remote
    26 days ago
  •  ...Curate and evaluate code in Rust to enhance AI training datasets. About Us Based in San Francisco, California, Turing is the world...  ...oral and written communication skills for clear, structured evaluation rationales. Engagement Details Commitment: flexible engagement... 
    Part time
    For contractors
    Flexible hours

    Turing

    Remote
    15 days ago