Average salary: $41,181 /yearly

More stats
Get new jobs by email
  • $80 - $120 per hour

     ...Evaluate AI-generated artifacts remotely for Mercor, applying healthcare expertise and precise written feedback across clinical content....  ...higher Bring healthcare judgment, document review skills, and clear writing to Mercor's remote AI evaluation contract. #J-18808-Ljbffr
    Suggested
    Hourly pay
    Contract work
    Work at office
    Remote work

    MyHealth Centre

    Mississauga, ON
    2 days ago
  •  ...your own work and turn each one into a self-contained Task that an AI agent has to solve in a Linux terminal. For every Task, you'll...  ...programming languages - **Machine learning:** training, inference, evaluation, and kernels - **Security:** cryptography, reverse engineering,... 
    Suggested
    Shift work

    Workada

    Remote
    3 days ago
  •  ...Evaluate AI applications in Marathi through translation and linguistic review while working remotely on a short collaboration. Assess accuracy...  ...adherence Ability to provide objective, consistent evaluations independently Apply Marathi language expertise, translation... 
    Suggested
    Remote work

    RWS

    Winnipeg, MB
    5 days ago
  • Evaluate frontier AI models using circuit analysis and electronics engineering expertise. Work remotely from an eligible country, if applicable. This Electrical Engineering AI Evaluator designs realistic engineering problems grounded in professional practice. You will assess... 
    Suggested
    Internship
    Remote work

    MissionHires

    Winnipeg, MB
    3 days ago
  •  ...Review and rate AI coding solutions for real software engineering tasks. About Turing...  ...systems. You’ll be at the forefront of evaluating how LLMs interact with real code,...  ...Engineers to support a frontier AI training and evaluation initiative focused on improving the coding... 
    Suggested
    Part time
    For contractors
    Freelance
    Remote work

    Turing

    Remote
    4 days ago
  • usd16 per hour

     ...We are looking for AI Linguistic Evaluators to assess how effectively an AI application performs in Marathi for a short collaboration. This role...  ..., and cultural appropriateness. Providing structured evaluations and feedback following the project instructions and quality... 
    Suggested
    Hourly pay
    Remote work

    RWS

    Toronto, ON
    5 days ago
  •  ...Evaluate AI-generated responses remotely for clarity, accuracy, and human reasoning while developing prompts across generalist subject areas...  ...Bring research judgment, concise communication, and response evaluation skills to Mercor’s AI benchmarking and prompt-development work.... 
    Suggested
    For contractors
    Remote work

    Mercor

    Mississauga, ON
    1 day ago
  • $30 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors...  ...tasks guiding it answering questions and correcting errors. Evaluate the experience and deliverables providing concise feedback on performance... 
    Suggested
    Hourly pay
    Weekly pay
    Full time
    Contract work
    For contractors
    Summer work
    Remote work

    Mercor

    Toronto, ON
    1 day ago
  •  ...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task-based...  ...clinical EHR vignettes for a medical AI evaluation project. General and internal medicine are the... 
    Suggested
    Part time
    For contractors
    Remote work
    Flexible hours

    Mindrift

    Hamilton, ON
    1 day ago
  • $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...pipelines , and technical reports. Evaluate AI-generated or human-created work against...  ...Provide detailed written justifications for evaluations and scores to maintain transparency.... 
    Suggested
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    18 days ago
  •  ...Outlier helps the world’s most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train AI models? About the opportunity: Outlier is looking for talented... 
    Suggested
    Hourly pay
    Freelance
    Remote work
    Work from home
    Flexible hours

    Scale AI

    Ottawa, ON
    1 day ago
  •  ...Evaluate AI voice models in fluent English as a remote freelance contributor with flexible hours and strong communication skills. Help assess naturalness, usefulness, and clarity. Outlier seeks detail-oriented English speakers to provide human feedback for generative AI voice... 
    Suggested
    Freelance
    Remote work
    Flexible hours

    Scale AI

    Ajax, ON
    1 day ago
  •  ...project requirements Help Shape the Future of AI in Healthcare What if the medical...  ...understands complex healthcare information, evaluates medical scenarios, and delivers more accurate...  ...with opportunities to contribute to the evaluation and improvement of advanced Artificial... 
    Suggested
    Contract work
    For contractors
    Traineeship
    Remote work

    Volga Partners

    Remote
    4 days ago
  •  ...Accountable—and are ready to make a significant impact, we encourage you to apply. Your Role : We're looking for a Senior Data Scientist, AI Evaluation to design how Alpaca measures whether our models and agents are actually right. You'll be a senior individual contributor who... 
    Suggested
    Full time
    Home office

    Alpaca

    Canada
    4 days ago
  • $10 - $30 per hour

     ...detail constructive feedback digital delivery platforms ai-driven tools familiarity independent work adaptability collaboration...  ...train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM... 
    Suggested
    Part time
    For contractors
    Remote work
    Shift work

    micro1

    Remote
    13 days ago
  • © 2026 Smart Ecosystems. All rights reserved.
    Contract work

    Outlier AI

    Remote
    a month ago
  • $140k - $175k per year

     ...is seeking a Lead Research Engineer to lead the design and delivery of production-ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable evaluation infrastructure that enables research and product teams to compare large language... 
    Full time
    Internship
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Toronto, ON
    1 day ago
  •  ...Outlier is seeking detail-oriented, fluent English speakers to help train AI models via live conversations and scoring. You will rate naturalness, usefulness, and clarity, then provide concise English explanations. This freelance, remote role offers flexible hours and a quick... 
    Freelance
    Remote work
    Flexible hours

    Scale AI

    Moncton, NB
    1 day ago
  •  ...Evaluate AI voice, image, and video outputs from a quiet remote workspace, using fluent English and precise attention to detail. This freelance...  ...fluency, multimedia inspection, and independent judgment to Outlier’s remote generative AI evaluation projects. #J-18808-Ljbffr
    Freelance
    Remote work
    Flexible hours

    Scale AI

    Mississauga, ON
    1 day ago
  •  ...Curate and evaluate Java code for AI training and performance benchmarks. About Us Based in San Francisco, California, Turing is the world...  ...oral and written communication skills for clear, structured evaluation rationales. Engagement Details Commitment:... 
    Part time
    For contractors
    Flexible hours

    Turing

    Remote
    2 days ago
  •  ...interview Walk us through how you currently evaluate new artificial intelligence platforms...  ...recent challenges you faced while vetting AI tools Who Should Apply Active role in...  ...Comfortable discussing technical and business evaluation criteria in a 1:1 setting Contract &... 
    Contract work
    For contractors

    Terac

    Remote
    4 days ago
  • Permanent, Full time At TELUS Health we’re committed to building the healthiest workplaces on the planet, which is why we offer organizations the Employee Assistance Program (EAP) among our range of services. The EAP counselling team provides mental health support to employees...
    Permanent employment
    Full time
    Temporary work
    Work at office
    Monday to friday
    Flexible hours
    1 day per week

    Mindrift

    Montréal, QC
    1 day ago
  • $40 per hour

     ...review your choices. Accept All Customize Settings Reject All Employers Job seekers Career centers Handshake AI Enterprise AI Research Log in Sign up FRENCH AI EVALUATION SPECIALIST (CANADA) Sign up now Up to $40/hr Depending on the project Bachelor's Remote Part-time Flexible... 
    Part time
    Remote work
    Flexible hours

    Handshake

    Remote
    26 days ago
  • $96k - $116.25k per year

     ...About Dialpad Dialpad is the AI platform for customer experience, built to resolve customer problems in real time across voice and...  ...Optimistic, Persistent, and Empathetic . Your role As an AI Evaluation Engineer, you'll be an integral part of our AI Evaluation team, owning... 
    Internship
    Work at office

    Software Engineering, Data Science

    Kitchener, ON
    more than 2 months ago
  •  ...This is a fully remote, hourly contractor role supporting AI data and language projects on a project-based, flexible hour basis. Project...  ..., and other content to support AI training datasets. LLM evaluation: reviewing AI-generated responses for accuracy, reasoning quality... 
    Hourly pay
    Contract work
    For contractors
    Remote work
    Flexible hours

    CNTXT AI

    Remote
    18 days ago
  •  ...Key Responsibilities • Design and implement evaluation metrics for AI models • Conduct thorough testing of model performance across different scenarios • Analyze model outputs for bias, fairness, and accuracy • Collaborate with ML engineers to implement improvements... 
    Contract work

    Rise Data Labs

    Remote
    a month ago
  •  ...Digital is building a global community of experts to evaluate, challenge and improve advanced AI systems . We are looking for university students,...  ...scenarios Responsible AI behaviour Domain-Specific AI Evaluation Healthcare & Medicine Law Finance, Economics &... 
    Part time

    TELUS International

    Remote
    a month ago
  •  ...- We’ll assess your Contra profile and portfolio for strength in photography, composition, lighting, and visual quality. # Skills evaluation - You’ll complete a structured photography submission designed to evaluate attention to detail, consistency, and execution. What... 
    Full time
    Contract work

    Contra Labs

    Remote
    17 days ago
  •  ...Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve...  ...get paid when a job comes through. What You May Work On Evaluate AI-generated visual outputs across a wide range of styles, subjects... 
    Full time
    Contract work

    Contra Labs

    Remote
    17 days ago
  •  ...contractor Remote · Contract · Radiological Science · Health Physics · AI Safety · CBRN What this pays Rates are set by the client...  ...a figure we cannot stand behind. About the Role AI Safety Evaluation Project | Remote | Contract Locations: US, Canada, UK, Europe,... 
    Hourly pay
    Contract work
    For contractors
    Remote work

    Pasiflora AI

    Remote
    a month ago