Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote AI Model Evaluator

FedEx Corporation

Evaluate AI model outputs remotely with critical thinking and precise writing. Workada offers full-time work assessing text, images, video, and documents.

As an AI model evaluator, you will assess quality against detailed criteria and identify errors or inconsistencies. You will write clear, well-reasoned justifications for judgments. Your evaluations help improve technology used every day, while clear guidelines and training support consistent work.

Key Responsibilities:

  • Evaluate AI model outputs across text, images, video, and documents
  • Assess quality against detailed criteria
  • Identify errors and inconsistencies in evaluated outputs
  • Write clear, well-reasoned judgment justifications
  • Follow detailed written guidelines independently

Requirements:

  • Strong reading and writing skills with sound judgment
  • Comfort evaluating creative or technical work against criteria
  • Careful approach to quality and overlooked details
  • Experience with precise written evaluation, design, photography, video, editorial, research, or technical specifications

Bring critical evaluation, careful judgment, and clear writing to Workada’s remote AI model quality work.

#J-18808-Ljbffr
Vacancy posted 4 hours ago
Similar jobs that could be interesting for youBased on the Remote AI Model Evaluator in Ottawa, ON vacancy
  •  ...Evaluate AI models, text, images, video, and documents with clear writing and critical judgment at Workada. Help improve everyday technology...  ...judgments clearly while reviewing creative and technical work. Your evaluations help advanced systems become more accurate, consistent, and... 
    Suggested

    Clubshop | US

    Ottawa, ON
    4 hours ago
  • An innovative company is seeking a physics expert to train AI models in a flexible remote role. You will engage with AI chatbots by providing complex physics problems and assessing their logic and performance. This position allows you to work on your own schedule and choose... 
    Remote work
    Flexible hours

    DataAnnotation

    Ottawa, ON
    6 hours ago
  •  ...seeking an experienced Electrical Engineer to guide frontier AI models in evaluating real electrical engineering tasks. The role leverages your design...  ...models, and critique model outputs with rigorous reasoning. Remote-first environment with global collaboration. #J-18808-... 
    Remote work
    Internship

    DataAnnotation

    Ottawa, ON
    6 hours ago
  • Evaluate frontier AI models with electrical engineering judgment, circuit analysis expertise, and flexible remote work from your own computer. DataAnnotation seeks an experienced electrical engineer for independent contract work evaluating real engineering tasks. Apply circuit... 
    Remote work
    Contract work
    For contractors
    Internship
    Flexible hours

    DataAnnotation

    Ottawa, ON
    6 hours ago
  •  ...Bring real-world quantitative experience to remote AI model evaluation, with flexible scheduling and projects selected around your availability. As an Experimentation Analyst and AI Trainer with DataAnnotation, you will test whether AI outputs withstand practical scrutiny... 
    Remote work
    Flexible hours

    DataAnnotation

    Ottawa, ON
    6 hours ago
  •  ...Evaluate AI models against real business problems using consulting judgment, analytical rigor, and structured written feedback from your own...  ...client relevance. The work is independent contracting, completed remotely from your own computer and schedule. Key Responsibilities:... 
    Remote work

    DataAnnotation

    Ottawa, ON
    6 hours ago
  •  ...Evaluate German AI outputs from your Canadian home while helping Cohere strengthen data quality, accuracy, and model performance. This remote independent contractor assignment focuses on language-based quality work for large language models. You will proofread, compare,... 
    Remote work
    For contractors

    Cohere

    Ottawa, ON
    6 hours ago
  •  ...Evaluate AI model outputs at Workada using critical thinking and clear writing to improve technology people use every day. Assess text, images...  ..., and inconsistencies Write clear justifications for evaluation judgments Follow written guidelines independently during reviews... 

    Clubshop | US

    Ottawa, ON
    3 hours ago
  •  ...specialists with project-based AI opportunities for leading tech...  ..., focused on testing, evaluating, and improving AI systems. This...  ...which tasks to take and when ~ Remote: open to US-licensed physicians...  ...EHR vignettes for a medical AI evaluation project. General and internal... 
    Remote work
    Part time
    For contractors
    Flexible hours

    Mindrift

    Ottawa, ON
    2 days ago
  • $30 per hour

    Prolific is looking for Portuguese speakers to evaluate and train cutting-edge AI models, with earning potential of $30/hour. Enjoy flexible hours while...  ...Prolific, you’ll play a pivotal role in AI model training and evaluation. Candidates will need advanced language skills and the... 
    Self employment
    Work from home
    Flexible hours

    Prolific

    Ottawa, ON
    6 hours ago
  •  ...work Role Responsibilities Review and evaluate project deliverables with high attention...  ...established guidelines and standards Support AI research initiatives through careful...  ...consistency and reliability across evaluations Requirements Strong analytical and... 
    Remote work
    Ongoing contract
    Flexible hours

    Crossing Hurdles

    Ottawa, ON
    6 hours ago
  •  ...seeking a Principal Engineer (Physical AI - System Modeling) to join the Pathfinding Studio within...  ...versioning and reproducible training and evaluation. Lead imitation-learning...  ...sole discretion of Renesas Canada. Remote Work : No Employment Type :... 
    Remote work
    Long term contract
    Permanent employment
    Full time
    Work at office

    Renesas Electronics

    Ottawa, ON
    5 days ago
  •  ...Evaluate large language model responses remotely from Canada, using academic knowledge, careful reasoning, and strong writing skills. Work part time asynchronously. As an AI Evaluation Specialist, you will support AI training by reviewing model performance across assigned... 
    Remote work
    Part time

    OpenTrain AI, Inc.

    Ottawa, ON
    6 hours ago
  • $100 per hour

     ...software developers to participate in an AI training project focused on testing and evaluating AI coding assistants. The...  ...Additional Information Fully remote freelance opportunity....  ...eligible. Projects involving AI model training or evaluation, machine learning... 
    Remote work
    Hourly pay
    Contract work
    Freelance
    Worldwide
    10 hours per week

    Lifted, an Upwork Company™

    Ottawa, ON
    6 days ago
  • $45 per hour

    A leading AI solutions company is looking for an expert to design and evaluate test scenarios for AI agents. The ideal candidate will have a Bachelor's or Master's degree...  ...flexible freelance position that allows working remotely, with rates up to $45/hour based on skills and... 
    Remote work
    Freelance
    Flexible hours

    Mindrift

    Ottawa, ON
    6 hours ago
  •  ...Outlier, a Scale AI platform, is seeking English speakers to contribute by training and refining AI systems. This...  ...offers up to $15/hour USD and weekly payouts, with 100% remote work and flexible hours. You'll evaluate AI outputs, develop prompts, and contribute across... 
    Remote work
    Contract work
    Freelance
    Flexible hours

    Outlier

    Ottawa, ON
    6 hours ago
  •  ...Remote software engineering work in Edmonton combines clean coding with AI-generated code evaluation and expert technical feedback. Choose 10–40 hours weekly. Alignerr seeks Software Engineers for hourly contract work improving AI coding systems. You will write solutions... 
    Remote work
    Hourly pay
    Contract work

    Alignerr Corp.

    Ottawa, ON
    6 hours ago
  •  ...Outlier, a platform owned by Scale AI, seeks English speakers to help train and refine...  ...systems. This freelance, 1099 role is 100% remote, with flexible hours and a base rate up to...  ...bonuses based on project performance. You'll evaluate AI outputs, draft and improve prompts, and... 
    Remote work
    Hourly pay
    Freelance
    Flexible hours

    Outlier

    Ottawa, ON
    6 hours ago
  •  ...Evaluate AI-generated code remotely for Alignerr while applying software engineering, debugging, and code review expertise. Work flexibly on an hourly...  ...practical experience Apply software engineering, code evaluation, and precise technical communication to help Alignerr improve... 
    Remote work
    Hourly pay
    Contract work

    Alignerr Corp.

    Ottawa, ON
    6 hours ago
  • Join Terac as a Remote Software Engineer for a paid AI task evaluation study. This position allows you to leverage your coding expertise in assessing and improving AI programming tasks. As a software engineer involved in this project, you will evaluate coding environments and... 
    Remote work

    Remolity, Inc.

    Ottawa, ON
    6 hours ago
  •  ...leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are...  ...Seoul. Join us! Role Overview: Evaluation is critical to making progress in...  ...: This role can be based remotely or from one of our office locations... 
    Remote work
    Full time
    Work at office
    Local area
    Home office

    Cohere Inc.

    Ottawa, ON
    6 hours ago
  •  ...Outlier is seeking talented English-speaking conversationalists to help train generative AI voice models. This freelance, remote opportunity offers flexible hours, allowing you to work when it suits you. You will participate in live, scenario-based English conversations... 
    Remote work
    Freelance
    Flexible hours

    Wahojobs

    Ottawa, ON
    6 hours ago
  •  ...Crossing Hurdles is seeking an evaluator to assess AI tools under standardized conditions and annotate model responses. You will write and refine prompts to probe capabilities...  ...edge cases, then verify consistency across evaluations and ratings. This role emphasizes... 
    Remote work

    Crossing Hurdles

    Ottawa, ON
    6 hours ago
  • $180k - $200k per year

     ...learning engineering of our Large Language Models and their harnesses. Your work will impact...  .... Job Description We are seeking an AI Manager Language Models to guide the...  ..., model training, deployment, monitoring, evaluation, and feedback. Apply your knowledge to... 
    Remote work
    Internship
    Immediate start
    Relocation

    Motorola Solutions

    Ottawa, ON
    6 hours ago
  • $85k - $225k per year

    A leading cloud technology company in Toronto is seeking an experienced professional to validate and ensure the reliability of Veeva AI Agents. The ideal candidate should have expertise in data quality, prompt engineering, and proficiency in Python. This full-time role offers... 
    Remote work
    Full time
    Flexible hours

    Veeva Systems

    Ottawa, ON
    6 hours ago
  • A referral company is seeking a Mathematics Specialist (Undergraduate/Master’s) to curate advanced mathematics problems for AI training. This remote role involves reviewing AI-generated solutions for quality and logical reasoning. Ideal candidates should have strong problem-... 
    Remote work
    Contract work

    Crossing Hurdles

    Ottawa, ON
    6 hours ago
  •  ...Volga Partners is seeking Medical AI Evaluators to assess AI-generated healthcare content across General Practice, Family Medicine, Internal...  ...provide structured feedback without direct patient care. Based remotely, this project-based opportunity invites candidates currently in... 
    Remote work

    Volga Partners

    Ottawa, ON
    6 hours ago
  •  ...Outlier, a platform owned and operated by Scale AI, is seeking English-speaking contributors to help train and refine cutting-edge AI...  ...$15/hour USD, with weekly payouts and performance-based bonuses. Remote work is 100% remote with flexible hours. You must be authorized... 
    Remote work
    Freelance
    Flexible hours

    Outlier

    Ottawa, ON
    6 hours ago
  • $15 - $25 per hour

     ...Remote | Canada | Project-Based Independent Contractor Compensation...  ...requirements Help Shape the Future of AI in Healthcare What if the...  ...healthcare information, evaluates medical scenarios, and delivers...  ...advanced Artificial Intelligence (AI) models. We're seeking individuals... 
    Remote work
    Hourly pay
    For contractors
    Traineeship
    Freelance
    Internship
    Weekday work

    Volga Partners

    Ottawa, ON
    6 hours ago
  • Get notified about new Audio Director jobs in United States . 1,000+ Audio Director Jobs in United States Head of Audio & MIT – Blue Man Group North American Tour Advanced Development Audio Experience Engineer Director of Technical Solutions, Americas Audio ...
    Remote work

    Turing

    Ottawa, ON
    6 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Model Evaluator. Be the first to apply!