Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Ai Model Evaluation Consultant

DataAnnotation

Evaluate AI models using consulting judgment, structured analysis, and clear written rationale from your own practice. Work remotely as an independent contractor.This consulting position helps train AI models on business problems. You will create client-style briefs, review model responses, and explain their strengths and weaknesses. Your work spans strategy, market research, leadership communications, operations, transformation, and transactions.Key Responsibilities:
Write client-style briefs from familiar consulting engagementsAssess problem framing, structure, rigor, insight, and storylineFlag unsupported claims, faulty numbers, and vague conclusionsCompare responses and select the strongest recommendationBuild evaluation tasks, rubrics, and model answersRequirements:
Professional experience in management consulting, strategy, PMO, or deal advisoryStrong analytical and structured problem-solving skillsFluency in English at native or bilingual levelExperience building and critiquing senior-stakeholder workDetail-oriented approach;
postgraduate study preferred, not requiredApply consulting standards, analytical rigor, and structured feedback to improve the next generation of AI business tools.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Ai Model Evaluation Consultant in Winnipeg, MB vacancy
  • We are looking for a Finance - AI Model Evaluator to help train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. In this role you will need to hold an expert level of financial reasoning... 
    Suggested
    Hourly pay
    For contractors

    Sustainable World, Inc.

    Winnipeg, MB
    1 hour ago
  • Evaluate advanced statistical queries and AI-generated solutions with expertise in statistical inference. Work remotely...  .... Your work also supports AI model interpretability through documented...  ...statistical inference expertise and careful evaluation skills to strengthen accurate,... 
    Suggested
    Remote work

    Crossing Hurdles

    Winnipeg, MB
    1 hour ago
  • Evaluate frontier AI models with electrical engineering judgment, circuit analysis expertise, and flexible remote work from your own computer.DataAnnotation seeks an experienced electrical engineer for independent contract work evaluating real engineering tasks. Apply circuit... 
    Suggested
    Contract work
    For contractors
    Remote work
    Flexible hours

    DataAnnotation

    Winnipeg, MB
    1 hour ago
  • Use management consulting judgment to evaluate AI models against business problems, with flexible remote project availability through DataAnnotation. Your analysis shapes better business tools.This opportunity suits experienced Management Consultants and Strategy Consultants... 
    Suggested
    Remote work
    Flexible hours

    DataAnnotation

    Winnipeg, MB
    1 hour ago
  • DataAnnotation is seeking an experienced Electrical Engineer to guide frontier AI models in evaluating real electrical engineering tasks. The role leverages your design judgment, debugging, and hardware experience to teach AI systems to reason about circuits, power stages,... 
    Suggested
    Internship
    Remote work

    DataAnnotation

    Winnipeg, MB
    1 hour ago
  • $75 per hour

     ...Horizon Recruitment is recruiting for a Financial Modeling & Forecasting Consultant to support a non-profit organization (NPO) with building financial models and forecasting tools to guide future business decisions. This three-month contract will focus on creating reliable... 
    Hourly pay
    Ongoing contract
    Long term contract
    Contract work
    Remote work
    Flexible hours

    Horizon Recruitment Inc.

    Winnipeg, MB
    1 hour ago
  • $70k - $150k per year

     ...those changes. Focus is primarily on business/group within BMO; may have broader, enterprise-wide focus. Provides specialized consulting, analytical and technical support. Exercises judgment to identify, diagnose, and solve problems within given rules. Works... 
    Part time

    BMO

    Winnipeg, MB
    1 hour ago
  • Shape model and AI governance at BMO in hybrid Toronto, using data integrity, privacy, and enterprise management capabilities.This Manager...  ...within Data Analytics & Reporting and provides specialized consulting, analytical, and technical support. You will interpret enterprise... 

    Bank of Montreal

    Winnipeg, MB
    1 hour ago
  • About The Job We're looking for an experienced consulting professional to help train AI models. You'll test the newest AI models on business problems from...  ...on some projectsResponsibilities Build complete evaluation tasks: source files, a scoring rubric, and a model answer... 
    Hourly pay
    For contractors

    DataAnnotation

    Winnipeg, MB
    1 hour ago
  • # Python Developer-AI EvaluationZettaMine Labs Pvt. Ltd. · , CABack to resultsPython Developer-AI EvaluationZettaMine...  .../ TypeScript (USA) for a short-term AI Engineering and Evaluation project focused on improving AI models through high-quality training data, preference data... 
    Hourly pay
    Contract work
    Temporary work
    Freelance
    Immediate start
    Remote work

    Linuxassociation

    Winnipeg, MB
    1 hour ago
  • The AI Risk Management and Governance team oversees the development, deployment and use...  ..., algorithmic and artificial intelligence models. Our goal is to maximize the value of data...  ...and produce the required risk opinions Evaluate AI systems and vendor solutions that incorporate... 
    Internship
    Remote work
    Flexible hours

    Desjardins

    Winnipeg, MB
    1 hour ago
  • Elevate AI advancement at DataAnnotation as an Electrical Engineer, focusing on real-world...  ..., critiquing AI outputs, and ensuring the models align with professional standards. Your...  ...engineering problems from practical experience • Evaluate AI model outputs against professional... 

    DataAnnotation

    Winnipeg, MB
    1 hour ago
  • Evaluate AI answers through a molecular biology lens, checking mechanisms, experiments, and citations remotely with DataAnnotation. Clear English...  ...information. You will test biological reasoning, assess model responses, and provide accurate corrections grounded in primary... 
    Remote work

    DataAnnotation

    Winnipeg, MB
    1 hour ago
  •  ...building a global community of experts to evaluate, challenge and improve advanced AI systems. We are looking for...  ...concepts and technical outputs – Model reasoning and performance – Data...  ...AI behaviour Domain-Specific AI Evaluation – Healthcare & Medicine – Law... 
    Hourly pay
    For contractors
    Remote work
    Flexible hours

    TELUS Digital AI Data Solutions

    Winnipeg, MB
    1 hour ago
  • Shape AI evaluation with exceptional writing and logic-based decision-making at TELUS Digital, working remotely as an independent contractor...  ...will design rubrics, audit annotation quality, and investigate model outputs. Your work supports Reinforcement Learning from Human Feedback... 
    For contractors
    Remote work

    Telus Digital AI Solution

    Winnipeg, MB
    1 hour ago
  • Shape business reasoning in AI models using finance and strategy expertise from a fully remote, flexible contract. Work independently on your...  ...schedule.Alignerr seeks MBA-trained professionals to train and evaluate advanced AI models on business reasoning. You will apply finance... 
    Hourly pay
    Contract work
    Remote work
    Flexible hours

    Alignerr Corp.

    Winnipeg, MB
    1 hour ago
  • Shape Agentic AI governance and validation at BMO Financial Group...  ...AI Scientist sits in the Model Risk Management group, reporting...  ...AI Model Validation. You will evaluate enterprise AI systems for conceptual...  ...quantitative testing and evaluation for models and applicationsProvide... 

    BMO

    Winnipeg, MB
    1 hour ago
  • Shape AI governance at BMO Financial Group through model validation, quantitative testing, and risk-focused technical judgment. Work at 100 King Street West....  ...problems into scalable solutions.Key Responsibilities: Evaluate model soundness, quality, robustness, and... 

    BMO

    Winnipeg, MB
    1 hour ago
  • $126k - $176k per year

    Sr. Legal AI Prompter / EvaluatorSr. Legal AI Prompters / Evaluators are responsible for improving CoCounsel Legal by writing...  ...experimenting with large language models (LLMs), including Thomson, our...  ...opportunities to get involved with pro‑bono consulting projects and Environmental,... 
    Remplacement
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Winnipeg, MB
    1 hour ago
  • Shape AI safety at CIBC’s Enterprise AI Governance Office in Toronto...  ..., designing guardrails for models, applications, agents, and...  ...operational workflows.This Senior Consultant role translates standards and...  ...validationUnderstanding of evaluation, versioning, monitoring, and change... 
    Work at office

    Canadian Imperial Bank of Commerce (Canada)

    Winnipeg, MB
    1 hour ago
  •  ...strategy expertise into training signals for AI models by testing recommendations, reviewing...  ...on your schedule.As an experienced consulting professional, you will teach models to think...  ...top-tier strategy advisors. You will evaluate market-entry, growth, portfolio, competitive... 
    Remote work

    DataAnnotation

    Winnipeg, MB
    1 hour ago
  •  ...knowledge potential. Join Our Global Talent CommunityPosition: AI Training Consultant Location: Toronto, Ontario Job Id: 1466 # of...  .../ML fundamentals : Practical understanding of Large Language Models (LLMs), prompt engineering, generative AI capabilities, limitations... 
    Work at office
    Shift work

    Innovecture

    Winnipeg, MB
    1 hour ago
  •  ...Solutions (HeitechSoft) is a fast-growing AI, software development, and digital...  ...built technology. We are seeking a sharp, consultative AI Solutions Consultant to support our business...  ...by engaging deeply with prospects, evaluating their technical and operational environments... 
    Long term contract
    Internship

    HeitechSoft - AI Business Solutions

    Winnipeg, MB
    1 hour ago
  • Use management consulting judgment to evaluate AI models on business problems, with flexible remote project availability through DataAnnotation. Your written rationale shapes model quality.This opportunity suits experienced Management Consultants, Strategy Consultants, and... 
    Remote work
    Flexible hours

    DataAnnotation

    Winnipeg, MB
    1 hour ago
  •  ...experience in Cybersecurity, Security Consulting, and enterprise security...  ...engagements.Hands-on experience in AI Security, Generative AI...  ...10, MITRE ATLAS, and AI threat modeling.Experience identifying prompt injection, data leakage, model abuse, and AI supply chain vulnerabilities... 
    2 days per week
    3 days per week

    Pacer Group

    Winnipeg, MB
    1 hour ago
  •  ...autonomous agents and Generative AI systems with Databricks Mosaic...  ...a Forward Deployed Technical Consultant, you will create production-...  ...intelligence solutions using custom models, cloud services, and Azure...  ..., tool invocation, evaluation, and observability capabilities... 

    Accenture PLC

    Winnipeg, MB
    1 hour ago
  • Applied AI evaluation and user-centred research define this full-time contract role with Kids Help Phone in Toronto, using qualitative and quantitative methods.As an Applied AI Evaluation & Product Researcher, you will evaluate a youth-facing generative AI product. You will... 
    Full time
    Contract work
    1 day per week

    Kids Help Phone

    Winnipeg, MB
    1 hour ago
  • $125 per hour

     ...We’re looking for experienced computational biologists and bioinformaticians to help train AI models. You’ll design realistic analysis tasks from your own practice, run them through frontier AI systems, and grade what comes back against a professional standard. The models... 
    Full time
    Remote work
    Flexible hours

    DataAnnotation

    Winnipeg, MB
    1 hour ago
  • Select how often (in days) to receive an alert:Title: Audit Manager, Model, Data and AI Audit Requisition ID: 275458Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.Internal Audit is hiring an Audit Manager within Model... 

    Scotiabank

    Winnipeg, MB
    1 hour ago
  • Build reliable autonomous AI at Equifax through LLM evaluation, Python automation, and multi-agent workflow testing. This newly created position focuses on production reliability.As an Agentic AI Evaluation & Tuning Engineer, you will connect LLM capabilities with dependable... 

    Equifax Inc.

    Winnipeg, MB
    1 hour ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Ai Model Evaluation Consultant. Be the first to apply!