Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Ai Evaluation Strategy Expert

Telus Digital AI Solution

Shape AI evaluation with exceptional writing and logic-based decision-making at TELUS Digital, working remotely as an independent contractor. Define how systems reason across cultures.As an AI strategy expert, you will design rubrics, audit annotation quality, and investigate model outputs. Your work supports Reinforcement Learning from Human Feedback and consistent, helpful AI personas. You will collaborate with stakeholders on response profiles for industries and user personas.Key Responsibilities:
Draft multi-dimensional rubrics for tone, logic, and instruction followingLead quality-assurance audits for large-scale annotation projectsInvestigate hallucinations and logical fallacies in model outputsDevelop prompt-engineering strategies to mitigate model issuesDefine Ideal Response Profiles with project stakeholdersRequirements:
Bachelor’s Degree in technical or humanities disciplineMinimum B1 intermediate English proficiencyNative-level fluency in at least one languageExceptional writing and logic-based decision-making skillsSuccessful qualification exam and completed ID verificationApply AI reasoning, prompt engineering, and language expertise to help TELUS Digital shape human-aligned systems.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Ai Evaluation Strategy Expert in Winnipeg, MB vacancy
  • TELUS Digital is building a global community of experts to evaluate, challenge and improve advanced AI systems. We are looking for university students, graduates...  ...– Responsible AI behaviour Domain-Specific AI Evaluation – Healthcare & Medicine – Law – Finance,... 
    Suggested
    Hourly pay
    For contractors
    Remote work
    Flexible hours

    TELUS Digital AI Data Solutions

    Winnipeg, MB
    1 hour ago
  • Evaluate advanced AI systems remotely with TELUS Digital using subject-matter expertise, analytical...  ...researchers, and professionals for its global AI expert community. You may assess AI/ML...  ...-specific outputs. Work is expert evaluation rather than traditional data annotation... 
    Suggested
    For contractors
    Remote work

    TELUS Digital AI Data Solutions

    Winnipeg, MB
    1 hour ago
  •  ...seeking experienced finance professionals for a short-term AI training and evaluation project.We're looking for professionals with strong real-world...  ..., tools, and training will be provided to selected experts.Who You Are We're looking for finance professionals with... 
    Suggested
    Temporary work

    Visible Hands

    Winnipeg, MB
    1 hour ago
  •  ...They change how a company runs its creative strategy, and they become a trusted advisor to its...  ...analytics platform, then went all in on AI. The bet is paying off. Our valuation has...  ...expansion potential cold Be an industry expert that can find and close gaps in their creative... 
    Suggested
    Summer work
    Work at office
    Remote work
    Work from home
    Shift work

    TELUS International

    Winnipeg, MB
    1 hour ago
  •  ...for the ongoing management of FIBRS (Financial Business Rules system), with a key focus on the Calculations rules. As subject matter expert (SME) you will work with our business partners to identify new requirements and system enhancement opportunities to drive Finance System... 
    Suggested
    Full time

    Mercor

    Winnipeg, MB
    1 hour ago
  • L’évaluation immobilière commerciale vous intéresse? Mettez votre expertise senior au service de mandats complexes, de rapports rigoureux et...  ...des rapports professionnels conformes aux normesTémoigner comme expert dans les dossiers litigieuxBonifier la base de données... 

    FOCUS RESSOURCES INC.

    Winnipeg, MB
    1 hour ago
  • We are looking for a Finance - AI Model Evaluator to help train AI models. You will measure the progress of these AI chatbots, evaluate their logic...  ...quality of each model. In this role you will need to hold an expert level of financial reasoning- a completed or in progress... 
    Hourly pay
    For contractors

    Sustainable World, Inc.

    Winnipeg, MB
    1 hour ago
  • Evaluate AI prompts through nuclear safety expertise, distinguishing acceptable requests from...  ...centers on reviewing prompts from other experts, classifying them as safe or unsafe, and...  ...and clear domain analysis to AI prompt evaluation under a remote contract engagement. #J... 
    Contract work
    Work at office
    Remote work

    AfterQuery Experts

    Winnipeg, MB
    1 hour ago
  • Applied AI evaluation and user-centred research define this full-time contract role with Kids Help Phone in Toronto, using qualitative and...  ...youth-facing generative AI product. You will develop measurement strategies, conduct UX research, assess risks, and translate evidence... 
    Full time
    Contract work
    1 day per week

    Kids Help Phone

    Winnipeg, MB
    1 hour ago
  • Shape business reasoning in AI models using finance and strategy expertise from a fully remote, flexible contract. Work independently on your schedule.Alignerr seeks MBA-trained professionals to train and evaluate advanced AI models on business reasoning. You will apply finance... 
    Hourly pay
    Contract work
    Remote work
    Flexible hours

    Alignerr Corp.

    Winnipeg, MB
    1 hour ago
  • Evaluate AI answers through a molecular biology lens, checking mechanisms, experiments, and citations remotely with DataAnnotation. Clear English writing is essential.This Molecular Biology AI Evaluator role focuses on distinguishing established findings, contested claims,... 
    Remote work

    DataAnnotation

    Winnipeg, MB
    1 hour ago
  • $126k - $176k per year

    Sr. Legal AI Prompter / EvaluatorJob DescriptionSr. Legal AI Prompters / Evaluators are responsible for improving CoCounsel Legal by writing...  ...legal subject matter experts (SMEs), software engineers, and...  ...datasets with SMEs, coordinate evaluations, and design evaluation schemes... 
    Remplacement
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Winnipeg, MB
    1 hour ago
  • Elevate AI advancement at DataAnnotation as an Electrical Engineer, focusing on real-world circuit and systems challenges. Apply your...  ...Design realistic engineering problems from practical experience • Evaluate AI model outputs against professional benchmarks • Compare model... 

    DataAnnotation

    Winnipeg, MB
    1 hour ago
  • # Python Developer-AI EvaluationZettaMine Labs Pvt. Ltd. · , CABack to resultsPython Developer-AI EvaluationZettaMine Labs Pvt. Ltd.,...  ...- Python / TypeScript (USA) for a short-term AI Engineering and Evaluation project focused on improving AI models through high-quality training... 
    Hourly pay
    Contract work
    Temporary work
    Freelance
    Immediate start
    Remote work

    Linuxassociation

    Winnipeg, MB
    1 hour ago
  • Build reliable autonomous AI at Equifax through LLM evaluation, Python automation, and multi-agent workflow testing. This newly created position focuses on production reliability.As an Agentic AI Evaluation & Tuning Engineer, you will connect LLM capabilities with dependable... 

    Equifax Inc.

    Winnipeg, MB
    1 hour ago
  •  ...Join Workada as a Remote Video Production Evaluator dedicated to improving AI technology through precise evaluations. This full-time role focuses on quality assessment of multimedia outputs. At Workada, we seek an expert who can critically analyze video, image, and text... 
    Full time
    Remote work

    workada

    Winnipeg, MB
    5 days ago
  • Rise Data Labs is seeking experienced finance professionals for a short-term AI training and evaluation project in Canada. You will leverage real-world financial expertise to design challenging tasks, evaluate AI outputs, and establish criteria that define high-quality responses... 
    Temporary work

    Visible Hands

    Winnipeg, MB
    1 hour ago
  • Evaluate healthcare AI remotely with expertise in telehealth and clinical workflows. Alignerr offers hourly contract assignments on your own schedule...  ...digital health, clinical workflow, and critical evaluation expertise to help Alignerr improve healthcare AI systems remotely... 
    Hourly pay
    Contract work
    Remote work

    Alignerr Corp.

    Winnipeg, MB
    1 hour ago
  • Apply British English expertise to AI audio evaluation from Canada, using careful listening and linguistic analysis in a fully remote freelance arrangement.This British English Voice Expert role supports an AI training project evaluating spoken English quality and authenticity... 
    Freelance
    Remote work

    Jobgether

    Winnipeg, MB
    1 hour ago
  • $200k - $350k per year

    Evaluate AI-generated legal outputs remotely while growing business for a prominent downtown...  ...client. Apply Litigation experience and expert judgment.This full-time Litigation Lawyer...  ...client development with legal content evaluation. Candidates need four or more years of post... 
    Full time
    Remote work

    Success Matcher Recruitment

    Winnipeg, MB
    1 hour ago
  • Cohere is seeking a Senior Research Scientist focused on AI evaluation methods to support our innovative foundation models. This remote or on-site role emphasizes creating evaluation benchmarks and tools that enhance LLM capabilities. As a Senior Research Scientist at Cohere... 
    Remote work

    Cohere Inc.

    Winnipeg, MB
    1 hour ago
  • $95k - $110k per year

     ...Applied AI Evaluation & Product Researcher (Contract) Applied Research FT Contract Toronto,...  ...will develop and implement an evaluation strategy that defines success, examines user experience...  ...clinical leaders and subject‑matter experts to ensure evaluation criteria reflect... 
    Full time
    Contract work
    Live In
    2 days per week
    1 day per week

    Kids Help Phone

    Winnipeg, MB
    1 hour ago
  •  ...integrating, and operationalizing enterprise artificial intelligence (AI) solutions that support CN's next generation of data, analytics,...  ...Retrieval Augmented Generation (RAG), prompt engineering, model evaluation, and AI workflow automation patterns to support scalable... 
    Work at office
    Monday to friday

    CN

    Winnipeg, MB
    1 hour ago
  • Shape trusted AI evaluation with performance testing and CI/CD expertise as a Software Development Engineer in Test at CrowdStrike. Work on scalable cybersecurity services.As an SDET, you will help define how AI agents are tested, evaluated, and trusted in production. CrowdStrike... 

    CrowdStrike Canada ULC

    Winnipeg, MB
    1 hour ago
  • Agentic AI Expert at Rodeo FX . Repeatedly voted one of Montreal’s Top Employers and Employer of the Year for the 2022 Mercuriades...  ...post‑production operations. Key ResponsibilitiesAgentic AI Strategy and Use Cases Identify, assess, and prioritize high‑impact use... 
    Permanent employment
    Full time
    Contract work
    Local area
    Flexible hours
    3 days per week

    Rodeo FX

    Winnipeg, MB
    1 hour ago
  •  ...more than 5 years of sales experience, you will lead sales initiatives, partner with training efforts, and contribute to marketing strategies. You will also assess market trends to identify promising opportunities for expansion. Key Responsibilities: • Connect with clients... 

    EECOL Electric

    Winnipeg, MB
    1 hour ago
  • Lead marketing strategy and commercialization for National Bank from Edmonton, Montreal, or Toronto in a hybrid specialist position. Shape...  ...through client, market, and competitive insight.As a Senior Expert, Marketing Strategy and Commercialization, you will work across... 
    Permanent employment
    Full time

    Banque Nationale du Canada

    Winnipeg, MB
    1 hour ago
  • Leverage your engineering expertise as an Electrical Engineer AI Evaluator with DataAnnotation, focusing on evaluating frontier AI models in real-world electronics tasks. Engage in challenging problem design and model assessment remotely. At DataAnnotation, we seek an experienced... 
    Remote work

    DataAnnotation

    Winnipeg, MB
    1 hour ago
  •  ...and next steps. Our partner is looking for a Senior FP&A Expert - Financial Task Design and Evaluation based in Canada. We are seeking an experienced...  ...& Analysis professional to contribute to an innovative AI evaluation project focused on complex financial workflows... 
    Hourly pay
    Part time
    For contractors
    Freelance
    Remote work
    Flexible hours

    Jobgether

    Winnipeg, MB
    1 hour ago
  • Evaluate AI-generated code remotely for Alignerr while applying software engineering, debugging, and code review expertise. Work flexibly...  ...equivalent practical experienceApply software engineering, code evaluation, and precise technical communication to help Alignerr improve AI... 
    Hourly pay
    Contract work
    Remote work

    Alignerr Corp.

    Winnipeg, MB
    1 hour ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Ai Evaluation Strategy Expert. Be the first to apply!