Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Evaluation Strategy Expert

Telus Digital AI Solution

Shape AI evaluation with exceptional writing and logic-based decision-making at TELUS Digital, working remotely as an independent contractor. Define how systems reason across cultures.

As an AI strategy expert, you will design rubrics, audit annotation quality, and investigate model outputs. Your work supports Reinforcement Learning from Human Feedback and consistent, helpful AI personas. You will collaborate with stakeholders on response profiles for industries and user personas.

Key Responsibilities:

  • Draft multi-dimensional rubrics for tone, logic, and instruction following
  • Lead quality-assurance audits for large-scale annotation projects
  • Investigate hallucinations and logical fallacies in model outputs
  • Develop prompt-engineering strategies to mitigate model issues
  • Define Ideal Response Profiles with project stakeholders

Requirements:

  • Bachelor’s Degree in technical or humanities discipline
  • Minimum B1 intermediate English proficiency
  • Native-level fluency in at least one language
  • Exceptional writing and logic-based decision-making skills
  • Successful qualification exam and completed ID verification

Apply AI reasoning, prompt engineering, and language expertise to help TELUS Digital shape human-aligned systems.

#J-18808-Ljbffr
Vacancy posted 6 hours ago
Similar jobs that could be interesting for youBased on the AI Evaluation Strategy Expert in Ottawa, ON vacancy
  •  ...Review AI-generated media with Outlier using sharp visual judgment and...  ..., images, and videos. Outlier Experts support Scale AI’s training projects by evaluating model outputs. You will roleplay...  ...Write evidence-based explanations of evaluation decisions Requirements:... 
    Suggested
    Remote work
    Flexible hours

    Scale AI

    Ottawa, ON
    6 hours ago
  •  ...Review AI-generated images, videos, and voices remotely on your own schedule with Outlier as an English-speaking AI Media Evaluation Expert. Outlier Experts support Scale AI’s training projects by evaluating model outputs and explaining quality issues. You will assess adherence... 
    Suggested
    Remote work

    Scale AI

    Ottawa, ON
    6 hours ago
  •  ...Evaluate AI-generated media remotely on your own schedule using fluent English, close observation...  ...English speakers. As an Outlier Expert, you will help assess models across images...  ...in English. Tasks support Outlier’s evaluation and feedback loop for improving advanced... 
    Suggested
    Freelance
    Remote work
    Flexible hours

    Scale AI

    Ottawa, ON
    6 hours ago
  •  ...Review AI-generated media remotely on your own schedule using careful observation, English...  ..., and evidence-based judgment. Evaluate voices, images, and videos for quality....  ...problems clearly. Your feedback supports evaluation and improvement of advanced AI systems.... 
    Suggested
    Remote work

    Scale AI

    Ottawa, ON
    6 hours ago
  •  ...Evaluate AI-generated media for Outlier remotely on your own schedule, using fluent English...  ...and evidence-based judgment. Outlier Experts review AI voice, image, and video outputs...  ...findings in writing. The work supports evaluation and feedback for improving advanced AI systems... 
    Suggested
    Remote work

    Scale AI

    Ottawa, ON
    6 hours ago
  •  ...Evaluate AI-generated media remotely on your own schedule using fluent English, close observation, and evidence-based writing. Review voices...  ...mismatches Write specific English explanations supporting evaluation decisions Requirements: Fluent English and clear written... 
    For contractors
    Remote work

    Scale AI

    Ottawa, ON
    6 hours ago
  •  ...Evaluate AI-generated media for Outlier remotely, using fluent English, close observation, and clear written explanations on your own schedule. Outlier, operated by Scale AI, seeks detail-oriented English speakers for AI training projects. You will review voice conversations... 
    Remote work

    Scale AI

    Ottawa, ON
    6 hours ago
  •  ...Review AI-generated media remotely on your own schedule, using fluent...  ..., and clear written explanations. Evaluate voices, images, and videos. Outlier Experts support Scale AI’s training projects...  ...advanced AI systems through Outlier’s evaluation loop. Key Responsibilities:... 
    Remote work

    Scale AI

    Ottawa, ON
    6 hours ago
  •  ...Apply physics expertise to AI evaluation with TELUS Digital, reviewing formulas, units, diagrams, and explanations remotely as an independent contractor. This expert role suits candidates with a Physics, Mechanical Engineering, or Astronomy degree. You will assess AI-generated... 
    For contractors
    Remote work

    Telus Digital AI Solution

    Ottawa, ON
    6 hours ago
  •  ...Evaluate AI-generated responses remotely for clarity, accuracy, and human reasoning while developing...  ...labs and is seeking a Generalist Expert. The assignment lasts approximately two...  ...judgment, concise communication, and response evaluation skills to Mercor’s AI benchmarking and... 
    For contractors
    Remote work

    Mercor

    Ottawa, ON
    6 hours ago
  • TELUS Digital is building a global community of experts to evaluate, challenge and improve advanced AI systems. We are looking for university students, graduates...  ...– Responsible AI behaviour Domain-Specific AI Evaluation – Healthcare & Medicine – Law – Finance,... 
    Hourly pay
    For contractors
    Remote work
    Flexible hours

    TELUS Digital AI Data Solutions

    Ottawa, ON
    6 hours ago
  • Evaluate advanced AI systems remotely with TELUS Digital using subject-matter expertise, analytical...  ...researchers, and professionals for its global AI expert community. You may assess AI/ML...  ...-specific outputs. Work is expert evaluation rather than traditional data annotation... 
    For contractors
    Remote work

    TELUS Digital AI Data Solutions

    Ottawa, ON
    6 hours ago
  •  ...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task-based...  ...clinical EHR vignettes for a medical AI evaluation project. General and internal medicine are the... 
    Part time
    For contractors
    Remote work
    Flexible hours

    Mindrift

    Ottawa, ON
    5 days ago
  • $100 per hour

     ...experienced software developers to participate in an AI training project focused on testing and evaluating AI coding assistants. The project aims to improve...  ...feedback without using AI assistance to write evaluation responses. Nice to Haves: Experience maintaining... 
    Hourly pay
    Contract work
    Freelance
    Remote work
    Worldwide
    10 hours per week

    Lifted, an Upwork Company™

    Ottawa, ON
    2 days ago
  • $107.5k - $134.38k per year

     ...Department: UGME Accreditation and Program Evaluation Campus: Roger Guindon Hall Union...  ...plans that include a range of evaluation strategies, such as surveys, focus groups,...  ...data and provide meaningful insights and expert advice to the leadership, affiliated hospitals... 
    Permanent employment
    Temporary work
    For contractors
    Interim role
    Work at office

    University of Ottawa

    Ottawa, ON
    2 days ago
  • $142.5k - $152.65k per year

     ...NACCA is seeking an experienced Director of Strategy and Partnerships for a 14-month maternity...  ...support program reach and impact. Evaluate partnership effectiveness and adjust approaches...  ...qualitative and quantitative program evaluation frameworks. Oversee program data... 
    Long term contract
    Contract work
    Work at office
    Remote work

    Highbridge Human Capital

    Ottawa, ON
    14 days ago
  •  ...Ottawa ON CGI is seeking a Director Consulting Expert – Defence to support and expand our...  ...including opportunity identification, capture strategy, proposal development, and executive-level...  .... To support our recruitment team, AI tools may be used to help assess applications... 
    Long term contract
    Full time
    3 days per week

    CGI

    Ottawa, ON
    5 days ago
  • $80k - $175k per year

     ...connectedness. Learn from deep subject matter experts through mentoring and on the job coaching...  ...practitioner within Deloitte’s Technology Strategy & Transformation (TS&T) practice, you will...  ...reports. ~ Proficiency in utilizing AI tools (e.g., generative AI, automation... 
    Long term contract
    Permanent employment
    Temporary work
    Flexible hours

    Deloitte

    Ottawa, ON
    21 hours ago
  • $88.6k - $138.6k per year

     ...Americas Growth & Strategy (G&S) will help drive the strategic direction for Accenture’s largest Market. We will serve as trusted advisors...  ...combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and... 
    Full time
    Work at office
    Local area

    Accenture Global

    Ottawa, ON
    6 days ago
  •  ...TEHORA est présentement à la recherche d'un(e) expert(e) en intelligence artificielle ayant d'...  ...technique et recommandations d'architecture; Évaluation des risques, limites et biais potentiels des solutions IA; Azure AI, Azure OpenAI ou service équivalent; Microsoft... 
    Hourly pay
    Full time
    Contract work
    Apprenticeship
    Remote work
    Flexible hours

    TEHORA

    Ottawa, ON
    more than 2 months ago
  •  ...We Are: We are Technology Strategy and Transformation. Our vision is to become the world’s leading advisors in harnessing technology and innovation...  ...our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and... 
    Hourly pay
    Long term contract
    Full time
    Work at office
    Local area

    Accenture Global

    Ottawa, ON
    6 days ago
  • usd15 per hour

     ...Overview: Are you a web-savvy, search expert with a talent for finding things online by using...  ...you want to influence the future of global AI search? If so, we want you on board! Working on behalf of RWS, you will test and evaluate how our clients’ search engine responds to... 
    Weekly pay
    Full time
    Part time
    Freelance
    Second job
    Remote work
    Work from home
    Home office
    Flexible hours

    Rws

    Ottawa, ON
    a month ago
  •  ...They all touch the same customer. And if the journey feels disjointed, confusing, repetitive, or poorly timed, performance suffers. ~ Strategy that converts like a tent revival. You’ve planned campaigns that engage, educate, and motivate people to take action. You understand... 
    Full time
    Casual work
    Live In
    Work at office
    Remote work
    Flexible hours
    Shift work

    AlgaeCal

    Ottawa, ON
    16 days ago
  •  ...analytics platform, then dove headfirst into AI over the past couple of years, and that...  ...what we’re building. About the Platform Expert role When a customer hits a wall inside...  ...and teaching the customer about creative strategy along the way. It's the front lines of the... 
    Permanent employment
    Full time
    Summer work
    Internship
    Work at office
    Remote work
    Work from home
    Night shift

    Motion

    Ottawa, ON
    6 days ago
  • $314.8k per year

     ...facing roles that have a direct impact on sales. The Performance Strategy Principal Director applies deep business strategy development, architecting...  ...our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and... 
    Long term contract
    Full time
    Work at office
    Local area

    Accenture Global

    Ottawa, ON
    6 days ago
  • $75k - $125k per year

     ...seeking Intermediate Agentic AI Developers / AI Engineers to support...  ...capabilities. Evaluate, troubleshoot, and optimize AI...  ...applications, including testing, evaluation, monitoring, and responsible AI...  ...actively shape our company’s strategy and direction. Your work creates... 
    Full time

    CGI

    Ottawa, ON
    5 days ago
  •  ...This role is Hybrid Ottawa AI Solutions Engineer Position...  ...options analysis, specifically evaluating the performance and reliability...  ...systems, frameworks or strategies. Communicating information...  ...decisions, including candidate evaluation, selection, and disposition,... 
    Long term contract
    Full time
    Temporary work
    Local area
    Worldwide

    Thales

    Ottawa, ON
    5 days ago
  • $257.05k - $367.2k per year

     ...combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and...  ...capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song,... 
    Full time
    Work at office
    Local area
    Remote work

    Accenture Global

    Ottawa, ON
    6 days ago
  • $85k - $111.3k per year

     ...maintained through Generative AI and agentic software engineering...  ..., AI specialists, and domain experts, you will help turn emerging...  ...use cases, prototype solutions, evaluate their impact on development...  ...Develop repeatable benchmarks and evaluation methods to assess AI agent... 
    Long term contract
    Full time
    Temporary work
    Manual labor

    Ericsson

    Ottawa, ON
    6 days ago
  • $69.45k - $119.45k per year

     ...stepping boldly into this future with a clear strategy and purpose: to help clients optimize and...  ...their business with Data & Advanced AI — backed by a $3B investment and commitment...  ...knowledge integration, workflow automation, evaluation, observability and AI Ops. You will integrate... 
    Full time
    Manual labor
    Work at office
    Local area

    Accenture Global

    Ottawa, ON
    6 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Evaluation Strategy Expert. Be the first to apply!