AI Evaluation Strategy Expert
Telus Digital AI Solution
Shape AI evaluation with exceptional writing and logic-based decision-making at TELUS Digital, working remotely as an independent contractor. Define how systems reason across cultures.
As an AI strategy expert, you will design rubrics, audit annotation quality, and investigate model outputs. Your work supports Reinforcement Learning from Human Feedback and consistent, helpful AI personas. You will collaborate with stakeholders on response profiles for industries and user personas.
Key Responsibilities:
- Draft multi-dimensional rubrics for tone, logic, and instruction following
- Lead quality-assurance audits for large-scale annotation projects
- Investigate hallucinations and logical fallacies in model outputs
- Develop prompt-engineering strategies to mitigate model issues
- Define Ideal Response Profiles with project stakeholders
Requirements:
- Bachelor’s Degree in technical or humanities discipline
- Minimum B1 intermediate English proficiency
- Native-level fluency in at least one language
- Exceptional writing and logic-based decision-making skills
- Successful qualification exam and completed ID verification
Apply AI reasoning, prompt engineering, and language expertise to help TELUS Digital shape human-aligned systems.
#J-18808-Ljbffr- ...Review AI-generated media with Outlier using sharp visual judgment and... ..., images, and videos. Outlier Experts support Scale AI’s training projects by evaluating model outputs. You will roleplay... ...Write evidence-based explanations of evaluation decisions Requirements:...SuggestedRemote workFlexible hours
- ...Review AI-generated images, videos, and voices remotely on your own schedule with Outlier as an English-speaking AI Media Evaluation Expert. Outlier Experts support Scale AI’s training projects by evaluating model outputs and explaining quality issues. You will assess adherence...SuggestedRemote work
- ...Evaluate AI-generated media remotely on your own schedule using fluent English, close observation... ...English speakers. As an Outlier Expert, you will help assess models across images... ...in English. Tasks support Outlier’s evaluation and feedback loop for improving advanced...SuggestedFreelanceRemote workFlexible hours
- ...Review AI-generated media remotely on your own schedule using careful observation, English... ..., and evidence-based judgment. Evaluate voices, images, and videos for quality.... ...problems clearly. Your feedback supports evaluation and improvement of advanced AI systems....SuggestedRemote work
- ...Evaluate AI-generated media for Outlier remotely on your own schedule, using fluent English... ...and evidence-based judgment. Outlier Experts review AI voice, image, and video outputs... ...findings in writing. The work supports evaluation and feedback for improving advanced AI systems...SuggestedRemote work
- ...Evaluate AI-generated media remotely on your own schedule using fluent English, close observation, and evidence-based writing. Review voices... ...mismatches Write specific English explanations supporting evaluation decisions Requirements: Fluent English and clear written...For contractorsRemote work
- ...Evaluate AI-generated media for Outlier remotely, using fluent English, close observation, and clear written explanations on your own schedule. Outlier, operated by Scale AI, seeks detail-oriented English speakers for AI training projects. You will review voice conversations...Remote work
- ...Review AI-generated media remotely on your own schedule, using fluent... ..., and clear written explanations. Evaluate voices, images, and videos. Outlier Experts support Scale AI’s training projects... ...advanced AI systems through Outlier’s evaluation loop. Key Responsibilities:...Remote work
- ...Apply physics expertise to AI evaluation with TELUS Digital, reviewing formulas, units, diagrams, and explanations remotely as an independent contractor. This expert role suits candidates with a Physics, Mechanical Engineering, or Astronomy degree. You will assess AI-generated...For contractorsRemote work
- ...Evaluate AI-generated responses remotely for clarity, accuracy, and human reasoning while developing... ...labs and is seeking a Generalist Expert. The assignment lasts approximately two... ...judgment, concise communication, and response evaluation skills to Mercor’s AI benchmarking and...For contractorsRemote work
- TELUS Digital is building a global community of experts to evaluate, challenge and improve advanced AI systems. We are looking for university students, graduates... ...– Responsible AI behaviour Domain-Specific AI Evaluation – Healthcare & Medicine – Law – Finance,...Hourly payFor contractorsRemote workFlexible hours
- Evaluate advanced AI systems remotely with TELUS Digital using subject-matter expertise, analytical... ...researchers, and professionals for its global AI expert community. You may assess AI/ML... ...-specific outputs. Work is expert evaluation rather than traditional data annotation...For contractorsRemote work
- ...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task-based... ...clinical EHR vignettes for a medical AI evaluation project. General and internal medicine are the...Part timeFor contractorsRemote workFlexible hours
$100 per hour
...experienced software developers to participate in an AI training project focused on testing and evaluating AI coding assistants. The project aims to improve... ...feedback without using AI assistance to write evaluation responses. Nice to Haves: Experience maintaining...Hourly payContract workFreelanceRemote workWorldwide10 hours per week$107.5k - $134.38k per year
...Department: UGME Accreditation and Program Evaluation Campus: Roger Guindon Hall Union... ...plans that include a range of evaluation strategies, such as surveys, focus groups,... ...data and provide meaningful insights and expert advice to the leadership, affiliated hospitals...Permanent employmentTemporary workFor contractorsInterim roleWork at office$142.5k - $152.65k per year
...NACCA is seeking an experienced Director of Strategy and Partnerships for a 14-month maternity... ...support program reach and impact. Evaluate partnership effectiveness and adjust approaches... ...qualitative and quantitative program evaluation frameworks. Oversee program data...Long term contractContract workWork at officeRemote work- ...Ottawa ON CGI is seeking a Director Consulting Expert – Defence to support and expand our... ...including opportunity identification, capture strategy, proposal development, and executive-level... .... To support our recruitment team, AI tools may be used to help assess applications...Long term contractFull time3 days per week
$80k - $175k per year
...connectedness. Learn from deep subject matter experts through mentoring and on the job coaching... ...practitioner within Deloitte’s Technology Strategy & Transformation (TS&T) practice, you will... ...reports. ~ Proficiency in utilizing AI tools (e.g., generative AI, automation...Long term contractPermanent employmentTemporary workFlexible hours$88.6k - $138.6k per year
...Americas Growth & Strategy (G&S) will help drive the strategic direction for Accenture’s largest Market. We will serve as trusted advisors... ...combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and...Full timeWork at officeLocal area- ...TEHORA est présentement à la recherche d'un(e) expert(e) en intelligence artificielle ayant d'... ...technique et recommandations d'architecture; Évaluation des risques, limites et biais potentiels des solutions IA; Azure AI, Azure OpenAI ou service équivalent; Microsoft...Hourly payFull timeContract workApprenticeshipRemote workFlexible hours
- ...We Are: We are Technology Strategy and Transformation. Our vision is to become the world’s leading advisors in harnessing technology and innovation... ...our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and...Hourly payLong term contractFull timeWork at officeLocal area
usd15 per hour
...Overview: Are you a web-savvy, search expert with a talent for finding things online by using... ...you want to influence the future of global AI search? If so, we want you on board! Working on behalf of RWS, you will test and evaluate how our clients’ search engine responds to...Weekly payFull timePart timeFreelanceSecond jobRemote workWork from homeHome officeFlexible hours- ...They all touch the same customer. And if the journey feels disjointed, confusing, repetitive, or poorly timed, performance suffers. ~ Strategy that converts like a tent revival. You’ve planned campaigns that engage, educate, and motivate people to take action. You understand...Full timeCasual workLive InWork at officeRemote workFlexible hoursShift work
- ...analytics platform, then dove headfirst into AI over the past couple of years, and that... ...what we’re building. About the Platform Expert role When a customer hits a wall inside... ...and teaching the customer about creative strategy along the way. It's the front lines of the...Permanent employmentFull timeSummer workInternshipWork at officeRemote workWork from homeNight shift
$314.8k per year
...facing roles that have a direct impact on sales. The Performance Strategy Principal Director applies deep business strategy development, architecting... ...our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and...Long term contractFull timeWork at officeLocal area$75k - $125k per year
...seeking Intermediate Agentic AI Developers / AI Engineers to support... ...capabilities. Evaluate, troubleshoot, and optimize AI... ...applications, including testing, evaluation, monitoring, and responsible AI... ...actively shape our company’s strategy and direction. Your work creates...Full time- ...This role is Hybrid Ottawa AI Solutions Engineer Position... ...options analysis, specifically evaluating the performance and reliability... ...systems, frameworks or strategies. Communicating information... ...decisions, including candidate evaluation, selection, and disposition,...Long term contractFull timeTemporary workLocal areaWorldwide
$257.05k - $367.2k per year
...combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and... ...capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song,...Full timeWork at officeLocal areaRemote work$85k - $111.3k per year
...maintained through Generative AI and agentic software engineering... ..., AI specialists, and domain experts, you will help turn emerging... ...use cases, prototype solutions, evaluate their impact on development... ...Develop repeatable benchmarks and evaluation methods to assess AI agent...Long term contractFull timeTemporary workManual labor$69.45k - $119.45k per year
...stepping boldly into this future with a clear strategy and purpose: to help clients optimize and... ...their business with Data & Advanced AI — backed by a $3B investment and commitment... ...knowledge integration, workflow automation, evaluation, observability and AI Ops. You will integrate...Full timeManual laborWork at officeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Evaluation Strategy Expert. Be the first to apply!


