Ai Evaluation Strategy Expert
Telus Digital AI Solution
Shape AI evaluation with exceptional writing and logic-based decision-making at TELUS Digital, working remotely as an independent contractor. Define how systems reason across cultures.As an AI strategy expert, you will design rubrics, audit annotation quality, and investigate model outputs. Your work supports Reinforcement Learning from Human Feedback and consistent, helpful AI personas. You will collaborate with stakeholders on response profiles for industries and user personas.Key Responsibilities:
Draft multi-dimensional rubrics for tone, logic, and instruction followingLead quality-assurance audits for large-scale annotation projectsInvestigate hallucinations and logical fallacies in model outputsDevelop prompt-engineering strategies to mitigate model issuesDefine Ideal Response Profiles with project stakeholdersRequirements:
Bachelor’s Degree in technical or humanities disciplineMinimum B1 intermediate English proficiencyNative-level fluency in at least one languageExceptional writing and logic-based decision-making skillsSuccessful qualification exam and completed ID verificationApply AI reasoning, prompt engineering, and language expertise to help TELUS Digital shape human-aligned systems.
#J-18808-Ljbffr
Draft multi-dimensional rubrics for tone, logic, and instruction followingLead quality-assurance audits for large-scale annotation projectsInvestigate hallucinations and logical fallacies in model outputsDevelop prompt-engineering strategies to mitigate model issuesDefine Ideal Response Profiles with project stakeholdersRequirements:
Bachelor’s Degree in technical or humanities disciplineMinimum B1 intermediate English proficiencyNative-level fluency in at least one languageExceptional writing and logic-based decision-making skillsSuccessful qualification exam and completed ID verificationApply AI reasoning, prompt engineering, and language expertise to help TELUS Digital shape human-aligned systems.
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Ai Evaluation Strategy Expert in Winnipeg, MB vacancy
- 87751# Expert advisor in data governance and AI strategyMontrealHybridOtherApplyWith over 30 years of recognized expertise, COFOMO is now a leading Canadian... ...Experience in developing and implementing AI adoption strategies, including change management, skills development,...SuggestedPermanent employment
- ...seeking experienced finance professionals for a short-term AI training and evaluation project.We're looking for professionals with strong real-world... ..., tools, and training will be provided to selected experts.Who You Are We're looking for finance professionals with...SuggestedTemporary work
- L’évaluation immobilière commerciale vous intéresse? Mettez votre expertise senior au service de mandats complexes, de rapports rigoureux et... ...des rapports professionnels conformes aux normesTémoigner comme expert dans les dossiers litigieuxBonifier la base de données...Suggested
- We are looking for a Finance - AI Model Evaluator to help train AI models. You will measure the progress of these AI chatbots, evaluate their logic... ...quality of each model. In this role you will need to hold an expert level of financial reasoning- a completed or in progress...SuggestedHourly payFor contractors
- Evaluate AI prompts through nuclear safety expertise, distinguishing acceptable requests from... ...centers on reviewing prompts from other experts, classifying them as safe or unsafe, and... ...and clear domain analysis to AI prompt evaluation under a remote contract engagement. #J...SuggestedContract workWork at officeRemote work
- Use management consulting judgment to evaluate AI models against business problems, with flexible remote project availability through DataAnnotation... ....This opportunity suits experienced Management Consultants and Strategy Consultants. You will create client-style briefs, test AI...Remote workFlexible hours
- Cohere is seeking a Senior Research Scientist focused on AI evaluation methods to support our innovative foundation models. This remote or on-site role emphasizes creating evaluation benchmarks and tools that enhance LLM capabilities. As a Senior Research Scientist at Cohere...Remote work
- Rise Data Labs is seeking experienced finance professionals for a short-term AI training and evaluation project in Canada. You will leverage real-world financial expertise to design challenging tasks, evaluate AI outputs, and establish criteria that define high-quality responses...Temporary work
- Build reliable autonomous workflows at Equifax in Toronto using Python, LLM evaluation, and observability for production AI systems.This newly created full-time role focuses on Agentic AI Evaluation and Tuning Engineering. You will test multi-agent architectures, audit decision...Full time
- Elevate AI advancement at DataAnnotation as an Electrical Engineer, focusing on real-world circuit and systems challenges. Apply your... ...Design realistic engineering problems from practical experience • Evaluate AI model outputs against professional benchmarks • Compare model...
- ...Join Workada as a Remote Video Production Evaluator dedicated to improving AI technology through precise evaluations. This full-time role focuses on quality assessment of multimedia outputs. At Workada, we seek an expert who can critically analyze video, image, and text...Full timeRemote work
- # Python Developer-AI EvaluationZettaMine Labs Pvt. Ltd. · , CABack to resultsPython Developer-AI EvaluationZettaMine Labs Pvt. Ltd.,... ...- Python / TypeScript (USA) for a short-term AI Engineering and Evaluation project focused on improving AI models through high-quality training...Hourly payContract workTemporary workFreelanceImmediate startRemote work
- Apply British English expertise to AI audio evaluation from Canada, using careful listening and linguistic analysis in a fully remote freelance arrangement.This British English Voice Expert role supports an AI training project evaluating spoken English quality and authenticity...FreelanceRemote work
- Evaluate healthcare AI remotely with expertise in telehealth and clinical workflows. Alignerr offers hourly contract assignments on your own schedule... ...digital health, clinical workflow, and critical evaluation expertise to help Alignerr improve healthcare AI systems remotely...Hourly payContract workRemote work
- Lead RAG troubleshooting and LLM evaluation with embeddings, vector search, retrieval optimization... ...quality testing.As a Senior Agentic AI Engineer, you will improve how enterprise... ..., and response accuracyDesign evaluation strategies with metrics and test datasetsImplement prompt...
$200k - $350k per year
Evaluate AI-generated legal outputs remotely while growing business for a prominent downtown... ...client. Apply Litigation experience and expert judgment.This full-time Litigation Lawyer... ...client development with legal content evaluation. Candidates need four or more years of post...Full timeRemote work$126k - $176k per year
Sr. Legal AI Prompter / EvaluatorJob DescriptionSr. Legal AI Prompters / Evaluators are responsible for improving CoCounsel Legal by writing... ...legal subject matter experts (SMEs), software engineers, and... ...datasets with SMEs, coordinate evaluations, and design evaluation schemes...RemplacementWork at officeLocal areaFlexible hours- ...en structures ferroviaires pour diriger une équipe et agir comme experte technique. Vous établirez et documenterez la capacité portante des ponts du réseau, conformément aux normes CN et AREMA, et évaluerez les demandes de charges exceptionnelles. Vous fournirez un soutien...
$95k - $110k per year
...Applied AI Evaluation & Product Researcher (Contract) Applied Research FT Contract Toronto,... ...will develop and implement an evaluation strategy that defines success, examines user experience... ...clinical leaders and subject‑matter experts to ensure evaluation criteria reflect...Full timeContract workLive In2 days per week1 day per week$15k per year
...studio in Canada. We build websites, CRM systems, mobile apps and AI automation for small businesses — mostly legal and real estate... ...multi-step, multi-tool AI workflows that run unattendedBuild the evaluation and monitoring that tells us when a pipeline has quietly started...InternshipWork at officeRemote workFlexible hours- ...more than 5 years of sales experience, you will lead sales initiatives, partner with training efforts, and contribute to marketing strategies. You will also assess market trends to identify promising opportunities for expansion. Key Responsibilities: • Connect with clients...
- Agentic AI Expert at Rodeo FX . Repeatedly voted one of Montreal’s Top Employers and Employer of the Year for the 2022 Mercuriades... ...post‑production operations. Key ResponsibilitiesAgentic AI Strategy and Use Cases Identify, assess, and prioritize high‑impact use...Permanent employmentFull timeContract workLocal areaFlexible hours3 days per week
- Lead marketing strategy and commercialization for National Bank from Edmonton, Montreal, or Toronto in a hybrid specialist position. Shape... ...through client, market, and competitive insight.As a Senior Expert, Marketing Strategy and Commercialization, you will work across...Permanent employmentFull time
- Take a leadership role at Brookfield Energy as the Expert Director focused on Risk and Insurance Strategy. Manage complex global insurance programs and offer strategic... ...skills • Proficient in Microsoft Office Suite with AI awareness Contribute your expertise in risk...Work at office
- Leverage your engineering expertise as an Electrical Engineer AI Evaluator with DataAnnotation, focusing on evaluating frontier AI models in real-world electronics tasks. Engage in challenging problem design and model assessment remotely. At DataAnnotation, we seek an experienced...Remote work
- Evaluate frontier AI models with electrical engineering judgment, circuit analysis expertise, and flexible remote work from your own computer.DataAnnotation seeks an experienced electrical engineer for independent contract work evaluating real engineering tasks. Apply circuit...Contract workFor contractorsRemote workFlexible hours
$140k - $175k per year
...delivery of production-ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable evaluation... ..., you may contact our Human Resources Department at hr.leave-expert@thomsonreuters.com. Disability accommodations in the recruiting...InternshipWork at officeLocal areaFlexible hours- Here's a brief overview of the tasks and responsibilities you'll have : Design, integrate, operate, and scale a customer identity and access management (CIAM) platform covering front-end, back-end, API, and identity servicesSupport the integration of solutions with user and...
- Job description: Innovation and AI Strategy LeadAs Innovation and AI Strategy Lead, you will drive the design and delivery of analytics and... ...advantage across all MTY brands. You will serve as a subject matter expert for MTY and a lead collaborator with key digital partners,...Casual workWork at officeFlexible hours
$125 per hour
...experienced Management Consultant to help train AI models. You’ll test the newest models on... ...on teaching AI to think like a top-tier strategy advisor. The models can already generate... ...DataAnnotationDataAnnotation is where 100k+ experts train the world’s leading AI models. $...Full timeRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Ai Evaluation Strategy Expert. Be the first to apply!

