Ai Evaluation Strategy Expert
Telus Digital AI Solution
Shape AI evaluation with exceptional writing and logic-based decision-making at TELUS Digital, working remotely as an independent contractor. Define how systems reason across cultures.As an AI strategy expert, you will design rubrics, audit annotation quality, and investigate model outputs. Your work supports Reinforcement Learning from Human Feedback and consistent, helpful AI personas. You will collaborate with stakeholders on response profiles for industries and user personas.Key Responsibilities:
Draft multi-dimensional rubrics for tone, logic, and instruction followingLead quality-assurance audits for large-scale annotation projectsInvestigate hallucinations and logical fallacies in model outputsDevelop prompt-engineering strategies to mitigate model issuesDefine Ideal Response Profiles with project stakeholdersRequirements:
Bachelor’s Degree in technical or humanities disciplineMinimum B1 intermediate English proficiencyNative-level fluency in at least one languageExceptional writing and logic-based decision-making skillsSuccessful qualification exam and completed ID verificationApply AI reasoning, prompt engineering, and language expertise to help TELUS Digital shape human-aligned systems.
#J-18808-Ljbffr
Draft multi-dimensional rubrics for tone, logic, and instruction followingLead quality-assurance audits for large-scale annotation projectsInvestigate hallucinations and logical fallacies in model outputsDevelop prompt-engineering strategies to mitigate model issuesDefine Ideal Response Profiles with project stakeholdersRequirements:
Bachelor’s Degree in technical or humanities disciplineMinimum B1 intermediate English proficiencyNative-level fluency in at least one languageExceptional writing and logic-based decision-making skillsSuccessful qualification exam and completed ID verificationApply AI reasoning, prompt engineering, and language expertise to help TELUS Digital shape human-aligned systems.
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Ai Evaluation Strategy Expert in Winnipeg, MB vacancy
- Apply physics expertise to AI evaluation with TELUS Digital, reviewing formulas, units, diagrams, and explanations remotely as an independent contractor.This expert role suits candidates with a Physics, Mechanical Engineering, or Astronomy degree. You will assess AI-generated...SuggestedFor contractorsRemote work
- TELUS Digital is building a global community of experts to evaluate, challenge and improve advanced AI systems. We are looking for university students, graduates... ...– Responsible AI behaviour Domain-Specific AI Evaluation – Healthcare & Medicine – Law – Finance,...SuggestedHourly payFor contractorsRemote workFlexible hours
- Evaluate advanced AI systems remotely with TELUS Digital using subject-matter expertise, analytical... ...researchers, and professionals for its global AI expert community. You may assess AI/ML... ...-specific outputs. Work is expert evaluation rather than traditional data annotation...SuggestedFor contractorsRemote work
- We are looking for a Finance - AI Model Evaluator to help train AI models. You will measure the progress of these AI chatbots, evaluate their logic... ...quality of each model. In this role you will need to hold an expert level of financial reasoning- a completed or in progress...SuggestedHourly payFor contractors
- Evaluate AI models using consulting judgment, structured analysis, and clear written rationale... ...and weaknesses. Your work spans strategy, market research, leadership communications... ...select the strongest recommendationBuild evaluation tasks, rubrics, and model answersRequirements...SuggestedFor contractorsRemote work
- Applied AI evaluation and user-centred research define this full-time contract role with Kids Help Phone in Toronto, using qualitative and... ...youth-facing generative AI product. You will develop measurement strategies, conduct UX research, assess risks, and translate evidence...Full timeContract work1 day per week
- Shape business reasoning in AI models using finance and strategy expertise from a fully remote, flexible contract. Work independently on your schedule.Alignerr seeks MBA-trained professionals to train and evaluate advanced AI models on business reasoning. You will apply finance...Hourly payContract workRemote workFlexible hours
- # Python Developer-AI EvaluationZettaMine Labs Pvt. Ltd. · , CABack to resultsPython Developer-AI EvaluationZettaMine Labs Pvt. Ltd.,... ...- Python / TypeScript (USA) for a short-term AI Engineering and Evaluation project focused on improving AI models through high-quality training...Hourly payContract workTemporary workFreelanceImmediate startRemote work
- Build reliable autonomous AI at Equifax through LLM evaluation, Python automation, and multi-agent workflow testing. This newly created position focuses on production reliability.As an Agentic AI Evaluation & Tuning Engineer, you will connect LLM capabilities with dependable...
- Elevate AI advancement at DataAnnotation as an Electrical Engineer, focusing on real-world circuit and systems challenges. Apply your... ...Design realistic engineering problems from practical experience • Evaluate AI model outputs against professional benchmarks • Compare model...
- ...Join Workada as a Remote Video Production Evaluator dedicated to improving AI technology through precise evaluations. This full-time role focuses on quality assessment of multimedia outputs. At Workada, we seek an expert who can critically analyze video, image, and text...Full timeRemote work
- Evaluate AI answers through a molecular biology lens, checking mechanisms, experiments, and citations remotely with DataAnnotation. Clear English writing is essential.This Molecular Biology AI Evaluator role focuses on distinguishing established findings, contested claims,...Remote work
- Cohere is seeking a Senior Research Scientist focused on AI evaluation methods to support our innovative foundation models. This remote or on-site role emphasizes creating evaluation benchmarks and tools that enhance LLM capabilities. As a Senior Research Scientist at Cohere...Remote work
- Lead AI evaluation strategy from Canada, applying automated testing and model governance to improve agent reliability across enterprise automations.As Lead Product Manager, Agent Runtime and Evals, you will shape evaluation infrastructure for an AI platform. Your scope includes...
- Apply British English expertise to AI audio evaluation from Canada, using careful listening and linguistic analysis in a fully remote freelance arrangement.This British English Voice Expert role supports an AI training project evaluating spoken English quality and authenticity...FreelanceRemote work
$110k - $144k per year
Expert AI Engineering-CAJob Location: Montreal - QC French/English Bilingual Requirement: Yes Hiring Salary Range: $ 110000 - 144000... ...Augmented Generation (RAG), prompt engineering, model evaluation, and AI workflow automation patterns to support scalable production...Work at officeMonday to friday$95k - $110k per year
...Applied AI Evaluation & Product Researcher (Contract) Applied Research FT Contract Toronto,... ...will develop and implement an evaluation strategy that defines success, examines user experience... ...clinical leaders and subject‑matter experts to ensure evaluation criteria reflect...Full timeContract workLive In2 days per week1 day per week- Leverage your engineering expertise as an Electrical Engineer AI Evaluator with DataAnnotation, focusing on evaluating frontier AI models in real-world electronics tasks. Engage in challenging problem design and model assessment remotely. At DataAnnotation, we seek an experienced...Remote work
- Shape reliable AI systems through retrieval, RAG, evaluation, and monitoring for an energy platform supporting complex portfolio decisions. Use Python or Node.Js daily.As a mid-to-senior Applied AI Engineer, you will improve how AI quality, cost, and latency are measured in...
- Agentic AI Expert at Rodeo FX . Repeatedly voted one of Montreal’s Top Employers and Employer of the Year for the 2022 Mercuriades... ...post‑production operations. Key ResponsibilitiesAgentic AI Strategy and Use Cases Identify, assess, and prioritize high‑impact use...Permanent employmentFull timeContract workLocal areaFlexible hours3 days per week
- ...more than 5 years of sales experience, you will lead sales initiatives, partner with training efforts, and contribute to marketing strategies. You will also assess market trends to identify promising opportunities for expansion. Key Responsibilities: • Connect with clients...
- Evaluate advanced statistical queries and AI-generated solutions with expertise in statistical inference. Work remotely through discussions or workshops... ...techniquesBring statistical inference expertise and careful evaluation skills to strengthen accurate, interpretable AI model...Remote work
- Evaluate frontier AI models with electrical engineering judgment, circuit analysis expertise, and flexible remote work from your own computer.DataAnnotation seeks an experienced electrical engineer for independent contract work evaluating real engineering tasks. Apply circuit...Contract workFor contractorsRemote workFlexible hours
- Evaluate AI-generated code remotely from Canada using software expertise, detailed rubrics, and strong written communication skills. Flexible contract work offers 20+ hours weekly.As a Senior Software Engineer AI Data contributor, you will assess coding agents through codebases...Ongoing contractContract workFor contractorsRemote workFlexible hours
- Lead marketing strategy and commercialization for National Bank from Edmonton, Montreal, or Toronto in a hybrid specialist position. Shape... ...through client, market, and competitive insight.As a Senior Expert, Marketing Strategy and Commercialization, you will work across...Permanent employmentFull time
- Shape trusted AI evaluation at CrowdStrike using agent frameworks, LLM APIs, and verification-first test automation. Work on cloud-based cybersecurity systems.As a Software Development Engineer in Test, you will help determine how CrowdStrike AI agents are tested, evaluated...
- Evaluate AI-generated code remotely for Alignerr while applying software engineering, debugging, and code review expertise. Work flexibly... ...equivalent practical experienceApply software engineering, code evaluation, and precise technical communication to help Alignerr improve AI...Hourly payContract workRemote work
- Join Sports Experts as you lead the evolution of learning strategies to enhance employee development in Laval, Quebec. This key role focuses on innovative learning... ...for operational success • Use metrics to evaluate and enhance learning impact Requirements: • Bachelor...
- Evaluate AI-generated mechanical designs and calculations with strong engineering fundamentals and technical writing skills. Work fully remotely... ..., CFD, MATLAB, or Python experienceBring careful engineering evaluation, failure analysis, and technical communication to...For contractorsRemote workFlexible hours
- Shape trusted AI evaluation with performance testing and CI/CD expertise as a Software Development Engineer in Test at CrowdStrike. Work on scalable cybersecurity services.As an SDET, you will help define how AI agents are tested, evaluated, and trusted in production. CrowdStrike...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Ai Evaluation Strategy Expert. Be the first to apply!

