Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Applied Ai Evaluation Researcher

Kids Help Phone

Applied AI evaluation and user-centred research define this full-time contract role with Kids Help Phone in Toronto, using qualitative and quantitative methods.As an Applied AI Evaluation & Product Researcher, you will evaluate a youth-facing generative AI product. You will develop measurement strategies, conduct UX research, assess risks, and translate evidence into recommendations. The hybrid contract requires working one or two days weekly in the workplace.Key Responsibilities:
Develop evaluation strategies from early testing through post-launch monitoringCreate evaluation matrices linking objectives, indicators, data, and decisionsConduct surveys, usability testing, journey mapping, and co-design activitiesAssess unintended outcomes, bias, safety, privacy, and equity risksSynthesize findings into recommendations, reports, briefings, and decision materialsRequirements:
PhD or equivalent Master’s experience in a related disciplineMinimum five years evaluating generative AI or digital servicesKnowledge of responsible AI, safety, risk, or technology governanceStrong qualitative and quantitative research experienceExperience translating findings into product or implementation recommendationsBring evaluation strategy, UX research, and responsible AI expertise to Kids Help Phone’s youth-focused generative AI initiative.
#J-18808-Ljbffr
Vacancy posted 53 minutes ago
Similar jobs that could be interesting for youBased on the Applied Ai Evaluation Researcher in Winnipeg, MB vacancy
  • $95k - $110k per year

     ...Applied AI Evaluation & Product Researcher (Contract) Applied Research FT Contract Toronto, Toronto, ON, CA Salary Range: $95,000.00 To $110,000.00 Annually Job title Applied AI Evaluation & Product Researcher (12 Month Contract) Department Reports to Director... 
    Suggested
    Full time
    Contract work
    Live In
    2 days per week
    1 day per week

    Kids Help Phone

    Winnipeg, MB
    51 minutes ago
  • $118k - $157.5k per year

     ...all. About The Role And The TeamAs an Applied Researcher 1 within the Computer Vision team, you...  ...You will work on training, fine‑tuning, evaluation, and deployment of models across problem...  ...inference, and evaluation pipelines for modern AI systems, including workflows that... 
    Suggested
    Internship
    Immediate start

    eBay

    Winnipeg, MB
    55 minutes ago
  •  ...you can be proud to be with.The AI/ML team within eBay’s Selling...  ...ML engineering — moving research from theoretical grounding through...  ...eBay’s global marketplace.As an Applied Researcher, you will design...  ...actionable listing advice.Developing evaluation frameworks for generative AI... 
    Suggested
    Manual labor
    Immediate start
    Worldwide

    eBay

    Winnipeg, MB
    53 minutes ago
  •  ...CIBC in Toronto is seeking a Quantum Machine Learning Research Scientist to drive applied research and design quantum algorithms for banking use cases such as fraud and optimization. You will collaborate with AI researchers, engineers and business stakeholders to translate... 
    Suggested

    CIBC

    Winnipeg, MB
    51 minutes ago
  • $140k - $175k per year

     ...Thomson Reuters Labs is seeking a Lead Research Engineer to lead the design and delivery...  ...software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable...  ..., interpreting evaluation results, and applying findings to engineering decisions.... 
    Suggested
    Internship
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Winnipeg, MB
    51 minutes ago
  •  ...unique opportunity to contribute to cutting-edge AI research in Trust and Safety, with a particular focus on understanding and evaluating the risks of autonomous AI systems. You’ll...  ...-renowned researchers drive fundamental and applied research at the University of Alberta (and... 
    Casual work
    Work at office
    Flexible hours
    Shift work

    Alberta Machine Intelligence Institute (Amii)

    Winnipeg, MB
    53 minutes ago
  • $40 - $80 per hour

    Synthires is seeking detail-oriented Generalists to help benchmark and improve advanced AI models. You will create research questions, answers, and evaluation materials using your academic or professional expertise. The opportunity is open to individuals with experience across... 
    Hourly pay
    Part time
    10 hours per week

    Synthires

    Winnipeg, MB
    57 minutes ago
  • $173k - $197.4k per year

     ...machine learning, conversational AI and design thinking into our...  ...to building world-class applied science and engineering teams...  ...work touches every aspect of the research life cycle, from partnering with...  ...from design through training, evaluation, validation, and implementation... 
    Work at office
    Work from home

    Capital One

    Winnipeg, MB
    54 minutes ago
  •  ...the role and the team In the role of Applied Researcher 3 within the Global Focus Categories Applied...  ...new computer vision and multimodal AI solutions. These solutions will address...  ...will research, build, train, fine-tune, evaluate, and deploy models and AI systems at scale... 
    Work at office
    Immediate start

    eBay

    Winnipeg, MB
    54 minutes ago
  • Alberta Machine Intelligence Institute (Amii) in Edmonton seeks an Applied Research Scientist to advance the safety of autonomous AI systems. You will investigate agentic AI safety, develop rigorous evaluation methods, and translate research into practical tools supporting... 

    Alberta Machine Intelligence Institute (Amii)

    Winnipeg, MB
    57 minutes ago
  • lululemon is seeking a Senior Director, AI/ML Research and Science to advance the company's AI capabilities through research, development, and...  ...impact. You will lead a lean team of AI researchers and applied scientists, balance long-range exploration with near-term business... 

    lululemon

    Winnipeg, MB
    58 minutes ago
  • eBay’s AI/ML team within the Selling organization is seeking an Applied Researcher to design and advance our research agenda across machine learning and generative AI. You will contribute to price guidance modeling and the expanding selling-agent platform, translating research... 

    eBay

    Winnipeg, MB
    56 minutes ago
  •  ...Work closely with process teams to translate physical signals into model inputs Own data experimental designs and statistical evaluations. Develop data collection requirements and model improvement cycles. Stay current with spectroscopy, computer vision, and remote... 
    Remote work

    Sixone

    Winnipeg, MB
    56 minutes ago
  •  ...Technology team is seeking two highly experienced Applied AI Engineers to design, build, and operate an...  ...-on role focused on production systems, not research or demos, requiring deep understanding of GenAI failure modes, evaluation, and governance. The engineers will... 
    Internship
    Work at office

    Compunnel Inc.

    Winnipeg, MB
    54 minutes ago
  • Applied AI Engineer### Applied AI EngineerApply: Remote, Canada: Poland, Virtual:...  ...AI runtime, retrieval, guardrails, and evaluation that make the platform's AI features work...  ...This Role Is Different*** **Applied, not research.** We use proven commercial models and win... 
    Full time
    Remote work

    Modaxo

    Winnipeg, MB
    53 minutes ago
  • eBay Inc. is seeking a Staff Applied Researcher to advance visual and multimodal AI across the Global Focus Categories. You will research, train, fine-tune, evaluate, and deploy foundation-model-based systems at scale, collaborating with product, engineering and analytics teams... 

    eBay Inc.

    Winnipeg, MB
    55 minutes ago
  • usd192k per year

     ...machine learning to create a new generation of AI-native scientific, engineering, and industrial simulation. We are seeking an applied researcher who can connect machine learning with...  ...counters, and physics constraints.Define evaluation methods that measure numerical impact,... 

    NVIDIA

    Winnipeg, MB
    51 minutes ago
  • $180k - $230k per year

     ...complex capital projects. The AI buildout runs on physical...  ...the world, including Crusoe, Applied Digital, and NTT. We raised a...  ...projects. Continuous improvement: Evaluate models repeatedly and...  ...features, inspired by latest research publications. What you'll doOwn... 
    For contractors
    Internship
    Work at office

    Foresight Works

    Winnipeg, MB
    52 minutes ago
  •  ...all applications and next steps. Our partner is looking for an Applied AI Engineer based in Canada. As an Applied AI Engineer, you will...  ..., agent orchestration, retrieval-augmented generation (RAG), evaluation frameworks, and safety controls. Working with proven commercial... 
    Long term contract

    Jobgether

    Winnipeg, MB
    57 minutes ago
  • About Mundo AI Mundo AI builds multimodal data infrastructure for frontier research labs and Fortune 100 companies. Our work covers...  ...Role We’re looking for an applied researcher to turn open-ended...  ...failure modes, develop novel evaluation methodologies, and design datasets... 
    Long term contract
    Temporary work
    Work at office

    Mundo AI Inc.

    Winnipeg, MB
    54 minutes ago
  •  ...Your RoleFloyd is PSP's in-house AI platform — a custom analyst...  ...built workflows that turn complex research questions into structured,...  ...role puts you at the frontier of applied AI inside an institutional...  ...multi-model orchestration and evaluation Collaborate with our Data Engineers... 
    Summer work
    Work at office
    Local area
    Remote work
    1 day per week

    PSP Investments | Investissements PSP

    Winnipeg, MB
    54 minutes ago
  • We’re seeking a Senior Applied AI Engineer to serve as a forward-deployed AI expert across...  ...teamsYou’ll turn the latest machine learning research into practical, production-ready...  ...end to end, from framing the question to evaluating model performance and deciding what’s worth... 
    Internship
    Flexible hours

    Clariti

    Winnipeg, MB
    51 minutes ago
  • $149.3k - $249.3k per year

     ...the computer vision area who is aspired to apply your skills to bring value to millions of...  ...Participate in the design, development, evaluation, deployment and updating of data-driven models for computer vision applications.Research and implement the state-of-the-art computer... 

    Amazon

    Winnipeg, MB
    58 minutes ago
  •  ...team dedicated to accelerating Generative AI adoption within a major organization. You...  ...enterprise connectors Performing testing, evaluation, and performance optimization of AI...  ...Your future team:You will work within an Applied AI team partnering closely with business and... 
    Work at office
    Remote work
    3 days per week

    Astek Group

    Winnipeg, MB
    58 minutes ago
  •  ...build a more efficient and enjoyable world. Role overviewAs an Applied AI Scientist, you design, build, and ship AI solutions that solve...  ...)Turn experiments into production-ready components (evaluation, monitoring, iteration)Coach colleagues on applied AI best practices... 
    Work at office
    Flexible hours

    Osedea

    Winnipeg, MB
    56 minutes ago
  • Software Developer - Applied AIRemote, Ontario Technology Remote...  ...J is the leading generative AI solution for tax professionals...  ...building industry-leading tax research software that helps accountants...  ...hands of tax professionals Evaluation and data-driven decisions:... 
    Long term contract
    Full time
    Immediate start
    Remote work

    Blue J Legal

    Winnipeg, MB
    51 minutes ago
  • $150k - $180k per year

     ...CivCheck, we created Guided AI Plan Review™ (GPR) - a...  ...offering. We’re seeking a Senior Applied AI Engineer to serve as a forward...  ...the latest machine learning research into practical, production‑...  ...from framing the question to evaluating model performance and deciding... 
    Full time
    Contract work
    Part time
    Internship
    Remote work

    Clariti Cloud Inc.

    Winnipeg, MB
    51 minutes ago
  • $140k - $160k per year

     ...worldwide. And we'd love for you to join us! About the job - Applied AI EngineerJoin the Engineering Team, where you'll help build our...  ...or model change actually made things better. Raise the bar for evaluation across the team - judge design, offline and online metrics, and... 
    Manual labor
    Work at office
    Worldwide
    1 day per week

    ContactMonkey

    Winnipeg, MB
    54 minutes ago
  • Drive applied research and technology innovation for iconic RBI brands as a Research and Development Manager. Focus on beverage and baked goods...  .... Responsibilities include laboratory testing, sensory evaluation, shelf-life studies, regulatory awareness, and project documentation... 
    Work at office

    Tim Hortons

    Winnipeg, MB
    54 minutes ago
  •  ...transition, regulatory challenges, application of AI technologies, and Industry 4.0...  ...Job Description We'relooking for an Applied AILeadto join Sia's ETI (Energy & Transportation...  ...are often the normBuild monitoring, evaluation, and guardrails so solutions perform reliably... 
    Local area
    Worldwide

    Sia

    Winnipeg, MB
    55 minutes ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Applied Ai Evaluation Researcher. Be the first to apply!