Senior HR AI Tools Evaluator & Knowledge Quality Lead

Obsidian

Obsidian is seeking experienced HR practitioners to evaluate AI-powered HR knowledge tasks. You will assess enterprise search answers for source grounding, permission handling, and content freshness, contributing to quality improvements.

You will judge citations, identify stale content, and distinguish retrieval misses from reasoning errors across multiple AI tools and HR knowledge sources. This is a technology-focused HR evaluation role in Toronto.

#J-18808-Ljbffr

Apply

Vacancy posted 14 hours ago

Similar jobs that could be interesting for youBased on the Senior HR AI Tools Evaluator & Knowledge Quality Lead in Toronto, ON vacancy

HR Knowledge Management Specialist
$70 - $90 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San... ..., and Jack Dorsey . Position: Knowledge Management Expert Type: Contract... ...Remote Role Responsibilities Evaluate answers from enterprise search and workplace...
Suggested
Contract work
Summer work
Remote work
Mercor
Toronto, ON
17 days ago
Senior / Staff Software Engineer, AI Tooling
...Waabi, founded by AI visionary Raquel Urtasun, is the leader in... ...: The latest advances in AI tooling is fundamentally changing all teams... .... We are looking for hands-on senior software engineers to build the... ...them work well for Waabi. Evaluate new AI tools, models, and agent...
Quality
Senior
Full time
Work at office
Work from home
Flexible hours
Waabi
Toronto, ON
16 days ago
AI Product Quality Specialist
$15 - $30 per hour
...explore, design, and implement AI strategies that are secure, scalable... ...engagement. From advisory and tooling to implementation and education... .... And through it all, we lead with purpose, love, and... ...same. The Opportunity Our senior team is shipping fast. Too fast...
Quality
Senior
Remote job
Hourly pay
Full time
Contract work
For contractors
Manual labor
Immediate start
Flexible hours
Human Agency Inc
Toronto, ON
23 days ago
Senior HR Business Partner
...widespread opportunity to build multilingual, AI/ML-based solutions that activate data for... ...in the office. About the Role: The Senior HR Business Partner is an individual... ...HR Business Partnering — Applies working knowledge of business priorities and workforce needs...
Senior
Long term contract
Full time
Work at office
Immediate start
1 day per week
Behavox
Toronto, ON
6 days ago
Solution Architect (Senior AI / Technical Lead)
...Glass (BIG) is a high-growth AI and automation consulting firm... ...portfolio spans more than 10 leading technologies across AI, cloud,... ...pod inherits for agent design, evaluation, observability, security, and... ...Evaluate new models, frameworks, and tooling with rigour rather than...
Senior
Permanent employment
Full time
Internship
Bits In Glass
Toronto, ON
21 days ago
Data Scientist - AI Evaluation
$100 - $150 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco... ..., and A/B test write-ups . Evaluate AI-generated or human-created work against established criteria to ensure quality and consistency. Provide detailed written...
Quality
Senior
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
more than 2 months ago
RTL Design Engineer - AI Tools
$100 - $175 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco... .../week Role Responsibilities Evaluate and enhance AI model training for... ...seamless integration. Utilize EDA tools for simulation, waveform debug, and coverage...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
more than 2 months ago
Nanny Wanted - Wanted: A Knowledgeable Nanny In Toronto
Hi there, My family is busy, both parents have demanding jobs. Here’s my little break down: I’m looking for someone to work with us from 4-8 every day. Part time. This could shift to 3-7 pm if that works better. We have two kids. 1 girl 5 years old 1 boy 1 years old...
Part time
Shift work
CanadianNanny.ca
Toronto, ON
19 days ago
Compliance AI Evaluator - Finance
$80 - $120 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...response with financial-services AI Evaluator Type: Contract Compensation... ...artifacts against domain-specific quality rubrics. Identify factual, aesthetic...
Quality
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
more than 2 months ago
Financial Compliance AI Evaluator
$80 - $120 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...response with financial-services AI Evaluator Type: Contract Compensation... ...artifacts against domain-specific quality rubrics. Identify factual, aesthetic...
Quality
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
more than 2 months ago
Lead Product Manager, AI Technology
$118.3k - $168.3k per year
...Overview: We're looking for a Lead Product Manager to run execution on Zynga's internal AI operating platform - the system... ...interconnected surfaces (chat, knowledge bases, connectors/MCPs,... ...technical landscape scans (models, tooling, competitive AI platforms), stakeholder...
Quality
Senior
Full time
Local area
Zynga, Inc.
Toronto, ON
23 days ago
Knowledge Management Specialist
$74k - $93.5k per year
...repetitive tasks. As we introduce more AI-enabled capabilities, you will be... ...journey where intelligent tools support better outcomes while people lead the decisions that matter. We're... ...America, Europe, and Australia. As a Knowledge Management Specialist at Prophix, you...
Full time
Internship
Prophix
Toronto, ON
more than 2 months ago
Senior AI Software Engineer
$150k - $200k per year
...Elliott is building its own agentic AI platform, with production... ...systems of record through MCP tool servers, the platform is already... ...continues to expand. This is the senior engineering role responsible... ...promotion, and secrets management. Lead code reviews for AI...
Quality
Senior
Full time
Stikeman Elliott Llp
Toronto, ON
8 days ago
Data Engineer - AI Model Evaluator
$80 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...AI coding agents to complete and evaluate complex data engineering tasks. Review... ...Codex, Windsurf, Gemini CLI, or similar tools. ~ Ability to evaluate model-generated...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
more than 2 months ago
DevOps Engineer - AI Model Evaluator
$85 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...AI coding agents to complete and evaluate complex infrastructure engineering tasks... ..., CI/CD pipelines , or observability tooling. ~ Regular use of AI coding agents...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
more than 2 months ago
Data Scientist - AI Evaluation
$100 - $150 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...pipelines , and technical reports. Evaluate AI-generated or human-created work against established criteria to ensure quality and accuracy. Provide detailed...
Quality
Senior
Remote job
Contract work
Summer work
Mercor
Toronto, ON
3 days ago
Physician (MD/DO) - Medical AI Evaluation
$100 per hour
...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is... ...integumentary systems; Score the clinical reasoning quality of benchmark items: vignette accuracy and...
Quality
Hourly pay
Permanent employment
Part time
10 hours per week
Mindrift
Toronto, ON
8 days ago
Senior Quality Coordinator
$80k - $115k per year
...projects, distinguished by the high quality of their work, meeting the... ...places using state-of-the-art tools and space. human at the heart... ...! We are looking to add a Senior Quality Coordinator to work... ...contribute to organizational knowledge and continuous improvement initiatives...
Quality
Senior
Full time
Work at office
Ebc Corp
Toronto, ON
more than 2 months ago
Director Channel Automation and Knowledge
...The Director, Channel Automation and Knowledge will lead and execute the strategic vision of customer... ...). ~ Technology Visionary: Identify, evaluate, and champion the adoption of innovative technologies, including AI, Agentic AI, CRM, Knowledge and Telephony platforms...
Senior
Hourly pay
Long term contract
Permanent employment
Full time
Temporary work
Internship
Work at office
Eq Bank
Toronto, ON
a month ago
RQ11350 - Test Lead - Senior
...accessibility requirements. Evaluate test results against business... ...testing impacts and support quality throughout the development lifecycle... ...and provide ongoing knowledge transfer to ministry staff to... ...or similar defect management tools. ~ Experience performing end...
Quality
Senior
Full time
Maarut Inc
Toronto, ON
6 days ago
Senior AI Software Developer
$125k - $175k per year
...the best and the brightest talents. The Senior AI Software Developer will design, build, and... ...systems using the Claude Agent SDK, MCP tool servers that connect AI agents to the firm... ...environment promotion, and secrets management. Lead code reviews for AI applications and...
Quality
Senior
Full time
Work at office
Stikeman Elliott Llp
Toronto, ON
21 days ago
AI Product Lead
...Description Role Overview The AI Lead is responsible for identifying, building, validating... ...to equipping our customers with the tools that streamline operations, improve operational... ...opportunities and revenue potential · Evaluate ideas based on impact, feasibility, and...
Full time
Valsoft
Toronto, ON
a month ago
Oliver Wyman - Senior Lead AI Developer
$195k - $285k per year
...breakthrough outcomes for their toughest AI challenges. We blend the power of AI technology... ...products across industries. As a Senior Lead AI Developer, you are primarily responsible... ...solutions to be extensible and production quality. You are an expert in selected domains and...
Quality
Senior
Work at office
Local area
Remote work
Flexible hours
3 days per week
1 day per week
Oliver Wyman
Toronto, ON
3 days ago
Principal Engineer ( AI + Dev Tooling)
$214k per year
...About The Team The Developer Tooling team empowers Scribd engineers... ...engineering capabilities that let AI agents execute alongside our... ...across the org. Mentor staff and senior engineers, coach teams to get... ...products Enterprise access to leading AI tools Are you currently...
Senior
Long term contract
Local area
Home office
Flexible hours
Scribd, Inc.
Toronto, ON
2 days ago
Senior Manager, AI
...Role: Senior Manager, AI Location: Mississauga , Ontario – Hybrid (4 days/week... ...What we offer In this role, you’ll lead the development and delivery of Mattamy’... ...program, make the build-versus-buy and tooling calls, and lead the rollout of AI capabilities...
Quality
Senior
Full time
Work at office
Mattamy Homes
Toronto, ON
more than 2 months ago
Senior AI Engineer
...Position: Senior AI Engineer Location: Toronto, ON Job ID#: RQ11252 Duration... ..., Llama, or similar) ~ Experience evaluating, selecting, and optimizing AI technologies... ...routing logic, and customer journeys ~ Knowledge of speech analytics, sentiment analysis,...
Quality
Senior
Full time
Symbiotic Digital
Toronto, ON
more than 2 months ago
Senior AI Engineer (Permanent)
...CoreFactor is searching for a Senior AI Engineer on a permanent/full-time basis. This position... ...intelligent applications and automation tools that use LLMs to solve business problems,... ...Generation (RAG). Design, prototype, and lead development of agentic AI systems capable...
Senior
Permanent employment
Full time
Work at office
CoreFactor
Toronto, ON
23 days ago
Senior / Staff Software Engineer, Web Tools
$141k - $249k per year
...Waabi, founded by AI pioneer and visionary Raquel Urtasun, is an... ...To learn more visit: On Tools, we build software tools that solve... ...tools. You will... - Lead technical and architecture discussions... ...developing production quality software. - Experience with modern...
Quality
Senior
Full time
Work at office
Work from home
Flexible hours
Waabi
Toronto, ON
more than 2 months ago
Senior Quality Engineer
$157.5k - $192.5k per year
...platform that gives self-made business owners the tools and know-how to be great with money—... ...count, and uptime. Your mission is to scale quality operations and build the tooling,... ...make the numbers mean something. You are AI-fluent in practice — using AI tools daily,...
Quality
Senior
Full time
Internship
Local area
Shift work
Relay
Toronto, ON
a month ago
Senior Software Engineer, AI
$167.5k - $235k per year
...running their business. We solve HR issues. We’re data-driven and... ...experience than using a particular tool or framework. About the role... ...cross-functional team to build AI agents that fundamentally... ...platform that can read operational knowledge, reason about it in context,...
Quality
Senior
Long term contract
Full time
Casual work
Internship
Work at office
Local area
Immediate start
Justworks
Toronto, ON
more than 2 months ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior HR AI Tools Evaluator & Knowledge Quality Lead. Be the first to apply!