Ai Eval/Qe — Toron
Best Your Buy
Company:
Epsilon Solutions LTD
Job Description Job Description ROLE: AI EVAL/QE TORONTO - HYBRID - FULLTIME 10 YRS EXP. PRIMARY SKILLS: Gen AI Automation Testing, AI evaluator/ quality engineer Define and execute the evaluation approach for generative-AI solutions, proving that models, agents and AI-assisted workflows are accurate, safe, reliable, performant and fit for production under TD controls. Requires 10 years in quality engineering and at least 2 years evaluating AI/ML systems, with strong Python, test automation, AP…
#J-18808-Ljbffr
Epsilon Solutions LTD
Job Description Job Description ROLE: AI EVAL/QE TORONTO - HYBRID - FULLTIME 10 YRS EXP. PRIMARY SKILLS: Gen AI Automation Testing, AI evaluator/ quality engineer Define and execute the evaluation approach for generative-AI solutions, proving that models, agents and AI-assisted workflows are accurate, safe, reliable, performant and fit for production under TD controls. Requires 10 years in quality engineering and at least 2 years evaluating AI/ML systems, with strong Python, test automation, AP…
#J-18808-Ljbffr
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Ai Eval/Qe — Toron in Winnipeg, MB vacancy
- ...Company: Epsilon Solutions LTD Job Description Job Description ROLE: AI EVAL/QE TORONTO - HYBRID - FULLTIME 10 YRS EXP. PRIMARY SKILLS: Gen AI Automation Testing, AI evaluator/ quality engineer Define and execute the evaluation approach for generative-AI solutions, proving...SuggestedFull time
Best Your Buy
Winnipeg, MB-1 - Quality Engineer (QE) / SDET - AI Chatbot ValidationJob Description: We are looking for a seasoned AI first Senior Quality Engineer who is empowered to help the DevOps enablement team deliver highest level quality and is responsible for ensuring the team live quality values...Suggested
Astra-North Infoteck Inc.
Winnipeg, MB-1 - ...understanding of automation framework architecture- Experience utilizing AI for streamlining processes and creating efficiencies in D2D work-... ...position. You will lead Quality Engineers and workstream QE leads in a dotted-line capacity while contributing directly to automation...Suggested
Insight Global
Winnipeg, MB3 hours ago - ...focuses on designing and implementing quality engineering solutions, leveraging deep technical expertise in automation, API-first testing, AI-driven/agentic techniques, and non-functional validation. This is not a traditional QA Lead role. We are looking for a senior engineer (...Suggested
Insight Global
Winnipeg, MB3 hours ago - ...achievements for the Value Stream to highlight the ROIPrepare and communicate performance feedbackWhat You Will Bring To Succeed Strong QE Experience in Functional Testing and Test AutomationSound knowledge of Data, EDL, HadoopExpert ETL, SQL Skills & Automation...Suggested
Scotiabank
Winnipeg, MB-1 $96.3k - $154.4k per year
...on. We are building an automated regression capability that lets us release faster with higher confidence, and we are hiring senior QE engineers to design and build the automated suites that make it real. You will work across the product with cross-functional teams, writing...Long term contractTemporary workRemote workFlexible hoursKapitus, Inc.
Winnipeg, MB3 hours ago- Kapitus, Inc. is seeking a senior QA engineer to design and execute automated testing strategies using Playwright with TypeScript. You will automate UI, API, and integration tests, and help scale regression suites in a fast-paced fintech environment. You will collaborate with...Remote work
Kapitus, Inc.
Winnipeg, MBjust now - A software solutions provider is seeking a QE/SDET in Toronto, ON for a hybrid position (4 days a week). The role requires 8-10+ years of experience, strong programming skills in Java/Python, and expertise in test automation frameworks. Key responsibilities include designing...
Iris Software Inc.
Winnipeg, MB-2 - ...product intelligence).The role You will own agent runtime and AI-adjacent backend: how skills are built, how tools are called, how... ...Hands-on LLM application work: function/tool calling, RAG, prompt + eval loops — not only wrapping a chatbot widgetComfort with LangChain /...Manual labor
Supra ITS
Winnipeg, MB3 hours ago - ...passion, and you’re invited to be a part of that. • Our convenient Price Café offers free Tea and Coffee. Position Summary Join our AI team as an Intermediate AI Engineer, where you'll build and deploy AI applications, agents, and automation solutions that solve real...
- About AxyaAxya is building AI-powered technology that's transforming how the manufacturing industry sources and procures parts. Our platform... ...ERP and procurement data. Evaluation and quality: build the eval frameworks, test sets and monitoring that tell us whether the...InternshipRemote workFlexible hours
Axya
Winnipeg, MB-1 - ...exceptional end-to-end mortgage experience powered by best-in-class AI technology. Fast, simple, and fully digital, nesto has been... ...narrative. The client Sponsor makes the final call on the story. Chair eval review. Run the weekly review of agent performance evidence and...Long term contractLive InWork at officeWork from home
nesto
Winnipeg, MB3 hours ago $190k - $220k per year
...That's this role. You’ll embed directly with the cross functional AI team as a dedicated AI engineer. Your job isn't to write code... ...just prompting, but building reliable systems: structured outputs, eval frameworks, error handling, human-in-the-loop design. Operational...Hourly payShift workCookUnity LLC
Winnipeg, MB3 hours ago- ...Rakuten, Dayforce, PagerDuty, ROSS Intelligence & Lazer. We have top AI staff, including from programs such as MScAC, and advisors that... ...tooling for measuring and iterating on LLM output quality, leveraging eval frameworks and observability platforms. Create tooling to...
Mash
Winnipeg, MB-2 - Our client is an energy solutions provider. Our AI-enabled platform supports operations, tracking and decision-making to optimize large... ...outputs, retrieval/RAG and agent orchestrationEvaluating AI systems: eval sets built from representative data, automated graders, human...
Luxoft
Winnipeg, MB3 hours ago $120k - $140k per year
...Sound like you?ABOUT THIS ROLEWe are looking for a hands‑on Senior AI Engineer to build the platform that makes that possible — the... ...to agents.Establish AI evaluation, observability and guardrails — eval harnesses, regression testing for prompts and agents, tracing, quality...Work at officeLocal areaSafe Fleet
Winnipeg, MB3 hours ago- We're looking for a Staff AI Builder to lead the design and delivery of AI/ML systems. This role is ideal for an experienced engineer who... ...constraints, and few-shot design - not just prompt tinkeringBuild eval and observability into every agent you ship : golden datasets,...
robotsandpencils
Winnipeg, MB3 hours ago - ...Drive AI innovation as a Senior AI Engineer in Mississauga, Canada. Craft Python-based AI applications using FastAPI or Flask while optimizing performance and scalability for enterprise solutions. We are seeking an experienced Senior AI Engineer with over 8 years in software...
- ...Salesforce, the leading AI CRM, seeks a Senior Technical Consultant to drive enterprise deployments and AI-driven delivery. You'll partner with clients and internal teams to define architectures, implement solutions, and manage release cycles across desktop, cloud, and mobile...
- ...Value Solutions, a national IT consulting company, is seeking an AI Solution Architect to define the architecture and set the technical... ...and govern AI evaluation and quality assurance processes using LLM eval frameworks (e.g., Azure AI Evaluation SDK, DeepEval), including...
New Value Solutions Group
Winnipeg, MB3 hours ago - ...quality.This is a measurement-first engineering role. Today we ship AI features and form opinions about quality from anecdotes. You will... ...APIs in production, not in demos or notebooksYou have built an eval harness before and can explain why the naive version of it misleads...Live InRemote work
Velixo
Winnipeg, MB3 hours ago - ...centers that create friction for customers and drag for teams. Even as AI has advanced, most insurance work is still manual, slow and spread... ...like caching, context structuring and model selection Build eval pipelines that catch regressions and tie quality to every release...
General Magic
Winnipeg, MB3 hours ago - ...communities, and our people. If you want to be part of tomorrow’s health today, we want to hear from you. Position Summary The People AI Solutions Designer is the builder. Where the People AI Deployment Lead readies HR processes for automation, the Solutions Designer takes...
- ...Lead responsible AI adoption at YVR through digital governance, IT service management, and practical controls supporting safe airport operations. As Manager, Technology Services, you will oversee AI and digital tool governance across YVR. Reporting to the Director, Data...
- ...existing, active vacancy and we are looking to hire Technical Lead - AI Delivery in Brampton, ON (Onsite), who has experience as lead the... ...discovery and solution design.Collaborate with the Corp Apps Delivery and QE Teams for development, testing, deployment, and Hypercare...
Ardent SoftSol Inc.
Winnipeg, MB3 hours ago - ...1000 full-time professionals, and our annual growth rate exceeds 25%. Job Description Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US healthcare client. You will play a key role in developing and enhancing an...Full timeInternshipRemote workRelocation
$173k - $192k per year
Senior AI/ML Engineer, remote in Canada: own the AI that assesses patients for US healthcare providers and gets them to the right mental... ...Expertise in productizing LLM features and a strong background in eval-driven development. Expert-level proficiency in Python and...Remote workSoftware Directory
Winnipeg, MB-1- ...together! Is this role right for you? Strategy & Responsible AI Governance – Work with the business to define and implement a strategy... ...advanced RAG or agentic use cases. Building pipelines and eval sets to benchmark performance of such solutions is essential.Demonstrated...Long term contractFlexible hours
Tangerine
Winnipeg, MB3 hours ago $137k - $165k per year
...related spend in a single system. Combined with industry leading AI, the Motive platform gives you complete visibility and control, and... ...optimization.Turn prototypes into reusable platform capabilities with CI/CD, eval, and governance.Cloud infrastructureArchitect AWS/GCP environments...Long term contractTemporary workMotive
Winnipeg, MB3 hours ago$128.5k - $160.6k per year
...We are hiring a Software Engineer for the Automation team to use AI to solve and automate manual work across Coalition. This is a hands... ...correct" means with the business team before you build. Build the eval set, establish a baseline, and use it to make calls about what ships...Live InWork at officeRemote workHome officeCoalition Inc.
Winnipeg, MB-3
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Ai Eval/Qe — Toron. Be the first to apply!
