Ai Eval/Qe — Toron
Best Your Buy
Company:
Epsilon Solutions LTD
Job Description Job Description ROLE: AI EVAL/QE TORONTO - HYBRID - FULLTIME 10 YRS EXP. PRIMARY SKILLS: Gen AI Automation Testing, AI evaluator/ quality engineer Define and execute the evaluation approach for generative-AI solutions, proving that models, agents and AI-assisted workflows are accurate, safe, reliable, performant and fit for production under TD controls. Requires 10 years in quality engineering and at least 2 years evaluating AI/ML systems, with strong Python, test automation, AP…
#J-18808-Ljbffr
Epsilon Solutions LTD
Job Description Job Description ROLE: AI EVAL/QE TORONTO - HYBRID - FULLTIME 10 YRS EXP. PRIMARY SKILLS: Gen AI Automation Testing, AI evaluator/ quality engineer Define and execute the evaluation approach for generative-AI solutions, proving that models, agents and AI-assisted workflows are accurate, safe, reliable, performant and fit for production under TD controls. Requires 10 years in quality engineering and at least 2 years evaluating AI/ML systems, with strong Python, test automation, AP…
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Ai Eval/Qe — Toron in Winnipeg, MB vacancy
$90k - $110k per year
...in Canada and globally, TCS is aiming to become the world's largest AI-led technology services company and is enabling its clients to... ...commitment to health, sustainability, and community empowerment. QE AutomationJob DescriptionRequired Skills Senior Quality Engineering...SuggestedLong term contractTata Consultancy Services Limited
Winnipeg, MB1 hour ago- Quality Engineer (QE) / SDET - AI Chatbot ValidationJob Description: We are looking for a seasoned AI first Senior Quality Engineer who is empowered to help the DevOps enablement team deliver highest level quality and is responsible for ensuring the team live quality values...Suggested
Astra-North Infoteck Inc.
Winnipeg, MB1 hour ago - ...understanding of automation framework architecture- Experience utilizing AI for streamlining processes and creating efficiencies in D2D work-... ...position. You will lead Quality Engineers and workstream QE leads in a dotted-line capacity while contributing directly to automation...Suggested
Insight Global (United States)
Winnipeg, MB1 hour ago - ...leading organizations. As one of the largest IT services providers in Canada and globally, TCS is aiming to become the world's largest AI-led technology services company and is enabling its clients to transform themselves across the full AI stack, from infrastructure to intelligence...SuggestedLong term contract
Tata Consultancy Services Limited
Winnipeg, MB1 hour ago - ...achievements for the Value Stream to highlight the ROIPrepare and communicate performance feedbackWhat You Will Bring To Succeed Strong QE Experience in Functional Testing and Test AutomationSound knowledge of Data, EDL, HadoopExpert ETL, SQL Skills & Automation...Suggested
Scotiabank
Winnipeg, MB1 hour ago $96.3k - $154.4k per year
...on. We are building an automated regression capability that lets us release faster with higher confidence, and we are hiring senior QE engineers to design and build the automated suites that make it real. You will work across the product with cross-functional teams, writing...Long term contractTemporary workRemote workFlexible hoursKapitus, Inc.
Winnipeg, MB1 hour ago- DescriptionCompany: Artech LLC Job Description Job Description Title: Senior QA/QE Location: Toronto, ON/Hybrid Duration: 6 - 12 Months We are seeking a highly skilled professional with a strong background in payment testing, particularly with Connex systems. The ideal...Remplacement
Best Your Buy
Winnipeg, MB1 hour ago - Bilingual QE Engineer – Contact Center Tools Key Skills: Amazon Connect, French Speaking & Test AutomationSkill Required Expertise in QE with Contact Center platforms.IVR/Routing Automation using Cyara, Hammer, etc.Automation testing across UI & APIs (Selenium, Postman...
Astra-North Infoteck Inc.
Winnipeg, MB1 hour ago - Kapitus, Inc. is seeking a senior QA engineer to design and execute automated testing strategies using Playwright with TypeScript. You will automate UI, API, and integration tests, and help scale regression suites in a fast-paced fintech environment. You will collaborate with...Remote work
Kapitus, Inc.
Winnipeg, MB1 hour ago - OverviewPrimary Skill - Playwright, Rest Assured, Java, Selenium Gen AI Testing Pioneer: Lead the integration of Gen AI into all phases of... ...and merging strategies. The Modern AI & Tools Edge Gen AI in QE: Proven experience leveraging Gen AI (e.G., Copilot, Claude, or...Contract workShift work
Astra-North Infoteck Inc.
Winnipeg, MB1 hour ago - ...product intelligence).The role You will own agent runtime and AI-adjacent backend: how skills are built, how tools are called, how... ...Hands-on LLM application work: function/tool calling, RAG, prompt + eval loops — not only wrapping a chatbot widgetComfort with LangChain /...Manual labor
Supra ITS
Winnipeg, MB1 hour ago - ...passion, and you’re invited to be a part of that. • Our convenient Price Café offers free Tea and Coffee. Position Summary Join our AI team as an Intermediate AI Engineer, where you'll build and deploy AI applications, agents, and automation solutions that solve real...
- ...exceptional end-to-end mortgage experience powered by best-in-class AI technology. Fast, simple, and fully digital, nesto has been... ...narrative. The client Sponsor makes the final call on the story. Chair eval review. Run the weekly review of agent performance evidence and...Long term contractLive InWork at officeWork from home
nesto
Winnipeg, MB1 hour ago - Our client is an energy solutions provider. Our AI-enabled platform supports operations, tracking and decision-making to optimize large... ...outputs, retrieval/RAG and agent orchestrationEvaluating AI systems: eval sets built from representative data, automated graders, human...
Luxoft
Winnipeg, MB1 hour ago $176.61k - $243.68k per year
We're looking for a Staff AI Builder to lead the design and delivery of AI/ML systems. This role is ideal for an experienced engineer who... ...constraints, and few-shot design - not just prompt tinkeringBuild eval and observability into every agent you ship : golden datasets,...Robots and Pencils
Winnipeg, MB1 hour ago- About AxyaAxya is building AI-powered technology that's transforming how the manufacturing industry sources and procures parts. Our platform... ...ERP and procurement data. Evaluation and quality: build the eval frameworks, test sets and monitoring that tell us whether the...InternshipRemote workFlexible hours
Axya
Winnipeg, MB1 hour ago - ...centers that create friction for customers and drag for teams. Even as AI has advanced, most insurance work is still manual, slow and spread... ...like caching, context structuring and model selection Build eval pipelines that catch regressions and tie quality to every release...
General Magic
Winnipeg, MB1 hour ago - ...Value Solutions, a national IT consulting company, is seeking an AI Solution Architect to define the architecture and set the technical... ...and govern AI evaluation and quality assurance processes using LLM eval frameworks (e.g., Azure AI Evaluation SDK, DeepEval), including...
New Value Solutions Group
Winnipeg, MB1 hour ago $190k - $220k per year
...That's this role. You’ll embed directly with the cross functional AI team as a dedicated AI engineer. Your job isn't to write code... ...just prompting, but building reliable systems: structured outputs, eval frameworks, error handling, human-in-the-loop design. Operational...Hourly payShift workCookUnity LLC
Winnipeg, MB1 hour ago$120k - $140k per year
...Sound like you?ABOUT THIS ROLEWe are looking for a hands‑on Senior AI Engineer to build the platform that makes that possible — the... ...to agents.Establish AI evaluation, observability and guardrails — eval harnesses, regression testing for prompts and agents, tracing, quality...Work at officeLocal areaSafe Fleet
Winnipeg, MB1 hour ago- ...1000 full-time professionals, and our annual growth rate exceeds 25%. Job Description Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US healthcare client. You will play a key role in developing and enhancing an...Full timeInternshipRemote workRelocation
- ...Lead responsible AI adoption at YVR through digital governance, IT service management, and practical controls supporting safe airport operations. As Manager, Technology Services, you will oversee AI and digital tool governance across YVR. Reporting to the Director, Data...
- ...Drive AI innovation as a Senior AI Engineer in Mississauga, Canada. Craft Python-based AI applications using FastAPI or Flask while optimizing performance and scalability for enterprise solutions. We are seeking an experienced Senior AI Engineer with over 8 years in software...
- ...Salesforce, the leading AI CRM, seeks a Senior Technical Consultant to drive enterprise deployments and AI-driven delivery. You'll partner with clients and internal teams to define architectures, implement solutions, and manage release cycles across desktop, cloud, and mobile...
- ...communities, and our people. If you want to be part of tomorrow’s health today, we want to hear from you. Position Summary The People AI Solutions Designer is the builder. Where the People AI Deployment Lead readies HR processes for automation, the Solutions Designer takes...
- They will possess deep expertise in Oracle AI Agent Studio, Oracle Fusion Cloud Applications, AI architecture, GenAI technologies, and enterprise... ...and solution design.Collaborate with the Corp Apps Delivery and QE Teams for development, testing, deployment, and Hypercare...
TechDoQuest
Winnipeg, MB1 hour ago - ...together! Is this role right for you? Strategy & Responsible AI Governance – Work with the business to define and implement a strategy... ...advanced RAG or agentic use cases. Building pipelines and eval sets to benchmark performance of such solutions is essential.Demonstrated...Long term contractFlexible hours
Tangerine
Winnipeg, MB1 hour ago - Lead AI-native operations at Supabase by building autonomous agent systems, with hands-on architecture, evaluations, and production ownership... ...trusted autonomous operations for Supabase through architecture, eval-driven development, security judgment, and technical leadership....
Big Internet Seller Services Inc
Winnipeg, MB1 hour ago $128.5k - $160.6k per year
...We are hiring a Software Engineer for the Automation team to use AI to solve and automate manual work across Coalition. This is a hands... ...correct" means with the business team before you build. Build the eval set, establish a baseline, and use it to make calls about what ships...Live InWork at officeRemote workHome officeCoalition Inc.
Winnipeg, MB1 hour ago- Join us in building the AI layer for Observability!ClickStack is the open-source observability platform we're building at ClickHouse —... .... Tackle the hard parts. Latency, cost, context window limits, eval coverage, hallucinations on real telemetry. Who You Are You'...Local areaRemote workHome officeFlexible hours
ClickHouse
Winnipeg, MB1 hour ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Ai Eval/Qe — Toron. Be the first to apply!
