Ai Eval/Qe — Toron
Best Your Buy
Company:
Epsilon Solutions LTD
Job Description Job Description ROLE: AI EVAL/QE TORONTO - HYBRID - FULLTIME 10 YRS EXP. PRIMARY SKILLS: Gen AI Automation Testing, AI evaluator/ quality engineer Define and execute the evaluation approach for generative-AI solutions, proving that models, agents and AI-assisted workflows are accurate, safe, reliable, performant and fit for production under TD controls. Requires 10 years in quality engineering and at least 2 years evaluating AI/ML systems, with strong Python, test automation, AP…
#J-18808-Ljbffr
Epsilon Solutions LTD
Job Description Job Description ROLE: AI EVAL/QE TORONTO - HYBRID - FULLTIME 10 YRS EXP. PRIMARY SKILLS: Gen AI Automation Testing, AI evaluator/ quality engineer Define and execute the evaluation approach for generative-AI solutions, proving that models, agents and AI-assisted workflows are accurate, safe, reliable, performant and fit for production under TD controls. Requires 10 years in quality engineering and at least 2 years evaluating AI/ML systems, with strong Python, test automation, AP…
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Ai Eval/Qe — Toron in Winnipeg, MB vacancy
- Quality Engineer (QE) / SDET - AI Chatbot ValidationJob Description: We are looking for a seasoned AI first Senior Quality Engineer who is empowered to help the DevOps enablement team deliver highest level quality and is responsible for ensuring the team live quality values...Suggested
Astra-North Infoteck Inc.
Winnipeg, MB1 hour ago $90k - $110k per year
...in Canada and globally, TCS is aiming to become the world's largest AI-led technology services company and is enabling its clients to... ...commitment to health, sustainability, and community empowerment. QE AutomationJob DescriptionRequired Skills Senior Quality Engineering...SuggestedLong term contractTata Consultancy Services Limited
Winnipeg, MB1 hour ago- ...understanding of automation framework architecture- Experience utilizing AI for streamlining processes and creating efficiencies in D2D work-... ...position. You will lead Quality Engineers and workstream QE leads in a dotted-line capacity while contributing directly to automation...Suggested
Insight Global (United States)
Winnipeg, MB1 hour ago $96.3k - $154.4k per year
...on. We are building an automated regression capability that lets us release faster with higher confidence, and we are hiring senior QE engineers to design and build the automated suites that make it real. You will work across the product with cross-functional teams, writing...SuggestedLong term contractTemporary workRemote workFlexible hoursKapitus, Inc.
Winnipeg, MB1 hour ago- ...achievements for the Value Stream to highlight the ROIPrepare and communicate performance feedbackWhat You Will Bring To Succeed Strong QE Experience in Functional Testing and Test AutomationSound knowledge of Data, EDL, HadoopExpert ETL, SQL Skills & Automation...Suggested
Scotiabank
Winnipeg, MB1 hour ago - ...leading organizations. As one of the largest IT services providers in Canada and globally, TCS is aiming to become the world's largest AI-led technology services company and is enabling its clients to transform themselves across the full AI stack, from infrastructure to intelligence...Long term contract
Tata Consultancy Services Limited
Winnipeg, MB1 hour ago - E have Immediate requirement with our Direct Client as QE/SDET @ Toronto ON (Hybrid - 4Days/Week). if you are interested Please share your updated resume to ****@*****.*** TitleQE/SDET Primary SkillsJava/Python, Selenium, RestAsssured, SQL Description...Immediate start
Iris Software Inc.
Winnipeg, MB1 hour ago - DescriptionCompany: Artech LLC Job Description Job Description Title: Senior QA/QE Location: Toronto, ON/Hybrid Duration: 6 - 12 Months We are seeking a highly skilled professional with a strong background in payment testing, particularly with Connex systems. The ideal...Remplacement
Best Your Buy
Winnipeg, MB1 hour ago - Job Title: QE Mobile Test Automation Engineer Location: Toronto, Canada / Remote Job Type: Contract About the RoleWe are seeking... ...and automation are a plus. Basic to intermediate exposure to AI/Agentic AI concepts in testing Hands-on usage of Cursor IDE and...Contract workRemote work
Princeton IT Services, Inc
Winnipeg, MB1 hour ago - Bilingual QE Engineer – Contact Center Tools Key Skills: Amazon Connect, French Speaking & Test AutomationExpertise in QE with Contact Center platforms.IVR/Routing Automation using Cyara, Hammer etc.Automation testing across UI & APIs (Selenium, Postman, Karate etc- any of...
Astra-North Infoteck Inc.
Winnipeg, MB1 hour ago - Kapitus, Inc. is seeking a senior QA engineer to design and execute automated testing strategies using Playwright with TypeScript. You will automate UI, API, and integration tests, and help scale regression suites in a fast-paced fintech environment. You will collaborate with...Remote work
Kapitus, Inc.
Winnipeg, MB1 hour ago - A software solutions provider is seeking a QE/SDET in Toronto, ON for a hybrid position (4 days a week). The role requires 8-10+ years of experience, strong programming skills in Java/Python, and expertise in test automation frameworks. Key responsibilities include designing...
Iris Software Inc.
Winnipeg, MB1 hour ago - OverviewPrimary Skill - Playwright, Rest Assured, Java, Selenium Gen AI Testing Pioneer: Lead the integration of Gen AI into all phases of... ...and merging strategies. The Modern AI & Tools Edge Gen AI in QE: Proven experience leveraging Gen AI (e.G., Copilot, Claude, or...Contract workShift work
Astra-North Infoteck Inc.
Winnipeg, MB1 hour ago - ...product intelligence).The role You will own agent runtime and AI-adjacent backend: how skills are built, how tools are called, how... ...Hands-on LLM application work: function/tool calling, RAG, prompt + eval loops — not only wrapping a chatbot widgetComfort with LangChain /...Manual labor
Supra ITS
Winnipeg, MB1 hour ago - ...passion, and you’re invited to be a part of that. • Our convenient Price Café offers free Tea and Coffee. Position Summary Join our AI team as an Intermediate AI Engineer, where you'll build and deploy AI applications, agents, and automation solutions that solve real...
- Our client is an energy solutions provider. Our AI-enabled platform supports operations, tracking and decision-making to optimize large... ...outputs, retrieval/RAG and agent orchestrationEvaluating AI systems: eval sets built from representative data, automated graders, human...
Luxoft
Winnipeg, MB1 hour ago $190k - $220k per year
...That's this role. You’ll embed directly with the cross functional AI team as a dedicated AI engineer. Your job isn't to write code... ...just prompting, but building reliable systems: structured outputs, eval frameworks, error handling, human-in-the-loop design. Operational...Hourly payShift workCookUnity LLC
Winnipeg, MB1 hour ago- ...Lead responsible AI adoption at YVR through digital governance, IT service management, and practical controls supporting safe airport operations. As Manager, Technology Services, you will oversee AI and digital tool governance across YVR. Reporting to the Director, Data...
- ...exceptional end-to-end mortgage experience powered by best-in-class AI technology. Fast, simple, and fully digital, nesto has been... ...narrative. The client Sponsor makes the final call on the story. Chair eval review. Run the weekly review of agent performance evidence and...Long term contractLive InWork at officeWork from home
nesto
Winnipeg, MB1 hour ago $140k - $160k per year
...worldwide. And we'd love for you to join us! About the job - Applied AI EngineerJoin the Engineering Team, where you'll help build our... ...of well-scoped components. Evals & Measurement: Own the eval harness for the features you ship. Build the datasets, the automated...Manual laborWork at officeWorldwide1 day per weekContactMonkey
Winnipeg, MB1 hour ago$120k - $140k per year
...Sound like you?ABOUT THIS ROLEWe are looking for a hands‑on Senior AI Engineer to build the platform that makes that possible — the... ...to agents.Establish AI evaluation, observability and guardrails — eval harnesses, regression testing for prompts and agents, tracing, quality...Work at officeLocal areaSafe Fleet
Winnipeg, MB1 hour ago- ...Rakuten, Dayforce, PagerDuty, ROSS Intelligence & Lazer. We have top AI staff, including from programs such as MScAC, and advisors that... ...tooling for measuring and iterating on LLM output quality, leveraging eval frameworks and observability platforms. Create tooling to...
Mash
Winnipeg, MB1 hour ago $175k - $210k per year
Guidepoint is investing in applied AI across its research platform. We're building conversational AI systems that interact with our global... ...selection, cost/latency tradeoffs across vendors. Build the eval loop and treat quality as a number: define metrics, run experiments...InternshipGuidepoint
Winnipeg, MB1 hour ago$176.61k - $243.68k per year
We're looking for a Staff AI Builder to lead the design and delivery of AI/ML systems. This role is ideal for an experienced engineer who... ...constraints, and few-shot design - not just prompt tinkeringBuild eval and observability into every agent you ship : golden datasets,...Robots and Pencils
Winnipeg, MB1 hour ago- ...1000 full-time professionals, and our annual growth rate exceeds 25%. Job Description Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US healthcare client. You will play a key role in developing and enhancing an...Full timeInternshipRemote workRelocation
- ...Drive AI innovation as a Senior AI Engineer in Mississauga, Canada. Craft Python-based AI applications using FastAPI or Flask while optimizing performance and scalability for enterprise solutions. We are seeking an experienced Senior AI Engineer with over 8 years in software...
- ...Salesforce, the leading AI CRM, seeks a Senior Technical Consultant to drive enterprise deployments and AI-driven delivery. You'll partner with clients and internal teams to define architectures, implement solutions, and manage release cycles across desktop, cloud, and mobile...
- ...centers that create friction for customers and drag for teams. Even as AI has advanced, most insurance work is still manual, slow and spread... ...like caching, context structuring and model selection Build eval pipelines that catch regressions and tie quality to every release...
General Magic
Winnipeg, MB1 hour ago - ...Value Solutions, a national IT consulting company, is seeking an AI Solution Architect to define the architecture and set the technical... ...and govern AI evaluation and quality assurance processes using LLM eval frameworks (e.g., Azure AI Evaluation SDK, DeepEval), including...
New Value Solutions Group
Winnipeg, MB1 hour ago - About AxyaAxya is building AI-powered technology that's transforming how the manufacturing industry sources and procures parts. Our platform... ...ERP and procurement data. Evaluation and quality: build the eval frameworks, test sets and monitoring that tell us whether the...InternshipRemote workFlexible hours
Axya
Winnipeg, MB1 hour ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Ai Eval/Qe — Toron. Be the first to apply!
