Ai Eval/Qe — Toron
Best Your Buy
Company:
Epsilon Solutions LTD
Job Description Job Description ROLE: AI EVAL/QE TORONTO - HYBRID - FULLTIME 10 YRS EXP. PRIMARY SKILLS: Gen AI Automation Testing, AI evaluator/ quality engineer Define and execute the evaluation approach for generative-AI solutions, proving that models, agents and AI-assisted workflows are accurate, safe, reliable, performant and fit for production under TD controls. Requires 10 years in quality engineering and at least 2 years evaluating AI/ML systems, with strong Python, test automation, AP…
#J-18808-Ljbffr
Epsilon Solutions LTD
Job Description Job Description ROLE: AI EVAL/QE TORONTO - HYBRID - FULLTIME 10 YRS EXP. PRIMARY SKILLS: Gen AI Automation Testing, AI evaluator/ quality engineer Define and execute the evaluation approach for generative-AI solutions, proving that models, agents and AI-assisted workflows are accurate, safe, reliable, performant and fit for production under TD controls. Requires 10 years in quality engineering and at least 2 years evaluating AI/ML systems, with strong Python, test automation, AP…
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Ai Eval/Qe — Toron in Winnipeg, MB vacancy
- Quality Engineer (QE) / SDET - AI Chatbot ValidationJob Description: We are looking for a seasoned AI first Senior Quality Engineer who is empowered to help the DevOps enablement team deliver highest level quality and is responsible for ensuring the team live quality values...Suggested
- ...enterprise quality engineering and digital transformation with a strong emphasis on test automation, DevOps, and Generative AI. You will drive an ambitious QE roadmap while coordinating with engineering, product, design, and leadership teams. The role demands 15+ years in QE, a...Suggested
- ...leading organizations. As one of the largest IT services providers in Canada and globally, TCS is aiming to become the world's largest AI-led technology services company and is enabling its clients to transform themselves across the full AI stack, from infrastructure to intelligence...SuggestedLong term contract
- ...understanding of automation framework architecture- Experience utilizing AI for streamlining processes and creating efficiencies in D2D work-... ...position. You will lead Quality Engineers and workstream QE leads in a dotted-line capacity while contributing directly to automation...Suggested
$90k - $110k per year
...in Canada and globally, TCS is aiming to become the world's largest AI-led technology services company and is enabling its clients to... ...commitment to health, sustainability, and community empowerment. QE AutomationJob DescriptionRequired Skills Senior Quality Engineering...SuggestedLong term contract$90k - $120k per year
...the MSCI Global Sustainability Index and the FTSE4Good Emerging Index. Required Skill Sets: Essential skills for Real Time Payments QE Lead Onshore Good years of QE experience with experience in coordinating the activities with Onshore and Offshore. API Testing...- E have Immediate requirement with our Direct Client as QE/SDET @ Toronto ON (Hybrid - 4Days/Week). if you are interested Please share your updated resume to ****@*****.*** TitleQE/SDET Primary SkillsJava/Python, Selenium, RestAsssured, SQL Description...Immediate start
- DescriptionCompany: Artech LLC Job Description Job Description Title: Senior QA/QE Location: Toronto, ON/Hybrid Duration: 6 - 12 Months We are seeking a highly skilled professional with a strong background in payment testing, particularly with Connex systems. The ideal...Remplacement
- Step into a leadership role at QE Home as a Store Manager, where you'll create an inviting atmosphere and oversee sales operations in the home décor sector. Inspire your team while enhancing the guest experience. As the Store Manager, you will be at the forefront of all operational...Work from home
- ...achievements for the Value Stream to highlight the ROIPrepare and communicate performance feedbackWhat You Will Bring To Succeed Strong QE Experience in Functional Testing and Test AutomationSound knowledge of Data, EDL, HadoopExpert ETL, SQL Skills & Automation...
$96.3k - $154.4k per year
...on. We are building an automated regression capability that lets us release faster with higher confidence, and we are hiring senior QE engineers to design and build the automated suites that make it real. You will work across the product with cross-functional teams, writing...Long term contractTemporary workRemote workFlexible hours- OverviewQE Lead. Min 4 days WFO required. Skill: QE Lead (IVR + Automation). Job DescriptionQE Lead Experience: Proven track record in... ...unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-LjbffrFull time
- Job Title: QE Mobile Test Automation Engineer Location: Toronto, Canada / Remote Job Type: Contract About the RoleWe are seeking... ...and automation are a plus. Basic to intermediate exposure to AI/Agentic AI concepts in testing Hands-on usage of Cursor IDE and...Contract workRemote work
- Kapitus, Inc. is seeking a senior QA engineer to design and execute automated testing strategies using Playwright with TypeScript. You will automate UI, API, and integration tests, and help scale regression suites in a fast-paced fintech environment. You will collaborate with...Remote work
- Bilingual QE Engineer – Contact Center Tools Key Skills: Amazon Connect, French Speaking & Test AutomationExpertise in QE with Contact Center platforms.IVR/Routing Automation using Cyara, Hammer etc.Automation testing across UI & APIs (Selenium, Postman, Karate etc- any of...
- A software solutions provider is seeking a QE/SDET in Toronto, ON for a hybrid position (4 days a week). The role requires 8-10+ years of experience, strong programming skills in Java/Python, and expertise in test automation frameworks. Key responsibilities include designing...
$100k - $120k per year
AI EngineerPureFacts Financial Solutions Toronto, Ontario, Canada About this positionAbout PureFacts Financial SolutionsPureFacts is... ...cost optimization) Evaluation methods for generative AI (offline eval sets, human‑in‑the‑loop review, regression testing for prompt/...- Become a pivotal QE Lead specializing in Real Time Payments. This position focuses on your expertise in API Testing while managing interactions with onshore and offshore teams for innovative financial solutions. In this pivotal role, you will lead quality engineering efforts...
- ...commercial real estate owners bring their portfolios to net-zero with an AI-driven sustainability, asset, and investment management platform.... ...a bonus) Someone who's shipped AI features and understands the eval challenges that come with them Hands-on experience with LLMs/...Flexible hours
- ...product intelligence).The role You will own agent runtime and AI-adjacent backend: how skills are built, how tools are called, how... ...Hands-on LLM application work: function/tool calling, RAG, prompt + eval loops — not only wrapping a chatbot widgetComfort with LangChain /...Manual labor
- OverviewPrimary Skill - Playwright, Rest Assured, Java, Selenium Gen AI Testing Pioneer: Lead the integration of Gen AI into all phases of... ...and merging strategies. The Modern AI & Tools Edge Gen AI in QE: Proven experience leveraging Gen AI (e.G., Copilot, Claude, or...Contract workShift work
- ...passion, and you’re invited to be a part of that. • Our convenient Price Café offers free Tea and Coffee. Position Summary Join our AI team as an Intermediate AI Engineer, where you'll build and deploy AI applications, agents, and automation solutions that solve real...
- ...exceptional end-to-end mortgage experience powered by best-in-class AI technology. Fast, simple, and fully digital, nesto has been... ...narrative. The client Sponsor makes the final call on the story. Chair eval review. Run the weekly review of agent performance evidence and...Long term contractLive InWork at officeWork from home
- ...Value Solutions, a national IT consulting company, is seeking an AI Solution Architect to define the architecture and set the technical... ...and govern AI evaluation and quality assurance processes using LLM eval frameworks (e.g., Azure AI Evaluation SDK, DeepEval), including...
- Our client is an energy solutions provider. Our AI-enabled platform supports operations, tracking and decision-making to optimize large... ...outputs, retrieval/RAG and agent orchestrationEvaluating AI systems: eval sets built from representative data, automated graders, human...
- ...Rakuten, Dayforce, PagerDuty, ROSS Intelligence & Lazer. We have top AI staff, including from programs such as MScAC, and advisors that... ...tooling for measuring and iterating on LLM output quality, leveraging eval frameworks and observability platforms. Create tooling to...
$190k - $220k per year
...That's this role. You’ll embed directly with the cross functional AI team as a dedicated AI engineer. Your job isn't to write code... ...just prompting, but building reliable systems: structured outputs, eval frameworks, error handling, human-in-the-loop design. Operational...Hourly payShift work$140k - $160k per year
...worldwide. And we'd love for you to join us! About the job - Applied AI EngineerJoin the Engineering Team, where you'll help build our... ...of well-scoped components. Evals & Measurement: Own the eval harness for the features you ship. Build the datasets, the automated...Manual laborWork at officeWorldwide1 day per week- About AxyaAxya is building AI-powered technology that's transforming how the manufacturing industry sources and procures parts. Our platform... ...ERP and procurement data. Evaluation and quality: build the eval frameworks, test sets and monitoring that tell us whether the...InternshipRemote workFlexible hours
- ...centers that create friction for customers and drag for teams. Even as AI has advanced, most insurance work is still manual, slow and spread... ...like caching, context structuring and model selection Build eval pipelines that catch regressions and tie quality to every release...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Ai Eval/Qe — Toron. Be the first to apply!

