Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Llm Application Test Engineer

TribalScale

Test LLM-powered applications at TribalScale using automation, API validation, and failure analysis for complex agent interactions. The location remains to be confirmed.As an Agentic QA Engineer, you will assess applications whose outputs are dynamic, nondeterministic, and dependent on multi-step reasoning. Your work will cover agent tool usage, external systems, integrations, and production behavior. Experience with AI agents or generative AI products is especially relevant.Key Responsibilities:
Validate agent tools, APIs, and external system interactionsDesign end-to-end testing strategies for agentic workflowsReproduce unexpected outputs and tool-use failuresApply automated quality checks to development pipelinesImprove agent behavior through production findingsRequirements:
Professional QA, quality engineering, SDET, or software engineering experienceExperience with automated testing and framework developmentUnderstanding of API and end-to-end testingExperience debugging complex applicationsFamiliarity with Git and CI/CD pipelinesUse software testing, automation, and AI application knowledge to strengthen LLM workflow quality and reliability at TribalScale.
#J-18808-Ljbffr
Vacancy posted 39 minutes ago
Similar jobs that could be interesting for youBased on the Llm Application Test Engineer in Winnipeg, MB vacancy
  • Hygiena in Mississauga, Ontario seeks an Applied AI Engineer to design, build, and deploy GenAI/LLM applications across Hygiena products, including data-driven...  ...align with regulatory standards, and advance MLOps, testing, and deployment practices in a fast-growing environment... 
    Suggested

    Urban Ridge Supplies

    Winnipeg, MB
    35 minutes ago
  •  ...Lenovo is seeking an AI Application Developer to join its U.S.-based AI Application Solutions team in a hybrid role at the Morrisville, NC...  ...like FastAPI/Flask/Django, developing ML pipelines, and implementing LLM-powered features such as semantic search and #J-18808-Ljbffr
    Suggested
    Work at office

    Lenovo

    Winnipeg, MB
    42 minutes ago
  • Test Java and MS .Net web applications with Selenium, SQL, and accessibility knowledge as a hybrid Senior Web Application Test Engineer. Onsite work is required three days weekly.This senior testing specialist develops maintainable test plans, test cases, automation scripts... 
    Suggested

    Rubicon Path

    Winnipeg, MB
    36 minutes ago
  • Apply penetration testing and secure code review expertise as an Application Security Engineer at TMX, supporting products across global capital markets.This Application Security...  ..., and risk managementAutomate security tests within CI/CD pipelinesRequirements: Three-plus... 
    Suggested

    tmx

    Winnipeg, MB
    37 minutes ago
  •  ...passion to drive life-changing impact to ZS.LLM Engineer We are seeking a highly skilled LLM...  ...requirements analysis, design, coding, testing, and deployment.Utilize AWS services/...  ...Search, etc.Strong understanding of scalable application design principles and experience with... 
    Suggested
    Work at office
    Local area
    Work from home
    Worldwide
    Flexible hours

    ZS

    Winnipeg, MB
    37 minutes ago
  • $114.4k - $164.4k per year

    Company:Qualcomm Canada ULC Job Area:Engineering Group, Engineering Group Machine Learning...  ...development and optimization with application to a specific problem domain in ML (e.G....  ...expects its employees to abide by all applicable policies and procedures, including but not... 
    Immediate start
    Work from home

    Urban Ridge Supplies

    Winnipeg, MB
    37 minutes ago
  •  ...4 years’ experience with creating other project documentation related to testing such as writing test strategies, test scenarios and test cases 4 years’ experience with testing various applications, monitoring testing activities and providing guidance/support to the test... 
    Contract work

    TecTammina

    Winnipeg, MB
    34 minutes ago
  • Python and LLM engineering define this remote Senior AI/LLM Engineer position with Kake, building production-ready applications and systems at scale.Kake seeks senior engineers who design, build...  ..., and AI output evaluation testing experienceApply senior Python engineering... 
    Remote work

    Kake

    Winnipeg, MB
    35 minutes ago
  • $195k - $390k per year

     ...AI!What you'll be doing:Work closely with senior engineers to deliver, optimize, maintain, debug, unit test and document next-generation dialogue and security...  ...to craft, develop, test, and maintain integrated applications and featuresActively contribute to the adoption of... 
    Flexible hours

    NVIDIA Corporation

    Winnipeg, MB
    35 minutes ago
  • Build LLM-powered and agentic features for Quartermaster using Python...  .... This is hands-on software engineering.As an AI Engineer, you will...  ...capabilities across a production SaaS application. You will work with LLM APIs,...  ...prompts, agents, tests, deployments, and monitoringEvaluate... 

    hireVouch

    Winnipeg, MB
    36 minutes ago
  • $218.89k - $245.95k per year

     ...conversations so they can debug them. We're bringing LLM and agent observability together, and we...  ...in a small, cross-functional group of engineers with a dedicated product manager and...  ...time.Additionally, in compliance with applicable law, all persons hired will be required to... 
    Internship
    Work at office
    Local area
    Work from home
    Home office
    Visa sponsorship
    Shift work

    Candidate

    Winnipeg, MB
    43 minutes ago
  • Oracle Fusion Applications Test Lead (FSCM, EPM, Procurement, OTBI) Oracle Fusion Applications Test Lead (FSCM,EPM, Procurement, OTBI) Experience Required: 6–8 Years Role Descriptions: Specialized Fusion Testing Testend-to-end business processes within and across... 

    Astra-North Infoteck Inc.

    Winnipeg, MB
    37 minutes ago
  • Drive model integration projects as a Senior Engineer focused on AI LLMs. Engage in end-to-end processes from architecture translation...  ...contributions will not only enhance the systems but also transform AI applications as a whole. Key Responsibilities: • Spearhead bringing ML... 

    Cerebras

    Winnipeg, MB
    35 minutes ago
  • About the RoleWe are seeking a versatile and experienced engineer to join our Inference Core Model Bringup team. This team is responsible...  ...levels of performance, efficiency, and scalability for AI applications. Responsibilities Contribute to the end-to‑end bring up of... 

    Cerebras

    Winnipeg, MB
    38 minutes ago
  • Use LLM tools, JavaScript, and solution design to extend Orgvue’s organizational planning...  ..., and internal teams.As Senior Solutions Engineer, you will help define, develop, and deliver...  ...LLM experience writing instructions and testing performanceStrong technical consulting and... 
    Remote work

    Orgvue

    Winnipeg, MB
    39 minutes ago
  • Python and LLM application engineering define this backend role at Supra ITS. Build production agent runtimes for cloud and on-premise deployments.You...  ...services, LangChain or LangGraph, SQL, Postgres, and Test Driven Development. You will ship through stories, architecture... 

    Supra ITS

    Winnipeg, MB
    41 minutes ago
  • Build reliable LLM platforms in Montreal with GitHub Copilot, Python, and CI/CD...  ...role centers on production AI engineering.This Senior AI Application Developer position delivers AI and LLM...  ...position also addresses observability, testing, security, responsible AI, and operational... 

    Fujitsu

    Winnipeg, MB
    40 minutes ago
  • Apply LLM, RAG, and software safety expertise at CS Group Canada in a hybrid, full-time contract focused on SW-FMEA automation.As a Software Safety Engineer, you will support the ZHAP improvement initiative for two months. The work combines artificial intelligence, C/C++ analysis... 
    Full time
    Contract work

    Sopra Steria

    Winnipeg, MB
    38 minutes ago
  • Develop LLM workflows and data pipelines for AXIS Capital’s enterprise...  ...teams.This Senior AI Platform Engineer builds reusable capabilities...  ...: Strong maintainable and tested Python engineering...  ...Databricks workloads and pipelinesLLM application or agent framework experience... 

    AXIS Capital

    Winnipeg, MB
    42 minutes ago
  • Engineer production LLM systems for ClickStack with agent design, evaluation, and SQL expertise. Work on observability tools used to understand real telemetry.ClickHouse is hiring an AI Product Engineer to develop agents on ClickStack, its open-source observability platform... 

    ClickHouse

    Winnipeg, MB
    36 minutes ago
  •  ...you’re invited to be a part of that. Applications Engineering Specialist – Antec Controls We’re...  ...records in CRM System • Perform product testing to support the implementation of new...  ...appreciate the interest shown by all applicants, however only those being considered... 
    For contractors
    Immediate start

    Price Industries Limited

    Winnipeg, MB
    11 days ago
  • Design RAG systems and LLM features for Wiser Solutions remotely, using embeddings...  ...problems.This Senior Machine Learning Engineer builds AI applications that reach production across product...  ...Your work includes evaluation, rollout testing, and live-system improvement.Key... 
    Remote work

    Wiser Solutions

    Winnipeg, MB
    36 minutes ago
  • $70k - $75k per year

     ...BurlingtonOur Team:Semtech's Signal Integrity Products Applications Team is a group of experienced, passionate and talented engineers tasked to support and deliver industry-leading...  ...technical customer collateral, including test reports, application notes, and input for data... 
    Internship
    Remote work

    Sierra Wireless

    Winnipeg, MB
    35 minutes ago
  •  ...through systems thinking, exploratory testing, and production-code debugging....  ...Content Pillar team. You will work with Engineering, Product, and Customer teams on LLM-backed systems, data pipelines, and...  ...includes user-centered discovery, test strategy, observability, and... 
    Work at office
    Remote work

    Blue J

    Winnipeg, MB
    35 minutes ago
  • Build advanced language systems as a Senior AI Engineer in Kimberley, applying NLP and LLM expertise within a hybrid work model. Develop scalable solutions that understand, generate, and process human language at scale.This senior position focuses on developing and deploying... 

    Placements24

    Winnipeg, MB
    41 minutes ago
  • Lead LLM systems at Axya, working hands-on with Python, retrieval, agent workflows, and...  ...evaluation in a 100% remote environment.As Lead AI Engineer, you will own Axya’s AI architecture and...  ...use workflowsBuild evaluation frameworks, test sets, and monitoringDeliver observable,... 
    Remote work

    Axya

    Winnipeg, MB
    38 minutes ago
  •  ...and hands-on Senior Software Development Engineer in Test (SDET)/Quality Engineering Architect to define...  ..., or distributed cloud performance engines. Observability & Bottleneck Identification...  ...of AI-assisted testing tools, LLM-driven test case generation, and automated... 
    Full time
    Contract work
    Shift work

    Dexian

    Winnipeg, MB
    38 minutes ago
  • Turn LLM research into commercial-quality systems with secure AWS Serverless architecture...  ...center.As a Senior Staff Software Engineer on Platform AI, you will lead through influence...  ..., and evaluation experienceSecure cloud application ownership at high scaleAWS CDK, Terraform... 

    Diligent

    Winnipeg, MB
    35 minutes ago
  •  ...use Dometic products in outdoor, residential, and professional applications.Our Marine organization is a trusted provider of innovative...  ...continuous growth – now looking for our next star – a passionate Test Engineer. This position reports to Test Engineering Manager and will... 
    Worldwide

    Marine

    Winnipeg, MB
    41 minutes ago
  •  ...motivated professional to join its Burlington Operations as a Test Engineer. senior Test Engineering role with familiarity on multiple test...  ....Onsemi is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race... 
    Local area

    onsemi

    Winnipeg, MB
    36 minutes ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Llm Application Test Engineer. Be the first to apply!