Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Quality Engineering Strategist Llm Systems

Blue J

Shape quality for Blue J’s AI-powered tax products through systems thinking, exploratory testing, and production-code debugging. Work remotely near Toronto with quarterly office visits.As a QA Strategist, you will influence quality from specification through production across Blue J’s Content Pillar team. You will work with Engineering, Product, and Customer teams on LLM-backed systems, data pipelines, and retrieval workflows. Your focus includes user-centered discovery, test strategy, observability, and actionable production insights.Key Responsibilities:
Surface unknowns, clarify requirements, and identify overlooked use casesDevise test scenarios aligned with real-world user problemsLead exploratory and regression testing for feature releasesInvestigate bugs, feedback, root causes, and potential solutionsExpand LLM evaluation tools using production system metricsRequirements:
Five-plus years in a quality-focused roleAbility to read and debug production codeExperience writing maintainable tools for QA automationAbility to query millions of SQL rows for anomaliesStrong communication and user-first product thinkingBring technical QA strategy, LLM evaluation, data analysis, and product judgment to Blue J’s Toronto-based remote team.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Quality Engineering Strategist Llm Systems in Winnipeg, MB vacancy
  • Design RAG systems and LLM features for Wiser Solutions remotely, using embeddings and retrieval...  ...customer problems.This Senior Machine Learning Engineer builds AI applications that reach...  ...embeddings, retrieval, and LLMs, guided by quality and cost. Your work includes evaluation,... 
    Suggested
    Remote work

    Wiser Solutions

    Winnipeg, MB
    1 hour ago
  • Lead LLM systems at Axya, working hands-on with Python, retrieval, agent workflows, and evaluation in a 100% remote environment.As Lead AI Engineer, you will own Axya’s AI architecture and technical direction. You will report to the CTO while partnering with Product, Customer... 
    Suggested
    Remote work

    Axya

    Winnipeg, MB
    1 hour ago
  • ZS is seeking an LLM Engineer to design and build scalable software systems leveraging Python, LLM patterns, and cloud platforms. You will translate business requirements...  ...technical solutions, own the execution, and ensure quality across the full SDLC. You will work with AWS, Azure,... 
    Suggested

    ZS

    Winnipeg, MB
    1 hour ago
  •  ...to delivering innovative, high-quality solutions that drive business...  ...is looking for a hands-on AI Engineer to design, develop, deploy, and...  ...machine learning models, retrieval systems, and agentic workflows....  ...meaningful hands-on production LLM development.Strong Python programming... 
    Suggested

    247 Labs

    Winnipeg, MB
    1 hour ago
  • Get notified about new Director Of Software Engineering jobs in United States . 7,000+ Director Of Software Engineering Jobs in United States Director, Software Engineering, Product Eng Director of Software Engineering – Marketplace Director, Software Engineering... 
    Suggested
    Work at office
    Remote work

    Talent Seed

    Winnipeg, MB
    1 hour ago
  •  ...about SKF at. Position Overview We are seeking a skilled Quality Electrical Engineer to support customer and manufacturing quality for electrical...  ...customer-reported failures and determine root causes at the system, assembly, circuit, or component level, as applicable.... 
    Permanent employment

    SKF Group

    Winnipeg, MB
    6 days ago
  • $127k - $225k per year

     ...permanent opening for a Senior Engineer. About the team: The...  ...About the job: As a Senior System Engineer, you will drive core...  ...pipelines using MindSpeed (MindSpeed-LLM / MindSpeed-MM) alongside...  ...hierarchy/UB, memory movement engines, and HCCL collective communication... 
    Long term contract
    Permanent employment
    Internship
    Local area
    Immediate start

    Huawei Technologies Co.

    Winnipeg, MB
    1 hour ago
  •  ...We are seeking a highly experienced and hands-on Supplier Quality Engineer (SQE) with strong expertise in casting and machining processes, particularly...  ...of manufacturing processes and quality management systems Proven experience in supplier quality management and structured... 

    Global Connect Technologies

    Winnipeg, MB
    6 days ago
  • $79.4k - $142.9k per year

     ...trusted partner for the world's top brands, offering comprehensive engineering, supply chain, and manufacturing solutions. With 60 years of...  ...Electronic assemblies.How will you make an impact? The Quality Systems Engineer will act as a guardian of Quality, shaping a Quality... 
    Temporary work
    Local area
    Worldwide

    Jabil Inc.

    Winnipeg, MB
    1 hour ago
  • Shape software quality at Blue J through exploratory testing, systems thinking, and technical tools while working remotely near...  ...code reaches production.As a QA Strategist, you will influence discovery, clarify requirements, and test LLM-backed systems across Blue J’s Content... 
    Remote work

    Blue J Legal

    Winnipeg, MB
    1 hour ago
  •  ...passion to drive life-changing impact to ZS.LLM Engineer We are seeking a highly skilled LLM...  ...ensuring the performance and reliability of our systems.What You’ll Do: Take ownership of...  ...technical execution, ensuring code quality, adherence to deadlines, and efficient resource... 
    Work at office
    Local area
    Work from home
    Worldwide
    Flexible hours

    ZS

    Winnipeg, MB
    1 hour ago
  • Quality systems engineering at Woodbridge combines FMEA, control plans, audits, and continuous improvement within the Moulded Foam business unit. Use technical judgment daily.As a mid-career Quality Engineer, you will develop, implement, and maintain effective Quality Assurance... 

    Woodbridge-3

    Winnipeg, MB
    1 hour ago
  • Senior Systems Integration Quality Engineer in Toronto, testing APIs, applications, MFT platforms, and job schedulers across enterprise systems.At RBC, this senior position creates functional and API testing strategies for interconnected financial services systems. You will... 

    RBC

    Winnipeg, MB
    1 hour ago
  • Build a scalable quality system onsite in Prince George, Virginia, using ISO 9001:2015 expertise and startup manufacturing experience. Shape...  ...equipment production.Jabil seeks a Senior Quality Systems Engineer for a new factory startup supporting large form-factor equipment... 

    Jabil Inc.

    Winnipeg, MB
    1 hour ago
  • $90k - $120k per year

    Job Title: Quality Process Engineering Automation SystemsLocation: Cambridge, ON | On-siteJob Type: Full-timeCompensation: $90,000-$120...  ...to create smart, efficient, and sustainable manufacturing systems. Our global network includes facilities in Canada, the United... 
    Internship
    Work at office

    Eclipse Automation

    Winnipeg, MB
    1 hour ago
  • $195k - $285k per year

     ...helping teams design and build AI/ML systems and pipelines that consistently...  ...solutions to be extensible and production quality. You are an expert in selected...  ...that leverage our AI and engineering capabilitiesBuilding and deploying LLM-based agent systems in productionKeeping... 
    Work at office
    Local area
    Remote work
    Flexible hours
    3 days per week
    1 day per week

    Oliver Wyman

    Winnipeg, MB
    1 hour ago
  • Position Summary The Senior Quality Management System (QMS) Quality Engineer is a technical leader responsible for maintaining, improving, and ensuring the effectiveness of the Company's Quality Management System (QMS) and electronic Quality Management System (eQMS). This... 

    VitalBio

    Winnipeg, MB
    1 hour ago
  • About the Role Our client is seeking a highly skilled Senior Industrial Engineer with a strong focus on Quality Systems and Improvement for their facility in Kimberley, Northern Cape. This role is crucial for developing, implementing, and maintaining robust quality management... 
    Remote work

    Placements24

    Winnipeg, MB
    1 hour ago
  • $89.91k - $113.73k per year

    The Engineering Service Business Unit focuses on power system software development, power system and substation consulting studies and compliance testing services...  ...status with EGBC, years of experience, relevancy and quality of experience, as well as their core competencies.... 
    Full time
    Immediate start
    Remote work

    Powertech Labs

    Winnipeg, MB
    4 days ago
  •  ...service, innovation and a commitment to people. Our dependable quality, reliable delivery, and knowledgeable follow-up service have...  ...Price Café offers free Tea and Coffee. Finishing Systems Engineering Assistant (8 Month Term – Winter 2027) The successful candidate... 
    For contractors

    Price Industries Limited

    Winnipeg, MB
    6 days ago
  •  ...doors to new opportunities and growth.  THE POSITION   The  Quality Engineer  leads the development, implementation, and continuous...  ...with ISO 9001, IATF 16949, and other relevant quality management systems.  Lead failure analysis, process validation, and continuous... 
    Full time
    Remote work

    Smartrend Manufacturing Group

    Winnipeg, MB
    15 days ago
  •  ...StackAdapt is hiring a Staff Quality Engineer to lead the quality strategy for AI/agentic systems. You will design evaluation frameworks for non-deterministic AI, build scalable automated test suites, and set quality benchmarks across CI/CD pipelines. You’ll mentor QE teams... 
    Remote work

    Devconnectplatform

    Winnipeg, MB
    1 hour ago
  • Turn LLM capabilities into customer-facing Vanta products through prompting, RAG, agent frameworks, and thoughtful full-stack engineering.Vanta is seeking a Senior Applied AI Engineer to build AI-enabled...  ...usage and improve AI quality continuouslyBalance business priorities... 

    Vanta

    Winnipeg, MB
    1 hour ago
  • About the RoleWe are seeking a versatile and experienced engineer to join our Inference Core Model Bringup team. This team is responsible...  ...etc.) or customer‑provided proprietary models on our Cerebras CSX systems. Success in this role requires a system‑minded generalist who... 

    Cerebras

    Winnipeg, MB
    1 hour ago
  • Python and LLM engineering define this remote Senior AI/LLM Engineer position with Kake, building production-ready applications and systems at scale.Kake seeks senior engineers who design, build, and productionize AI systems. You will work across Python, FastAPI, LAG pipelines... 
    Remote work

    Kake

    Winnipeg, MB
    1 hour ago
  • Build advanced language systems as a Senior AI Engineer in Kimberley, applying NLP and LLM expertise within a hybrid work model. Develop scalable solutions that understand, generate, and process human language at scale.This senior position focuses on developing and deploying... 

    Placements24

    Winnipeg, MB
    1 hour ago
  •  ...development and certification of safety-critical systems in the aerospace, electric, and...  ...development and consolidation of a corporate Quality Management System (QMS) and Quality...  ...Facilitate workshops across Manufacturing, Engineering, Sourcing and IT to clarify processes, responsibilities... 
    Permanent employment
    Full time
    Flexible hours

    CS GROUP - Canada

    Winnipeg, MB
    1 hour ago
  • $85.17k - $93k per year

     ...viewpoint matter. And by harnessing Danaher’s system of continuous improvement, you help turn...  ...which makes everything possible. The Quality Systems Specialist supports the maintenance...  ...Include Bachelor’s degree in science, engineering, quality assurance, or a related field,... 

    SCIEX

    Winnipeg, MB
    1 hour ago
  •  ...The mission we are proposing:Reporting to the Operations Quality Manager, the Quality Systems Supervisor (QS) is responsible for maintaining and...  ...ideal candidate if you haveBachelor’s degree in Science, Engineering, or a related field.5 to 7 years of experience in a similar... 
    Long term contract
    Contract work

    kdc/one, Knowlton

    Winnipeg, MB
    1 hour ago
  • $218.89k - $245.95k per year

     ...conversations so they can debug them. We're bringing LLM and agent observability together, and we...  ...in a small, cross-functional group of engineers with a dedicated product manager and...  ...define how people understand and debug AI systems, this is the team for you.What you’ll do in... 
    Internship
    Work at office
    Local area
    Work from home
    Home office
    Visa sponsorship
    Shift work

    Candidate

    Winnipeg, MB
    1 hour ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Quality Engineering Strategist Llm Systems. Be the first to apply!