Quality Engineering Strategist Llm Systems
Blue J
Shape quality for Blue J’s AI-powered tax products through systems thinking, exploratory testing, and production-code debugging. Work remotely near Toronto with quarterly office visits.As a QA Strategist, you will influence quality from specification through production across Blue J’s Content Pillar team. You will work with Engineering, Product, and Customer teams on LLM-backed systems, data pipelines, and retrieval workflows. Your focus includes user-centered discovery, test strategy, observability, and actionable production insights.Key Responsibilities:
Surface unknowns, clarify requirements, and identify overlooked use casesDevise test scenarios aligned with real-world user problemsLead exploratory and regression testing for feature releasesInvestigate bugs, feedback, root causes, and potential solutionsExpand LLM evaluation tools using production system metricsRequirements:
Five-plus years in a quality-focused roleAbility to read and debug production codeExperience writing maintainable tools for QA automationAbility to query millions of SQL rows for anomaliesStrong communication and user-first product thinkingBring technical QA strategy, LLM evaluation, data analysis, and product judgment to Blue J’s Toronto-based remote team.
#J-18808-Ljbffr
Surface unknowns, clarify requirements, and identify overlooked use casesDevise test scenarios aligned with real-world user problemsLead exploratory and regression testing for feature releasesInvestigate bugs, feedback, root causes, and potential solutionsExpand LLM evaluation tools using production system metricsRequirements:
Five-plus years in a quality-focused roleAbility to read and debug production codeExperience writing maintainable tools for QA automationAbility to query millions of SQL rows for anomaliesStrong communication and user-first product thinkingBring technical QA strategy, LLM evaluation, data analysis, and product judgment to Blue J’s Toronto-based remote team.
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Quality Engineering Strategist Llm Systems in Winnipeg, MB vacancy
- Engineer production LLM systems for ClickStack with agent design, evaluation, and SQL expertise. Work on observability tools used to understand real telemetry.ClickHouse is hiring an AI Product Engineer to develop agents on ClickStack, its open-source observability platform...Suggested
- Design RAG systems and LLM features for Wiser Solutions remotely, using embeddings and retrieval... ...customer problems.This Senior Machine Learning Engineer builds AI applications that reach... ...embeddings, retrieval, and LLMs, guided by quality and cost. Your work includes evaluation,...SuggestedRemote work
- Lead LLM systems at Axya, working hands-on with Python, retrieval, agent workflows, and evaluation in a 100% remote environment.As Lead AI Engineer, you will own Axya’s AI architecture and technical direction. You will report to the CTO while partnering with Product, Customer...SuggestedRemote work
- ...to delivering innovative, high-quality solutions that drive business... ...is looking for a hands-on AI Engineer to design, develop, deploy, and... ...machine learning models, retrieval systems, and agentic workflows.... ...meaningful hands-on production LLM development.Strong Python programming...Suggested
- ZS is seeking an LLM Engineer to design and build scalable software systems leveraging Python, LLM patterns, and cloud platforms. You will translate business requirements... ...technical solutions, own the execution, and ensure quality across the full SDLC. You will work with AWS, Azure,...Suggested
$127k - $225k per year
...permanent opening for a Senior Engineer. About the team: The... ...About the job: As a Senior System Engineer, you will drive core... ...pipelines using MindSpeed (MindSpeed-LLM / MindSpeed-MM) alongside... ...hierarchy/UB, memory movement engines, and HCCL collective communication...Long term contractPermanent employmentInternshipLocal areaImmediate start- Get notified about new Director Of Software Engineering jobs in United States . 7,000+ Director Of Software Engineering Jobs in United States Director, Software Engineering, Product Eng Director of Software Engineering – Marketplace Director, Software Engineering...Work at officeRemote work
- Shape software quality at Blue J through exploratory testing, systems thinking, and technical tools while working remotely near... ...code reaches production.As a QA Strategist, you will influence discovery, clarify requirements, and test LLM-backed systems across Blue J’s Content...Remote work
- ...about SKF at. Position Overview We are seeking a skilled Quality Electrical Engineer to support customer and manufacturing quality for electrical... ...customer-reported failures and determine root causes at the system, assembly, circuit, or component level, as applicable....Permanent employment
- ...We are seeking a highly experienced and hands-on Supplier Quality Engineer (SQE) with strong expertise in casting and machining processes, particularly... ...of manufacturing processes and quality management systems Proven experience in supplier quality management and structured...
- Build North Vector Dynamics’ quality management system and production controls for CM70, combining AS9100 expertise with manufacturing engineering.As a Manufacturing Quality Systems Engineer, you will establish documented, audit-ready processes for a defence technology company...Contract work
$79.4k - $142.9k per year
...trusted partner for the world's top brands, offering comprehensive engineering, supply chain, and manufacturing solutions. With 60 years of... ...Electronic assemblies.How will you make an impact? The Quality Systems Engineer will act as a guardian of Quality, shaping a Quality...Temporary workLocal areaWorldwide- ...passion to drive life-changing impact to ZS.LLM Engineer We are seeking a highly skilled LLM... ...ensuring the performance and reliability of our systems.What You’ll Do: Take ownership of... ...technical execution, ensuring code quality, adherence to deadlines, and efficient resource...Work at officeLocal areaWork from homeWorldwideFlexible hours
- ...Morningstar is seeking a Senior Software Engineer to build applied systems for AI capabilities in production, including data pipelines, LLM integrations, agentic workflows, and evaluation frameworks. This role focuses on applied engineering, delivering durable architectures...Work at office
$90k - $120k per year
Job Title: Quality Process Engineering Automation SystemsLocation: Cambridge, ON | On-siteJob Type: Full-timeCompensation: $90,000-$120... ...to create smart, efficient, and sustainable manufacturing systems. Our global network includes facilities in Canada, the United...InternshipWork at office- Test cloud-connected systems, network integrations, and distributed services as Infoblox’s Software QA Engineer II in Burnaby, British Columbia. Bring strong automation expertise.... ...Marketing, and cross-functional teams. Its quality focus covers service-oriented systems, performance...
$114.4k - $164.4k per year
Company:Qualcomm Canada ULC Job Area:Engineering Group, Engineering Group Machine Learning Engineering General Summary:As a leading... ...'s degree in Computer Science, Engineering, Information Systems, or related field and 4+ years of Hardware Engineering, Software...Immediate startWork from home- ...Python Developer to design and build scalable backend systems and AI-powered solutions. You will own backend... ...product and architecture teams to deliver production-quality software. The role emphasizes hands-on engineering, system design, and mentoring teammates while working...Remote work
$195k - $285k per year
...helping teams design and build AI/ML systems and pipelines that consistently... ...solutions to be extensible and production quality. You are an expert in selected... ...that leverage our AI and engineering capabilitiesBuilding and deploying LLM-based agent systems in productionKeeping...Work at officeLocal areaRemote workFlexible hours3 days per week1 day per week- ...StackAdapt is hiring a Staff Quality Engineer to lead the quality strategy for AI/agentic systems. You will design evaluation frameworks for non-deterministic AI, build scalable automated test suites, and set quality benchmarks across CI/CD pipelines. You’ll mentor QE teams...Remote work
- Position Summary The Senior Quality Management System (QMS) Quality Engineer is a technical leader responsible for maintaining, improving, and ensuring the effectiveness of the Company's Quality Management System (QMS) and electronic Quality Management System (eQMS). This...
- ...doors to new opportunities and growth. THE POSITION The Quality Engineer leads the development, implementation, and continuous... ...with ISO 9001, IATF 16949, and other relevant quality management systems. Lead failure analysis, process validation, and continuous...Full timeRemote work
- Test LLM-powered applications at TribalScale using automation, API... ...be confirmed.As an Agentic QA Engineer, you will assess applications... ...agent tool usage, external systems, integrations, and production... ...tool-use failuresApply automated quality checks to development pipelinesImprove...
- ...development and certification of safety-critical systems in the aerospace, electric, and... ...development and consolidation of a corporate Quality Management System (QMS) and Quality... ...Facilitate workshops across Manufacturing, Engineering, Sourcing and IT to clarify processes, responsibilities...Permanent employmentFull timeFlexible hours
$85.17k - $93k per year
...viewpoint matter. And by harnessing Danaher’s system of continuous improvement, you help turn... ...which makes everything possible. The Quality Systems Specialist supports the maintenance... ...Include Bachelor’s degree in science, engineering, quality assurance, or a related field,...$85k per year
...publishing on our platform, is handled with quality, consistency, and care. We also help keep... ....As Senior Training & Quality Assurance Strategist, you'll build the training and quality... ...and bringing people along. You think in systems: you don't just fix the immediate error,...Long term contractFor contractorsLocal areaImmediate startRemote workHome officeFlexible hours- ...Rellia Health in Canada offers regulatory and quality consulting for early‑stage SaMD and medical device startups. This is virtual, project... ...guide clients on regulatory compliance and quality management systems, develop QMS, conduct mock audits, analyze requirements, and...Hourly payFor contractorsInternshipRemote work
- ...The mission we are proposing:Reporting to the Operations Quality Manager, the Quality Systems Supervisor (QS) is responsible for maintaining and... ...ideal candidate if you haveBachelor’s degree in Science, Engineering, or a related field.5 to 7 years of experience in a similar...Long term contractContract work
- ...people, ideas, and possibilities.The Opportunity The Manager, Quality Systems is responsible for the ongoing development, maintenance, and... ...methodology.What You Bring Bachelor’s degree in science, Engineering, or related discipline is required.5+ years of QA experience...For contractorsWork at office
- ...companies where the team has become the glue between disconnected systems, manual processes, and spreadsheets that everyone is eager to... ...certainly this could be 5 steps, right?" As a Business Systems Strategist, you'll figure out how a client's business actually operates,...Remote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Quality Engineering Strategist Llm Systems. Be the first to apply!
Related searches
- quality engineer manufacturing Winnipeg, MB
- entry level quality engineer Winnipeg, MB
- quality engineer- qms Winnipeg, MB
- technicien qualité Winnipeg, MB
- ingénieur qualité Winnipeg, MB
- quality engineer Winnipeg, MB
- strategy consultant Winnipeg, MB
- communications strategist Winnipeg, MB
- system development engineer Winnipeg, MB
- computer system validation engineer Winnipeg, MB

