Senior Software Engineer, Ai
Klue
Klue Engineering is hiring!We're looking for a
Senior Machine Learning Engineer
to join our team in Toronto, focusing on building and optimizing state-of-the-art LLM-powered agents that can reason, plan and automate workflows for users. You will be leading the design and development of search and retrieval agent systems that enable users to generate competitive insights for their business. In this role, you will own projects end-to-end, guiding architecture decisions, experimentation strategy, and production readiness for LLM-powered retrieval and generation workflows.
FAQQ: Klue who?A: Klue is a VC-backed, capital-efficient growing SaaS company. Tiger Global and Salesforce Ventures led our US$62m Series B in the fall of 2021. We’re creating the category of competitive enablement: helping companies understand their market and outmaneuver their competition. We benefit from having an experienced leadership team working alongside several hundred risk-taking builders who elevate every day.
We’re one of Canada’s Most Admired Corporate Cultures by Waterstone HC, a Deloitte Technology Fast 50 & Fast 500 winner, and recipient of both the Startup of the Year and Tech Culture of the Year awards at the Technology Impact Awards.
Q: What are the responsibilities, and how will I spend my time?A: You will shape how we integrate
retrieval-augmented generation (RAG), dense retrieval, query understanding, and agentic reasoning loops
to deliver fast, accurate, and trusted search experiences at scale.
What you’ll do on a Day to day basis:
Architect, design, and implement
retrieval pipelines and agentic workflows, including hybrid retrieval, re-ranking, and post-retrieval synthesis.
Lead the development of
evaluation frameworks
(offline and human-in-the-loop) to measure and improve relevance, quality, and latency.
Drive experimentation with
query rewriting, expansion, and classification
to enhance retrieval effectiveness.
Optimize
LLM workflows
by designing prompt structures, retrieval strategies, and caching for low-latency, high-accuracy responses.
Collaborate cross-functionally with product and infrastructure teams to align technical direction with product goals.
Mentor and provide technical guidance to team members, establishing best practices for building production-ready ML systems.
Own data strategy for retrieval and design pipelines to automatically extract insights about competitors from both public and internal data sources.
Evaluate and integrate advancements in
LLMs, retrieval architectures, and agentic reasoning
into our production systems.
Q: What experience are we looking for?
5+ years of industry experience
building and deploying ML systems, with at least 2+ years working on
search, retrieval, or ranking systems .
Expert-level programming skills in
Python, with experience using frameworks such as PyTorch, TensorFlow, or JAX.
Deep understanding of
information retrieval (BM25, dense retrieval, hybrid retrieval)
and relevance tuning.
Experience with
LLMs, retrieval-augmented generation pipelines, and prompt engineering .
Track record of designing and delivering
production-grade ML systems at scale, balancing experimentation with reliability.
Deep understanding of
data pipelines, preprocessing, and large-scale data handling .
Familiarity with
evaluation methodologies
for search systems (recall, MRR, nDCG) and user-facing evaluations.
Experience working with
vector database infrastructure
(FAISS, Milvus, Weaviate, Pinecone, PGVector) and traditional search engines (Elasticsearch, OpenSearch).
Familiarity with
scalable cloud ML infrastructure
(AWS, GCP, Azure).
Develop and implement CI/CD pipelines. Automate the deployment and monitoring of ML models.
Knowledge of
query understanding, document summarization, and other content enrichment strategies .
Ability to lead projects independently while providing technical direction to others.
Nice to Have
Experience designing
agentic LLM systems
and multi-step retrieval workflows.
Background in
conversational search .
Contributions to open-source search, retrieval, or LLM-related projects.
Interest in publishing or sharing learnings with the broader community.
Q: What makes you thrive at Klue?A: We're looking for builders who:
Take ownership and run with ambiguous problems.
Jump into new areas and rapidly learn what's needed to deliver solutions.
Bring scientific rigor while maintaining a pragmatic delivery focus.
See unclear requirements as an opportunity to shape the solution.
Q: What technologies do we use?
LLM platforms: OpenAI, Anthropic, open-source models.
ML frameworks: PyTorch, Transformers, spaCy.
Search/Vector DBs: Elasticsearch, Pinecone, PostgreSQL.
MLOps tools: Weights & Biases, MLflow, Langfuse.
Infrastructure: Docker, Kubernetes, GCP.
Development: Python, Git, CI/CD.
Q: What is your working style at Klue?
Hybrid.
Best of both worlds (remote & in-office). You and your team will be in the office 2 days a week.
Our main Canadian hubs are in Vancouver and Toronto, and most of our teams are located in EST and PST.
Q: What about Compensation & Benefits:
Competitive base salary.
Benefits.
Extended health & dental benefits that kick in Day 1.
Options.
Opportunity to participate in our Employee Stock Option Plan.
Time off.
Take what you need. Just ensure the required work gets done and clear it with your team in advance. The average Klue team member takes 2-4 weeks of PTO per year.
Direct access to our leadership team, including our CEO.
Not ticking every box? That’s okay. We take potential into consideration. An equivalent combination of education and experience may be accepted in lieu of the specifics listed above. If you know you have what it takes, even if that’s different from what we’ve described, be sure to explain why in your application.
At Klue, we're dedicated to creating an inclusive, equitable and diverse workplace as an equal‑opportunity employer. Our commitment is to build a high‑performing team where people feel a strong sense of belonging, can be their authentic selves, and are able to reach their full potential. If there’s anything we can do to make our hiring process more accessible or to better support you, please let us know—we’re happy to accommodate.
We’re excited to meet you and in the meantime, get to know us.
Klue BlogIgnition Acquisition (2025)Goldpan.Ai Acquisition (2025)Win-Loss Acquisition (2023)Series B (2021)CultureWinning as Women & More!About UsProduct Demo ArenaGlassdoorYoutubeLinkedInWellfound (AngelList)#J-18808-Ljbffr
Senior Machine Learning Engineer
to join our team in Toronto, focusing on building and optimizing state-of-the-art LLM-powered agents that can reason, plan and automate workflows for users. You will be leading the design and development of search and retrieval agent systems that enable users to generate competitive insights for their business. In this role, you will own projects end-to-end, guiding architecture decisions, experimentation strategy, and production readiness for LLM-powered retrieval and generation workflows.
FAQQ: Klue who?A: Klue is a VC-backed, capital-efficient growing SaaS company. Tiger Global and Salesforce Ventures led our US$62m Series B in the fall of 2021. We’re creating the category of competitive enablement: helping companies understand their market and outmaneuver their competition. We benefit from having an experienced leadership team working alongside several hundred risk-taking builders who elevate every day.
We’re one of Canada’s Most Admired Corporate Cultures by Waterstone HC, a Deloitte Technology Fast 50 & Fast 500 winner, and recipient of both the Startup of the Year and Tech Culture of the Year awards at the Technology Impact Awards.
Q: What are the responsibilities, and how will I spend my time?A: You will shape how we integrate
retrieval-augmented generation (RAG), dense retrieval, query understanding, and agentic reasoning loops
to deliver fast, accurate, and trusted search experiences at scale.
What you’ll do on a Day to day basis:
Architect, design, and implement
retrieval pipelines and agentic workflows, including hybrid retrieval, re-ranking, and post-retrieval synthesis.
Lead the development of
evaluation frameworks
(offline and human-in-the-loop) to measure and improve relevance, quality, and latency.
Drive experimentation with
query rewriting, expansion, and classification
to enhance retrieval effectiveness.
Optimize
LLM workflows
by designing prompt structures, retrieval strategies, and caching for low-latency, high-accuracy responses.
Collaborate cross-functionally with product and infrastructure teams to align technical direction with product goals.
Mentor and provide technical guidance to team members, establishing best practices for building production-ready ML systems.
Own data strategy for retrieval and design pipelines to automatically extract insights about competitors from both public and internal data sources.
Evaluate and integrate advancements in
LLMs, retrieval architectures, and agentic reasoning
into our production systems.
Q: What experience are we looking for?
5+ years of industry experience
building and deploying ML systems, with at least 2+ years working on
search, retrieval, or ranking systems .
Expert-level programming skills in
Python, with experience using frameworks such as PyTorch, TensorFlow, or JAX.
Deep understanding of
information retrieval (BM25, dense retrieval, hybrid retrieval)
and relevance tuning.
Experience with
LLMs, retrieval-augmented generation pipelines, and prompt engineering .
Track record of designing and delivering
production-grade ML systems at scale, balancing experimentation with reliability.
Deep understanding of
data pipelines, preprocessing, and large-scale data handling .
Familiarity with
evaluation methodologies
for search systems (recall, MRR, nDCG) and user-facing evaluations.
Experience working with
vector database infrastructure
(FAISS, Milvus, Weaviate, Pinecone, PGVector) and traditional search engines (Elasticsearch, OpenSearch).
Familiarity with
scalable cloud ML infrastructure
(AWS, GCP, Azure).
Develop and implement CI/CD pipelines. Automate the deployment and monitoring of ML models.
Knowledge of
query understanding, document summarization, and other content enrichment strategies .
Ability to lead projects independently while providing technical direction to others.
Nice to Have
Experience designing
agentic LLM systems
and multi-step retrieval workflows.
Background in
conversational search .
Contributions to open-source search, retrieval, or LLM-related projects.
Interest in publishing or sharing learnings with the broader community.
Q: What makes you thrive at Klue?A: We're looking for builders who:
Take ownership and run with ambiguous problems.
Jump into new areas and rapidly learn what's needed to deliver solutions.
Bring scientific rigor while maintaining a pragmatic delivery focus.
See unclear requirements as an opportunity to shape the solution.
Q: What technologies do we use?
LLM platforms: OpenAI, Anthropic, open-source models.
ML frameworks: PyTorch, Transformers, spaCy.
Search/Vector DBs: Elasticsearch, Pinecone, PostgreSQL.
MLOps tools: Weights & Biases, MLflow, Langfuse.
Infrastructure: Docker, Kubernetes, GCP.
Development: Python, Git, CI/CD.
Q: What is your working style at Klue?
Hybrid.
Best of both worlds (remote & in-office). You and your team will be in the office 2 days a week.
Our main Canadian hubs are in Vancouver and Toronto, and most of our teams are located in EST and PST.
Q: What about Compensation & Benefits:
Competitive base salary.
Benefits.
Extended health & dental benefits that kick in Day 1.
Options.
Opportunity to participate in our Employee Stock Option Plan.
Time off.
Take what you need. Just ensure the required work gets done and clear it with your team in advance. The average Klue team member takes 2-4 weeks of PTO per year.
Direct access to our leadership team, including our CEO.
Not ticking every box? That’s okay. We take potential into consideration. An equivalent combination of education and experience may be accepted in lieu of the specifics listed above. If you know you have what it takes, even if that’s different from what we’ve described, be sure to explain why in your application.
At Klue, we're dedicated to creating an inclusive, equitable and diverse workplace as an equal‑opportunity employer. Our commitment is to build a high‑performing team where people feel a strong sense of belonging, can be their authentic selves, and are able to reach their full potential. If there’s anything we can do to make our hiring process more accessible or to better support you, please let us know—we’re happy to accommodate.
We’re excited to meet you and in the meantime, get to know us.
Klue BlogIgnition Acquisition (2025)Goldpan.Ai Acquisition (2025)Win-Loss Acquisition (2023)Series B (2021)CultureWinning as Women & More!About UsProduct Demo ArenaGlassdoorYoutubeLinkedInWellfound (AngelList)#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Ai in Winnipeg, MB vacancy
- ...Job Description Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US healthcare... ...telemetry, and evaluation platforms. ~ Strong knowledge of software engineering best practices, testing, debugging, and performance...SeniorFull timeInternshipRemote workRelocation
- ...Drive AI innovation as a Senior AI Engineer in Mississauga, Canada. Craft Python-based AI applications using FastAPI or Flask while optimizing performance... ...an experienced Senior AI Engineer with over 8 years in software development. You will design and deploy AI and LLM applications...Senior
- ...position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Software Engineer - AI based in Canada. The Senior Software Engineer will join a small AI Platform team responsible for building production-...SeniorLong term contractRemote work
$176k - $200k per year
We’re looking for a Senior Software Engineer to join our growing AI organization in Vancouver. Asana is pioneering a new category of technology as the human-agent operating system, doubling down on our AI Suite to move our customers toward expansive, end-to-end intelligent...SeniorLong term contractWork at officeLocal areaWork from homeWorldwide$150k - $200k per year
...Stikeman Elliott is building its own agentic AI platform, with production agents working... ...and continues to expand. This is the senior engineering role responsible for advancing its... ...role that spans application architecture, software development and production delivery. You...Senior- ...of talent at your fingertips. With our AI-powered Global Work Platform™,... ...- we're rethinking what it means for software to work with you, not just for you. Our... ...AI assistant, and we're looking for a Senior Full-Stack AI Engineer who wants to help define what AI-native...SeniorContract workLocal area
- ...a fast-growing, venture-backed B2B SaaS company building an AI-powered competitive intelligence platform that helps revenue... ...office in downtown Toronto.About the role: We're hiring a Senior Software Engineer to build and optimize state-of-the- LLM-powered agents that can...SeniorWork at office
$145k - $183k per year
Job DescriptionToast is recruiting on behalf of this company for a Senior Software Engineer, AI to join their Engineering team in Toronto. They are looking for an experienced backend engineer who is excited to build and optimize LLM-powered systems that help users uncover meaningful...SeniorFull timeManual laborWork at officeFlexible hours- ...intersection of our people, our customers, and our brands. Senior Applied AI EngineerWho We Are.Newfold Digital is a leading web... ...mark.We are looking for a hand on Senior Applied AI Engineer who combines strong software engineering with practical AI problem solving. You...Senior
- ...leadership. Fleetworthy is shaping the future of fleet readiness with AI-enabled, connected fleet technology that keeps drivers safe,... ...Learn more at fleetworthy.Com .About the role:We're hiring a Senior Software Engineer for the AI Platform team. The team builds AI agents and...SeniorLong term contract
- ...Build AI Inference Networking software at Equinix using SDN, proxying, and open-source engineering expertise. Work within a globally distributed development team. As a Senior SDN Network Software Engineer, you will help develop open-source software for Equinix’s AI Inference...Senior
- Build production AI features as a Senior AI Software Engineer at Safe Fleet, using LLMs, machine learning, and backend APIs. Help make fleet vehicles safer through scalable technology.This hands-on senior engineering role delivers AI-powered capabilities across Safe Fleet’s...Senior
- Lead the way in AI innovation as a Senior Software Engineer at Newfold Digital. Your role will revolve around developing impactful AI solutions that significantly enhance our customers' digital presence. In this hands-on position, you will directly influence production AI...Senior
$100k - $145k per year
Senior Software Engineer - AI (Materia AI)Are you excited about building AI-driven software that redefines how professionals work? Join a dynamic and highly skilled team at Thomson Reuters, where we combine the agility and innovation of a startup with the stability and resources...SeniorWork at officeLocal areaFlexible hours2 days per week3 days per week- Build backend services and AI-powered workflows at Samsara, working flexibly from the United States or Canada on Connected Operations software.As a senior software engineer, you will create agentic solutions for custom detections and workflows. You will work across APIs, backend...Senior
- AI-native software engineering in Canada calls for Java and mobile expertise. Build features across backend services, APIs, and native applications.This Senior Software Engineer, Verticals role supports a product-focused engineering team. You will create technology helping...Senior
$120k - $145k per year
...Veralto company, is a mission-driven software company that organizes the world’s... ...growth.Reporting to the Director of Engineering & Predictive Analytics, the Senior Software Engineer will contribute to... ...predictive analytics products that leverage AI and ML.This position is part of the...SeniorWork at officeRemote workFlexible hoursShift work- 7shifts is seeking a Senior Software Developer to join the Growth squad. You’ll help ship experiments... ...decisions across product, design, and engineering. You’ll report to an Engineering Manager... ...PMs and Analysts to iterate on product using AI thoughtfully to #J-18808-LjbffrSenior
- Build AI systems as a Senior Software Engineer in Asana’s Vancouver office, using distributed systems expertise and technical leadership. Work follows an office-centric hybrid schedule.Asana is expanding AI engineering teams across its human-agent operating system and AI Suite...SeniorWork at office
- Engineer low-latency conversational AI with LLM orchestration, streaming audio, and autonomous workflows from a 100% on-site Montreal setting.As a Senior AI Engineer, you will build and refine voice-driven products across the entire stack. Your focus includes ambient AI scribes...Senior
- Build Operational AI software at Samsara using backend services, APIs, and customer-facing experiences while working remotely or in offices where aligned.As a senior engineer, you will create agentic solutions for custom detections and workflows. You will own software from customer...SeniorRemote work
- ...Senior Back End Software Engineer Canada, United Kingdom, United States 1 gün 9 saat 9 dakika önce yayınlandı. Full Time Himalayas - Our software engineers at Epistemix show a clear passion for quality and love to bring software to life. You are energized by the idea of...SeniorFull time
$120k - $140k per year
...as we build smarter technologies that redefine fleet safety. When you help make fleets smarter, you make people safer. Senior Software Engineer, AI Product EngineeringAbout The PositionABOUT THE POSITION Meet the Smart Safety Company AtSafe Fleetour name says it all...SeniorWork at officeLocal area$100k - $145k per year
Senior Software Engineer – AI (Materia AI) We're building the next generation of AI‑powered platforms for tax and accounting professionals, and we’re looking for a Senior Software Engineer who can architect high‑performance backend systems that bring real‑world AI capabilities...SeniorWork at officeLocal areaFlexible hours- Build production AI agents with Python or TypeScript on Fleetworthy’s AI Platform team... ...safety, compliance, and operations.As a senior engineer, you will ship AI products for customers... ...expertise.Key Responsibilities: Ship software frequently from specification through production...Senior
- Join Cerebras Systems as a Senior Software Engineer specializing in AI fleet platform development. This role focuses on managing AI clusters and enhancing operational efficiency across platforms. As a senior engineer at Cerebras, you'll drive innovation in fleet management...Senior
- Direct AI coding agents to build full-stack applications at Remitly, working onsite Tuesday through Thursday under the company’s hybrid expectations.As a Senior AI Native Software Engineer, you solve customer problems by orchestrating AI agents instead of writing code directly...Senior
$152k - $190k per year
...united by our vision to transform lives with trusted financial services that transcend borders.About the Role: As a Senior AI Native Software Engineer, you direct AI agents to build products and solutions, rather than writing code directly. You leverage AI coding agents...SeniorWork at officeWorldwide- Build financial technology in a hybrid Mississauga role using enterprise Java, AI, and real-time Kafka data streaming. Design resilient applications for Front Office Technology.As a Software Engineer, you will partner with front-office business teams to deliver enterprise-...Senior
- Build production AI agents and platform systems as a Senior Software Engineer on Fleetworthy’s AI Platform team. Work across fleet readiness technology.This senior engineer role focuses on shipping reliable software for Fleetworthy’s safety, compliance, toll management, and...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, Ai. Be the first to apply!
Related searches
- software developer internship no experience Winnipeg, MB
- software engineer intern Winnipeg, MB
- software developer Winnipeg, MB
- software developer remote Winnipeg, MB
- software engineer - ai machine learning Winnipeg, MB
- part time software developer Winnipeg, MB
- junior software engineer Winnipeg, MB
- software engineer part time Winnipeg, MB
- software developer intern Winnipeg, MB
- senior software developer Winnipeg, MB

