Senior Software Engineer, Ai
Klue
Klue Engineering is hiring!We're looking for a
Senior Machine Learning Engineer
to join our team in Toronto, focusing on building and optimizing state-of-the-art LLM-powered agents that can reason, plan and automate workflows for users. You will be leading the design and development of search and retrieval agent systems that enable users to generate competitive insights for their business. In this role, you will own projects end-to-end, guiding architecture decisions, experimentation strategy, and production readiness for LLM-powered retrieval and generation workflows.
FAQQ: Klue who?A: Klue is a VC-backed, capital-efficient growing SaaS company. Tiger Global and Salesforce Ventures led our US$62m Series B in the fall of 2021. We’re creating the category of competitive enablement: helping companies understand their market and outmaneuver their competition. We benefit from having an experienced leadership team working alongside several hundred risk-taking builders who elevate every day.
We’re one of Canada’s Most Admired Corporate Cultures by Waterstone HC, a Deloitte Technology Fast 50 & Fast 500 winner, and recipient of both the Startup of the Year and Tech Culture of the Year awards at the Technology Impact Awards.
Q: What are the responsibilities, and how will I spend my time?A: You will shape how we integrate
retrieval-augmented generation (RAG), dense retrieval, query understanding, and agentic reasoning loops
to deliver fast, accurate, and trusted search experiences at scale.
What you’ll do on a Day to day basis:
Architect, design, and implement
retrieval pipelines and agentic workflows, including hybrid retrieval, re-ranking, and post-retrieval synthesis.
Lead the development of
evaluation frameworks
(offline and human-in-the-loop) to measure and improve relevance, quality, and latency.
Drive experimentation with
query rewriting, expansion, and classification
to enhance retrieval effectiveness.
Optimize
LLM workflows
by designing prompt structures, retrieval strategies, and caching for low-latency, high-accuracy responses.
Collaborate cross-functionally with product and infrastructure teams to align technical direction with product goals.
Mentor and provide technical guidance to team members, establishing best practices for building production-ready ML systems.
Own data strategy for retrieval and design pipelines to automatically extract insights about competitors from both public and internal data sources.
Evaluate and integrate advancements in
LLMs, retrieval architectures, and agentic reasoning
into our production systems.
Q: What experience are we looking for?
5+ years of industry experience
building and deploying ML systems, with at least 2+ years working on
search, retrieval, or ranking systems .
Expert-level programming skills in
Python, with experience using frameworks such as PyTorch, TensorFlow, or JAX.
Deep understanding of
information retrieval (BM25, dense retrieval, hybrid retrieval)
and relevance tuning.
Experience with
LLMs, retrieval-augmented generation pipelines, and prompt engineering .
Track record of designing and delivering
production-grade ML systems at scale, balancing experimentation with reliability.
Deep understanding of
data pipelines, preprocessing, and large-scale data handling .
Familiarity with
evaluation methodologies
for search systems (recall, MRR, nDCG) and user-facing evaluations.
Experience working with
vector database infrastructure
(FAISS, Milvus, Weaviate, Pinecone, PGVector) and traditional search engines (Elasticsearch, OpenSearch).
Familiarity with
scalable cloud ML infrastructure
(AWS, GCP, Azure).
Develop and implement CI/CD pipelines. Automate the deployment and monitoring of ML models.
Knowledge of
query understanding, document summarization, and other content enrichment strategies .
Ability to lead projects independently while providing technical direction to others.
Nice to Have
Experience designing
agentic LLM systems
and multi-step retrieval workflows.
Background in
conversational search .
Contributions to open-source search, retrieval, or LLM-related projects.
Interest in publishing or sharing learnings with the broader community.
Q: What makes you thrive at Klue?A: We're looking for builders who:
Take ownership and run with ambiguous problems.
Jump into new areas and rapidly learn what's needed to deliver solutions.
Bring scientific rigor while maintaining a pragmatic delivery focus.
See unclear requirements as an opportunity to shape the solution.
Q: What technologies do we use?
LLM platforms: OpenAI, Anthropic, open-source models.
ML frameworks: PyTorch, Transformers, spaCy.
Search/Vector DBs: Elasticsearch, Pinecone, PostgreSQL.
MLOps tools: Weights & Biases, MLflow, Langfuse.
Infrastructure: Docker, Kubernetes, GCP.
Development: Python, Git, CI/CD.
Q: What is your working style at Klue?
Hybrid.
Best of both worlds (remote & in-office). You and your team will be in the office 2 days a week.
Our main Canadian hubs are in Vancouver and Toronto, and most of our teams are located in EST and PST.
Q: What about Compensation & Benefits:
Competitive base salary.
Benefits.
Extended health & dental benefits that kick in Day 1.
Options.
Opportunity to participate in our Employee Stock Option Plan.
Time off.
Take what you need. Just ensure the required work gets done and clear it with your team in advance. The average Klue team member takes 2-4 weeks of PTO per year.
Direct access to our leadership team, including our CEO.
Not ticking every box? That’s okay. We take potential into consideration. An equivalent combination of education and experience may be accepted in lieu of the specifics listed above. If you know you have what it takes, even if that’s different from what we’ve described, be sure to explain why in your application.
At Klue, we're dedicated to creating an inclusive, equitable and diverse workplace as an equal‑opportunity employer. Our commitment is to build a high‑performing team where people feel a strong sense of belonging, can be their authentic selves, and are able to reach their full potential. If there’s anything we can do to make our hiring process more accessible or to better support you, please let us know—we’re happy to accommodate.
We’re excited to meet you and in the meantime, get to know us.
Klue BlogIgnition Acquisition (2025)Goldpan.Ai Acquisition (2025)Win-Loss Acquisition (2023)Series B (2021)CultureWinning as Women & More!About UsProduct Demo ArenaGlassdoorYoutubeLinkedInWellfound (AngelList)#J-18808-Ljbffr
Senior Machine Learning Engineer
to join our team in Toronto, focusing on building and optimizing state-of-the-art LLM-powered agents that can reason, plan and automate workflows for users. You will be leading the design and development of search and retrieval agent systems that enable users to generate competitive insights for their business. In this role, you will own projects end-to-end, guiding architecture decisions, experimentation strategy, and production readiness for LLM-powered retrieval and generation workflows.
FAQQ: Klue who?A: Klue is a VC-backed, capital-efficient growing SaaS company. Tiger Global and Salesforce Ventures led our US$62m Series B in the fall of 2021. We’re creating the category of competitive enablement: helping companies understand their market and outmaneuver their competition. We benefit from having an experienced leadership team working alongside several hundred risk-taking builders who elevate every day.
We’re one of Canada’s Most Admired Corporate Cultures by Waterstone HC, a Deloitte Technology Fast 50 & Fast 500 winner, and recipient of both the Startup of the Year and Tech Culture of the Year awards at the Technology Impact Awards.
Q: What are the responsibilities, and how will I spend my time?A: You will shape how we integrate
retrieval-augmented generation (RAG), dense retrieval, query understanding, and agentic reasoning loops
to deliver fast, accurate, and trusted search experiences at scale.
What you’ll do on a Day to day basis:
Architect, design, and implement
retrieval pipelines and agentic workflows, including hybrid retrieval, re-ranking, and post-retrieval synthesis.
Lead the development of
evaluation frameworks
(offline and human-in-the-loop) to measure and improve relevance, quality, and latency.
Drive experimentation with
query rewriting, expansion, and classification
to enhance retrieval effectiveness.
Optimize
LLM workflows
by designing prompt structures, retrieval strategies, and caching for low-latency, high-accuracy responses.
Collaborate cross-functionally with product and infrastructure teams to align technical direction with product goals.
Mentor and provide technical guidance to team members, establishing best practices for building production-ready ML systems.
Own data strategy for retrieval and design pipelines to automatically extract insights about competitors from both public and internal data sources.
Evaluate and integrate advancements in
LLMs, retrieval architectures, and agentic reasoning
into our production systems.
Q: What experience are we looking for?
5+ years of industry experience
building and deploying ML systems, with at least 2+ years working on
search, retrieval, or ranking systems .
Expert-level programming skills in
Python, with experience using frameworks such as PyTorch, TensorFlow, or JAX.
Deep understanding of
information retrieval (BM25, dense retrieval, hybrid retrieval)
and relevance tuning.
Experience with
LLMs, retrieval-augmented generation pipelines, and prompt engineering .
Track record of designing and delivering
production-grade ML systems at scale, balancing experimentation with reliability.
Deep understanding of
data pipelines, preprocessing, and large-scale data handling .
Familiarity with
evaluation methodologies
for search systems (recall, MRR, nDCG) and user-facing evaluations.
Experience working with
vector database infrastructure
(FAISS, Milvus, Weaviate, Pinecone, PGVector) and traditional search engines (Elasticsearch, OpenSearch).
Familiarity with
scalable cloud ML infrastructure
(AWS, GCP, Azure).
Develop and implement CI/CD pipelines. Automate the deployment and monitoring of ML models.
Knowledge of
query understanding, document summarization, and other content enrichment strategies .
Ability to lead projects independently while providing technical direction to others.
Nice to Have
Experience designing
agentic LLM systems
and multi-step retrieval workflows.
Background in
conversational search .
Contributions to open-source search, retrieval, or LLM-related projects.
Interest in publishing or sharing learnings with the broader community.
Q: What makes you thrive at Klue?A: We're looking for builders who:
Take ownership and run with ambiguous problems.
Jump into new areas and rapidly learn what's needed to deliver solutions.
Bring scientific rigor while maintaining a pragmatic delivery focus.
See unclear requirements as an opportunity to shape the solution.
Q: What technologies do we use?
LLM platforms: OpenAI, Anthropic, open-source models.
ML frameworks: PyTorch, Transformers, spaCy.
Search/Vector DBs: Elasticsearch, Pinecone, PostgreSQL.
MLOps tools: Weights & Biases, MLflow, Langfuse.
Infrastructure: Docker, Kubernetes, GCP.
Development: Python, Git, CI/CD.
Q: What is your working style at Klue?
Hybrid.
Best of both worlds (remote & in-office). You and your team will be in the office 2 days a week.
Our main Canadian hubs are in Vancouver and Toronto, and most of our teams are located in EST and PST.
Q: What about Compensation & Benefits:
Competitive base salary.
Benefits.
Extended health & dental benefits that kick in Day 1.
Options.
Opportunity to participate in our Employee Stock Option Plan.
Time off.
Take what you need. Just ensure the required work gets done and clear it with your team in advance. The average Klue team member takes 2-4 weeks of PTO per year.
Direct access to our leadership team, including our CEO.
Not ticking every box? That’s okay. We take potential into consideration. An equivalent combination of education and experience may be accepted in lieu of the specifics listed above. If you know you have what it takes, even if that’s different from what we’ve described, be sure to explain why in your application.
At Klue, we're dedicated to creating an inclusive, equitable and diverse workplace as an equal‑opportunity employer. Our commitment is to build a high‑performing team where people feel a strong sense of belonging, can be their authentic selves, and are able to reach their full potential. If there’s anything we can do to make our hiring process more accessible or to better support you, please let us know—we’re happy to accommodate.
We’re excited to meet you and in the meantime, get to know us.
Klue BlogIgnition Acquisition (2025)Goldpan.Ai Acquisition (2025)Win-Loss Acquisition (2023)Series B (2021)CultureWinning as Women & More!About UsProduct Demo ArenaGlassdoorYoutubeLinkedInWellfound (AngelList)#J-18808-Ljbffr
Vacancy posted 34 minutes ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Ai in Winnipeg, MB vacancy
- ...Job Description Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US healthcare... ...telemetry, and evaluation platforms. ~ Strong knowledge of software engineering best practices, testing, debugging, and performance...SeniorFull timeInternshipRemote workRelocation
- ...Drive AI innovation as a Senior AI Engineer in Mississauga, Canada. Craft Python-based AI applications using FastAPI or Flask while optimizing performance... ...an experienced Senior AI Engineer with over 8 years in software development. You will design and deploy AI and LLM applications...Senior
- ...of talent at your fingertips. With our AI-powered Global Work Platform™,... ...— we’re rethinking what it means for software to work with you, not just for you. Our... ...AI assistant, and we’re looking for a Senior Full-Stack AI Engineer who wants to help define what AI-native...SeniorContract workLocal areaRemote workFlexible hours
$176k - $200k per year
We’re looking for a Senior Software Engineer to join our growing AI organization in Vancouver. Asana is pioneering a new category of technology as the human-agent operating system, doubling down on our AI Suite to move our customers toward expansive, end-to-end intelligent...SeniorLong term contractWork at officeLocal areaWork from homeWorldwide- ...position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Software Engineer - AI based in Canada. The Senior Software Engineer will join a small AI Platform team responsible for building production-...SeniorLong term contractRemote work
- Build production AI features as a Senior AI Software Engineer at Safe Fleet, using LLMs, machine learning, and backend APIs. Help make fleet vehicles safer through scalable technology.This hands-on senior engineering role delivers AI-powered capabilities across Safe Fleet’s...Senior
- ...a fast-growing, venture-backed B2B SaaS company building an AI-powered competitive intelligence platform that helps revenue... ...office in downtown Toronto.About the role: We're hiring a Senior Software Engineer to build and optimize state-of-the- LLM-powered agents that can...SeniorWork at office
$150k - $200k per year
...Stikeman Elliott is building its own agentic AI platform, with production agents working... ...and continues to expand. This is the senior engineering role responsible for advancing its... ...role that spans application architecture, software development and production delivery. You...Senior- ...intersection of our people, our customers, and our brands. Senior Applied AI EngineerWho We Are.Newfold Digital is a leading web... ...mark.We are looking for a hand on Senior Applied AI Engineer who combines strong software engineering with practical AI problem solving. You...Senior
- ...leadership. Fleetworthy is shaping the future of fleet readiness with AI-enabled, connected fleet technology that keeps drivers safe,... ...Learn more at fleetworthy.Com .About the role:We're hiring a Senior Software Engineer for the AI Platform team. The team builds AI agents and...SeniorLong term contract
$145k - $183k per year
Job DescriptionToast is recruiting on behalf of this company for a Senior Software Engineer, AI to join their Engineering team in Toronto. They are looking for an experienced backend engineer who is excited to build and optimize LLM-powered systems that help users uncover meaningful...SeniorFull timeManual laborWork at officeFlexible hours- ...Build AI Inference Networking software at Equinix using SDN, proxying, and open-source engineering expertise. Work within a globally distributed development team. As a Senior SDN Network Software Engineer, you will help develop open-source software for Equinix’s AI Inference...Senior
$120k - $140k per year
...as we build smarter technologies that redefine fleet safety. When you help make fleets smarter, you make people safer. Senior Software Engineer, AI Product EngineeringAbout The PositionABOUT THE POSITION Meet the Smart Safety Company AtSafe Fleetour name says it all...SeniorWork at officeLocal area$90.49k - $132.71k per year
...empowering better decisions for individuals and those managing money for millions. The RoleWe are seeking a Senior Software Engineer to build the applied systems that bring AI capabilities into production: the data pipelines, LLM integrations, agentic workflows, tool interfaces,...SeniorInternshipWork at officeWorldwide- We are hiring a Senior Software Engineer to build and run the search systems that connect Guidepoint clients with the right experts. You will join... ...semantic search, the Python services in front of it all, and the AI features that turn a plain-language question into a ranked...SeniorInternshipWork at office
- Join Cerebras Systems as a Senior Software Engineer specializing in AI fleet platform development. This role focuses on managing AI clusters and enhancing operational efficiency across platforms. As a senior engineer at Cerebras, you'll drive innovation in fleet management...Senior
$100k - $145k per year
...for proactive recruitment purposes and may be used to fill current openings or future vacancies within our organization.**Senior Software Engineer - AI (Materia AI)**We’re building the next generation of AI‑powered systems for tax and accounting professionals, and we need a...SeniorWork at officeLocal areaFlexible hours2 days per week3 days per week$120k - $145k per year
...aVeraltocompany, is a mission-driven software company that organizes the world’s... ...growth. Reporting to the Director of Engineering & Predictive Analytics, the Senior Software Engineer will contribute to... ...analytics products that leverage AI and ML. This position is part of the...SeniorWork at officeRemote workFlexible hoursShift work- Build AI systems as a Senior Software Engineer in Asana’s Vancouver office, using distributed systems expertise and technical leadership. Work follows an office-centric hybrid schedule.Asana is expanding AI engineering teams across its human-agent operating system and AI Suite...SeniorWork at office
- Engage in cutting-edge AI language model development as a Senior Software Engineer. With Ethos, work remotely and leverage your expertise for impactful software engineering tasks. This role with a leading AI lab seeks a Senior Software Engineer with over 5 years of experience...SeniorRemote workFlexible hours
- Build financial technology in a hybrid Mississauga role using enterprise Java, AI, and real-time Kafka data streaming. Design resilient applications for Front Office Technology.As a Software Engineer, you will partner with front-office business teams to deliver enterprise-...Senior
- Transform the insurance industry with Owl.co as a Senior Software Engineer dedicated to applied AI systems. This full-time, onsite role is based in New York City, Toronto, or Vancouver. As a Senior Software Engineer, you will work closely with cross-functional teams to design...SeniorFull time
- Elevate your career as a Senior Software Engineer at Thomson Reuters, focusing on AI systems that transform accounting practices. This hybrid opportunity combines backend development with innovative AI integration using Python. As a Lead Software Engineer, you'll spearhead...Senior
- Build AI-powered legal solutions as a Senior Software Engineer with Python expertise at Thomson Reuters. Work directly with legal customers and cross-functional teams.On CoCounsel Forward Deployed Engineering, you will design, build, and improve software for legal workflows....Senior
- Lead the way in AI innovation as a Senior Software Engineer at Newfold Digital. Your role will revolve around developing impactful AI solutions that significantly enhance our customers' digital presence. In this hands-on position, you will directly influence production AI...Senior
- Design AI agents and complex software systems at lululemon, using AWS Bedrock, Python, and enterprise automation expertise. This hybrid role requires onsite work four days weekly.As a Senior Software Engineer, you will lead AI agent implementation across multiple services and...Senior
- 7shifts is seeking a Senior Software Developer to join the Growth squad. You’ll help ship experiments... ...decisions across product, design, and engineering. You’ll report to an Engineering Manager... ...PMs and Analysts to iterate on product using AI thoughtfully to #J-18808-LjbffrSenior
- ...logiciel pour Retraite Canada chez Manulife, en mode hybride à Montréal. Mettez en pratique Java, C# ou Python.Comme ingénieur(e) logiciel senior, vous développerez des applications et services soutenant les produits, opérations et expériences clients de Retraite Canada. Vous...Senior
- Build reliable software with Python and AI at ZoomInfo, working remotely on applications, services, and data platforms for business teams.As a Senior Software Engineer, you will own complex technical projects from ambiguous requirements through production. You will use Python...SeniorRemote work
- Engineer low-latency conversational AI with LLM orchestration, streaming audio, and autonomous workflows from a 100% on-site Montreal setting.As a Senior AI Engineer, you will build and refine voice-driven products across the entire stack. Your focus includes ambient AI scribes...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, Ai. Be the first to apply!
Related searches
- software engineer part time Winnipeg, MB
- software engineer Winnipeg, MB
- software design engineer Winnipeg, MB
- software engineer - computer Winnipeg, MB
- software developer internship no experience Winnipeg, MB
- ingénieur logiciel Winnipeg, MB
- software engineer co-op Winnipeg, MB
- software development engineer Winnipeg, MB
- software developer Winnipeg, MB
- software engineer - ai machine learning Winnipeg, MB

