Ai Observability Engineer — Build & Govern Production Llms (Hybrid)
BMO
BMO Financial Group is seeking a Hybrid Senior AI Observability Engineer in Canada to design, build, and operate systems that track and evaluate non-deterministic AI models and agent workflows. You will trace LLM calls, monitor token usage, detect drift, and run automated evaluations in production.You should have 7–10 years of Site Reliability Engineering experience, strong automation and observability skills, and experience with Python, SQL, and telemetry tools (Prometheus, Grafana, Datadog).
#J-18808-Ljbffr
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Ai Observability Engineer — Build & Govern Production Llms (Hybrid) in Winnipeg, MB vacancy
- WiseMatic Inc. is seeking a Senior AI Developer to lead the design and delivery of... ...for clients. You will architect production AI systems, build ML models, and ensure responsible AI practices. The role blends software engineering with practical AI judgement and mentorship...SuggestedWork at office
WiseMatic Inc.
Winnipeg, MB1 hour ago - Nesto Group in Canada is seeking a senior software engineer to lead AI-enabled features for Maestro, our AI underwriting and lending engine... ...-based workflows, and optimize pipelines using Python and LLMs in production. The role emphasizes mentoring, architecture decisions, and...SuggestedRemote work
Software Directory
Winnipeg, MB1 hour ago - Fortiv Technical Inc. seeks an AI Engineer to build production-grade backend systems powering agentic AI workflows in a hybrid environment in Canada. You will design retrieval pipelines, evaluate LLM-powered applications, and collaborate with product and infrastructure teams...Suggested
Fortiv Technical Inc.
Winnipeg, MB1 hour ago $80k - $175k per year
...Family Group:Data Analytics & Reporting Hybrid role Designs, builds, and maintains systems that track, evaluate, and debug non-deterministic AI models and agent workflows. Trace LLM... ...drift, set up automated evaluations, and govern autonomous agent behaviors in production...SuggestedPart timeAimlroles
Winnipeg, MB1 hour ago- ...Intercast Staffing Ltd. is seeking a Senior AI / Generative AI Engineer to design and deliver enterprise-grade AI... ...growing Data & AI Marketplace. You will build, scale, and operationalize advanced AI systems in secure, governed Azure environments. The role focuses on delivering...Suggested
Intercast Staffing Ltd.
Winnipeg, MB1 hour ago - ...Altis in Toronto is seeking an Enterprise AI Engineer to lead AI adoption, development, and governance. The role collaborates with business leaders and IT across... ...organization to deliver responsible AI solutions that raise productivity and innovation. You’ll design and deploy AI...Remote work
Altis
Winnipeg, MB1 hour ago $165k - $330k per year
...inference for the world's most dynamic AI companies, like Cursor, Notion,... ...AI to bring cutting-edge models into production. We're growing quickly and recently raised... ..., and Spark Capital. Join us and help build the platform engineers turn to ship AI products.About Baseten...Flexible hoursBaseten
Winnipeg, MB1 hour ago- Join Honeycomb as a Software Engineer I, focusing on AI observability in a fully remote role. Contribute your software engineering expertise to enhance observability... ...engineering role, your responsibilities will include building observability tools and contributing to data models that...Remote work
Candidate
Winnipeg, MB1 hour ago - Build AI-powered products with Claude Code and Cursor as an AI Product Engineer in Montreal, working full-time in a hybrid model.At Angel Host, you will develop Sentinel, an AI-native revenue intelligence platform, alongside internal tools and automations. The role combines...Full time
Angel Host
Winnipeg, MB1 hour ago - ...RBC is seeking a Lead AI Engineer to design, develop, and implement AI-driven solutions within the software development lifecycle. You will... ...to implement AI-powered automation, LLM-driven workflows, and governance frameworks, ensuring secure, scalable, and maintainable systems...
RBC
Winnipeg, MB1 hour ago - Okta seeks an Observability Engineer for the Auth0 Platform Observability team. You will monitor, observe, and improve the platform’s reliability, partnering with Product and Platform Engineers to ship software rapidly while strengthening instrumentation and telemetry across...
Okta
Winnipeg, MB1 hour ago - Production troubleshooting and observability define this experienced Site Reliability Engineer role with Porter in Toronto’s Downtown Office.You will improve reliability, scalability, and performance through code, monitoring, and operational tooling. The role partners with developers...Work at office
Porter Airlines
Winnipeg, MB1 hour ago $120k - $215k per year
...Technologie Role OverviewThe Global Product Owner, Observability is accountable for defining, owning,... ...Monitoring (APM), and Site Reliability Engineering (SRE)-ensuring their priorities, investments... ...observability capabilities extend to AI-enabled systems, providing visibility...Long term contractPart timeBMO
Winnipeg, MB1 hour ago- NovoEd, Inc. is seeking a senior AI Engineer to design, build, and deploy production‑grade AI‑powered backend systems. The role emphasizes scalable LLM integration, vector database optimization, and high‑performance Python services. You will work across backend, AI inference...
NovoEd, Inc.
Winnipeg, MB1 hour ago - Translate AI policies into technical controls at CIBC in Toronto, using Python, automated testing, and CI/CD within a hybrid work arrangement.As Senior Consultant, AI Safety and Guardrails Engineering, you will advance Governed AI by Design across CIBC. You will design reusable...Internship
Canadian Imperial Bank of Commerce (Canada)
Winnipeg, MB1 hour ago - ...is seeking a Site Reliability Engineer to define day‑2 operations standards... ...platform. You will build robust systems, automate mitigations, and develop observability tooling to keep services reliable... ...engineering, forward‑deployed and product teams, turning recurring failures...
Baseten
Winnipeg, MB1 hour ago - ...Wiser is seeking a Senior ML Engineer to own the full ML lifecycle for our customer-facing AI platform. You will drive prototype-to-production work, focusing on matching, classification, and... ...extraction using classical ML, embeddings, and LLMs. You’ll ship RAG systems, manage...Remote work
Wiser
Winnipeg, MB1 hour ago - ...Chubb Canada through responsible AI, model risk management, and resilient engineering. The role is full-time.As Assistant... ...and regional teams to implement production-grade capabilities. Cost,... ...responsible AI, model risk, and AI governance practicesEnsure solutions meet security...Full time
Chubb Ltd.
Winnipeg, MB1 hour ago $96.56k - $128.74k per year
...world better through trade. Position: Observability Product Owner Employment Type:Permanent... ...Export Development Canada operates under a hybrid work model. As of September 2026, our... ...TOS) is EDC’s “run, support and sustain” engine for technology services, helping keep...Permanent employmentWork at officeRelocation packageFlexible hours3 days per weekExport Development Canada | Exportation et développement Can...
Winnipeg, MB1 hour ago- ...Description Insight Global is looking for an observability engineer for one of our clients platform and... ..., and reusable componentsBuild and govern Infrastructure-as-Code (IaC), modules, and... ...SSDLC standards into pipelinesIntegrate AI-assisted workflows into CI/CD, code review...
Insight Global
Winnipeg, MB1 hour ago - eBay is hiring for an AI/ML focused role within the Depop team to shape the future... ...of-the-art AI/ML models, partnering with engineering, product, and data teams to deliver measurable business impact. This position emphasizes building scalable data pipelines, deploying models...
eBay
Winnipeg, MB1 hour ago $85k - $125k per year
...through stretching themselves, where they can work on innovative products and projects, and where employees are supported and engaged in doing so. We are seeking a Mid-Level Observability Engineer to help build, maintain, and enhance our enterprise monitoring and...Work at officeCI Financial
Winnipeg, MB1 hour ago- Kraft Heinz is seeking a Group Lead, AI Governance in Toronto to establish and operate a technical governance and platform controls... ...the enterprise. This hands-on leader will drive policy-to-engineering in productivity AI, low-code agents, and production AI/ML solutions,...
Kraft Heinz
Winnipeg, MB1 hour ago - ...Angel Host Inc. in Montreal is hiring an AI Product Engineer to build and ship AI-driven features for Sentinel and internal Angel Host tools. You will work with Claude Code, Cursor and other AI-assisted development tools, translating business needs into clear specifications...
Angel Host Inc.
Winnipeg, MB1 hour ago - Own AI governance for Pumpkin AI in Mississauga, shaping cost controls, security, privacy, and audit compliance with engineering daily.Supra Canada Technologies Ltd. seeks an AI Product Owner for its enterprise agentic AI platform. You will own backlog ranking, story writing...
Supra ITS
Winnipeg, MB1 hour ago - Shape Dynatrace observability capabilities at EDC through service ownership... ..., enterprise strategy, and hybrid collaboration across Canadian locations.As Observability Product Owner, you will own EDC’s... ...observability strategy, roadmap, governance, and service...
Export Development Canada | Exportation et développement Can...
Winnipeg, MB1 hour ago - ...MontrealA career as a Generative AI Solutions Architect within the... ...to large language models (LLMs) and AI-powered solutions.Design... ...your work-life balance through a hybrid work environment and a flexible... ...Bachelor’s degree in Software Engineering, Computer Science, or a related...Flexible hours
Banque Nationale du Canada
Winnipeg, MB1 hour ago - AI Product Engineer - MONTREAL, Quebec BasedSentinel | Angel HostAbout usAngel Host is a Montreal-based revenue management and listing optimization... ...table and helping revenue teams maximize their returns. We build AI-first. Our backend runs on Supabase and Postgres, our...Full timeTemporary workInternshipWork from homeTrial period
Angel Host
Winnipeg, MB1 hour ago $160k - $180k per year
Senior Software Engineer, Agentic AI Products Who we are:Leo Berwick is an innovative mergers and acquisitions consulting firm. We are comprised... ...performance, continuous learning, and the shared ambition to build something exceptional, together.What we're looking forWe...Permanent employmentFull timeInternshipWork at office2 days per weekLeo Berwick, LP
Winnipeg, MB1 hour ago- Tekshapers seeks a Data Governance Lead to drive enterprise-wide data governance, quality, lineage and observability. You will design operating models, policies, and governance forums, and partner with risk, compliance, and analytics teams to elevate data maturity across cloud...
Tekshapers
Winnipeg, MB1 hour ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Ai Observability Engineer — Build & Govern Production Llms (Hybrid). Be the first to apply!
