Ai Observability Engineer — Build & Govern Production Llms (Hybrid)
BMO
BMO Financial Group is seeking a Hybrid Senior AI Observability Engineer in Canada to design, build, and operate systems that track and evaluate non-deterministic AI models and agent workflows. You will trace LLM calls, monitor token usage, detect drift, and run automated evaluations in production.You should have 7–10 years of Site Reliability Engineering experience, strong automation and observability skills, and experience with Python, SQL, and telemetry tools (Prometheus, Grafana, Datadog).
#J-18808-Ljbffr
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Ai Observability Engineer — Build & Govern Production Llms (Hybrid) in Winnipeg, MB vacancy
- WiseMatic Inc. is seeking a Senior AI Developer to lead the design and delivery of... ...for clients. You will architect production AI systems, build ML models, and ensure responsible AI practices. The role blends software engineering with practical AI judgement and mentorship...SuggestedWork at office
WiseMatic Inc.
Winnipeg, MB1 hour ago - Nesto Group in Canada is seeking a senior software engineer to lead AI-enabled features for Maestro, our AI underwriting and lending engine... ...-based workflows, and optimize pipelines using Python and LLMs in production. The role emphasizes mentoring, architecture decisions, and...SuggestedRemote work
Software Directory
Winnipeg, MB1 hour ago - Fortiv Technical Inc. seeks an AI Engineer to build production-grade backend systems powering agentic AI workflows in a hybrid environment in Canada. You will design retrieval pipelines, evaluate LLM-powered applications, and collaborate with product and infrastructure teams...Suggested
Fortiv Technical Inc.
Winnipeg, MB1 hour ago $80k - $175k per year
...Family Group:Data Analytics & Reporting Hybrid role Designs, builds, and maintains systems that track, evaluate, and debug non-deterministic AI models and agent workflows. Trace LLM... ...drift, set up automated evaluations, and govern autonomous agent behaviors in production...SuggestedPart timeAimlroles
Winnipeg, MB59 minutes ago- ...Altis in Toronto is seeking an Enterprise AI Engineer to lead AI adoption, development, and governance. The role collaborates with business leaders and IT across... ...organization to deliver responsible AI solutions that raise productivity and innovation. You’ll design and deploy AI...SuggestedRemote work
Altis
Winnipeg, MB1 hour ago - ...Intercast Staffing Ltd. is seeking a Senior AI / Generative AI Engineer to design and deliver enterprise-grade AI... ...growing Data & AI Marketplace. You will build, scale, and operationalize advanced AI systems in secure, governed Azure environments. The role focuses on delivering...
Intercast Staffing Ltd.
Winnipeg, MB1 hour ago - Join Honeycomb as a Software Engineer I, focusing on AI observability in a fully remote role. Contribute your software engineering expertise to enhance observability... ...engineering role, your responsibilities will include building observability tools and contributing to data models that...Remote work
Candidate
Winnipeg, MB1 hour ago - Build AI-powered products with Claude Code and Cursor as an AI Product Engineer in Montreal, working full-time in a hybrid model.At Angel Host, you will develop Sentinel, an AI-native revenue intelligence platform, alongside internal tools and automations. The role combines...Full time
Angel Host
Winnipeg, MB1 hour ago $165k - $330k per year
...inference for the world's most dynamic AI companies, like Cursor, Notion,... ...AI to bring cutting-edge models into production. We're growing quickly and recently raised... ..., and Spark Capital. Join us and help build the platform engineers turn to ship AI products.About Baseten...Flexible hoursBaseten
Winnipeg, MB1 hour ago- ...RBC is seeking a Lead AI Engineer to design, develop, and implement AI-driven solutions within the software development lifecycle. You will... ...to implement AI-powered automation, LLM-driven workflows, and governance frameworks, ensuring secure, scalable, and maintainable systems...
RBC
Winnipeg, MB1 hour ago - Okta seeks an Observability Engineer for the Auth0 Platform Observability team. You will monitor, observe, and improve the platform’s reliability, partnering with Product and Platform Engineers to ship software rapidly while strengthening instrumentation and telemetry across...
Okta
Winnipeg, MB1 hour ago - Infosys in Mississauga, Ontario, seeks a hands-on Gen AI / Agentic AI Engineer to design, develop, and deploy next‑generation AI solutions using LLMs, RAG, and agentic frameworks in a production‑oriented setting. You will collaborate with product and data teams, apply MLOps...Relocation
Infosys
Winnipeg, MB1 hour ago - ...Ample Insight Inc. is seeking a Data Scientist to join a world-class team of engineers and data scientists in Toronto. You will work on real-world problems, building production-grade AI/ML systems and turning cutting-edge research into working prototypes. The role emphasizes...
Ample Insight Inc.
Winnipeg, MB1 hour ago - ...leading manufacturer and distributor of air distribution products ( The founding principles of Price have never... ...free Tea and Coffee. Position Summary Join our AI team as an Intermediate AI Engineer, where you'll build and deploy AI applications, agents, and automation...
- ...Java-Holdings in Edmonton, Canada seeks an AI/ML Engineer to design, develop, integrate and deploy AI solutions that boost business... ...across the enterprise. The role emphasizes generative AI, LLMs, RAG and production AI operations with Microsoft technologies, third-party platforms...
Java-Holdings
Winnipeg, MB1 hour ago $120k - $215k per year
...Technologie Role OverviewThe Global Product Owner, Observability is accountable for defining, owning,... ...Monitoring (APM), and Site Reliability Engineering (SRE)-ensuring their priorities, investments... ...observability capabilities extend to AI-enabled systems, providing visibility...Long term contractPart timeBMO
Winnipeg, MB1 hour ago- Production troubleshooting and observability define this experienced Site Reliability Engineer role with Porter in Toronto’s Downtown Office.You will improve reliability, scalability, and performance through code, monitoring, and operational tooling. The role partners with developers...Work at office
Porter Airlines
Winnipeg, MB1 hour ago - NovoEd, Inc. is seeking a senior AI Engineer to design, build, and deploy production‑grade AI‑powered backend systems. The role emphasizes scalable LLM integration, vector database optimization, and high‑performance Python services. You will work across backend, AI inference...
NovoEd, Inc.
Winnipeg, MB1 hour ago - ...Lead responsible AI adoption at YVR through digital governance, IT service management, and practical controls supporting safe airport operations. As Manager, Technology Services, you will oversee AI and digital tool governance across YVR. Reporting to the Director, Data...
$85k - $125k per year
...through stretching themselves, where they can work on innovative products and projects, and where employees are supported and engaged in doing so. We are seeking a Mid-Level Observability Engineer to help build, maintain, and enhance our enterprise monitoring and...Work at officeCI Financial
Winnipeg, MB1 hour ago- ...Blanc Labs is seeking a Software Engineer to help build across the stack—from backend services to web interfaces and AI agents. You will contribute to features used by real clients... ...partners, with ownership from idea to production. The role emphasizes working with Python,...Work at office
Blanc-Labs
Winnipeg, MB1 hour ago - ...is seeking a Site Reliability Engineer to define day‑2 operations standards... ...platform. You will build robust systems, automate mitigations, and develop observability tooling to keep services reliable... ...engineering, forward‑deployed and product teams, turning recurring failures...
Baseten
Winnipeg, MB1 hour ago $154k - $230k per year
A technology firm specializing in identity solutions is seeking a Staff Machine Learning Engineer to drive the development of scalable AI systems. This role involves designing and implementing AI infrastructure, optimizing machine learning systems, and collaborating with cross...Okta
Winnipeg, MB1 hour ago- eBay is hiring for an AI/ML focused role within the Depop team to shape the future... ...of-the-art AI/ML models, partnering with engineering, product, and data teams to deliver measurable business impact. This position emphasizes building scalable data pipelines, deploying models...
eBay
Winnipeg, MB1 hour ago - ...Wiser is seeking a Senior ML Engineer to own the full ML lifecycle for our customer-facing AI platform. You will drive prototype-to-production work, focusing on matching, classification, and... ...extraction using classical ML, embeddings, and LLMs. You’ll ship RAG systems, manage...Remote work
Wiser
Winnipeg, MB1 hour ago $96.56k - $128.74k per year
...better through trade. Position: Observability Product Owner Employment Type: Permanent... ...Export Development Canada operates under a hybrid work model. As of September 2026, our in... ...TOS) is EDC’s “run, support and sustain” engine for technology services, helping keep...Permanent employmentWork at officeRelocation packageFlexible hours3 days per weekExport Development Canada
Winnipeg, MB1 hour ago- ...Chubb Canada through responsible AI, model risk management, and resilient engineering. The role is full-time.As Assistant... ...and regional teams to implement production-grade capabilities. Cost,... ...responsible AI, model risk, and AI governance practicesEnsure solutions meet security...Full time
Chubb Ltd.
Winnipeg, MB1 hour ago - Kraft Heinz is seeking a Group Lead, AI Governance in Toronto to establish and operate a technical governance and platform controls... ...the enterprise. This hands-on leader will drive policy-to-engineering in productivity AI, low-code agents, and production AI/ML solutions,...
Kraft Heinz
Winnipeg, MB1 hour ago - Translate AI policies into technical controls at CIBC in Toronto, using Python, automated testing, and CI/CD within a hybrid work arrangement.As Senior Consultant, AI Safety and Guardrails Engineering, you will advance Governed AI by Design across CIBC. You will design reusable...Internship
Canadian Imperial Bank of Commerce (Canada)
Winnipeg, MB1 hour ago - ...AItoolnavio and its partner are seeking an AI Forward Deployed Engineer based in Canada to design and operate production-ready AI-powered services. You will enable agents to interact safely with external systems, building reusable capabilities for meetings, browsing, search...Remote work
AItoolnavio
Winnipeg, MB1 hour ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Ai Observability Engineer — Build & Govern Production Llms (Hybrid). Be the first to apply!
