Ai Observability Engineer — Build & Govern Production Llms (Hybrid)
BMO
BMO Financial Group is seeking a Hybrid Senior AI Observability Engineer in Canada to design, build, and operate systems that track and evaluate non-deterministic AI models and agent workflows. You will trace LLM calls, monitor token usage, detect drift, and run automated evaluations in production.You should have 7–10 years of Site Reliability Engineering experience, strong automation and observability skills, and experience with Python, SQL, and telemetry tools (Prometheus, Grafana, Datadog).
#J-18808-Ljbffr
#J-18808-Ljbffr
Vacancy posted 48 minutes ago
Similar jobs that could be interesting for youBased on the Ai Observability Engineer — Build & Govern Production Llms (Hybrid) in Winnipeg, MB vacancy
- WiseMatic Inc. is seeking a Senior AI Developer to lead the design and delivery of... ...for clients. You will architect production AI systems, build ML models, and ensure responsible AI practices. The role blends software engineering with practical AI judgement and mentorship...SuggestedWork at office
- Nesto Group in Canada is seeking a senior software engineer to lead AI-enabled features for Maestro, our AI underwriting and lending engine... ...-based workflows, and optimize pipelines using Python and LLMs in production. The role emphasizes mentoring, architecture decisions, and...SuggestedRemote work
- Thomson Reuters is seeking a Senior Legal Engineer to design, build, and deploy AI-powered software for legal workflows. You will work with legal customers... ..., mentor engineers, and collaborate across engineering, product, and legal partners to improve the software lifecycle....Suggested
- Fortiv Technical Inc. seeks an AI Engineer to build production-grade backend systems powering agentic AI workflows in a hybrid environment in Canada. You will design retrieval pipelines, evaluate LLM-powered applications, and collaborate with product and infrastructure teams...Suggested
- ClickHouse is hiring an AI Product Engineer to build agentic capabilities atop a petabyte-scale observability platform. You’ll focus on developer experience, write reusable skills, and own the agent stack end-to-end, from context engineering to observability. You’ll collaborate...SuggestedRemote work
$80k - $175k per year
...Family Group:Data Analytics & Reporting Hybrid role Designs, builds, and maintains systems that track, evaluate, and debug non-deterministic AI models and agent workflows. Trace LLM... ...drift, set up automated evaluations, and govern autonomous agent behaviors in production...Part time- ...Altis in Toronto is seeking an Enterprise AI Engineer to lead AI adoption, development, and governance. The role collaborates with business leaders and IT across... ...organization to deliver responsible AI solutions that raise productivity and innovation. You’ll design and deploy AI...Remote work
- ...Intercast Staffing Ltd. is seeking a Senior AI / Generative AI Engineer to design and deliver enterprise-grade AI... ...growing Data & AI Marketplace. You will build, scale, and operationalize advanced AI systems in secure, governed Azure environments. The role focuses on delivering...
- Join Honeycomb as a Software Engineer I, focusing on AI observability in a fully remote role. Contribute your software engineering expertise to enhance observability... ...engineering role, your responsibilities will include building observability tools and contributing to data models that...Remote work
$165k - $330k per year
...inference for the world's most dynamic AI companies, like Cursor, Notion,... ...AI to bring cutting-edge models into production. We're growing quickly and recently raised... ..., and Spark Capital. Join us and help build the platform engineers turn to ship AI products.About Baseten...Flexible hours- Build AI-powered products with Claude Code and Cursor as an AI Product Engineer in Montreal, working full-time in a hybrid model.At Angel Host, you will develop Sentinel, an AI-native revenue intelligence platform, alongside internal tools and automations. The role combines...Full time
- Okta seeks an Observability Engineer for the Auth0 Platform Observability team. You will monitor, observe, and improve the platform’s reliability, partnering with Product and Platform Engineers to ship software rapidly while strengthening instrumentation and telemetry across...
- ...RBC is seeking a Lead AI Engineer to design, develop, and implement AI-driven solutions within the software development lifecycle. You will... ...to implement AI-powered automation, LLM-driven workflows, and governance frameworks, ensuring secure, scalable, and maintainable systems...
- ...Ample Insight Inc. is seeking a Data Scientist to join a world-class team of engineers and data scientists in Toronto. You will work on real-world problems, building production-grade AI/ML systems and turning cutting-edge research into working prototypes. The role emphasizes...
- Infosys in Mississauga, Ontario, seeks a hands-on Gen AI / Agentic AI Engineer to design, develop, and deploy next‑generation AI solutions using LLMs, RAG, and agentic frameworks in a production‑oriented setting. You will collaborate with product and data teams, apply MLOps...Relocation
- ...Lead responsible AI adoption at YVR through digital governance, IT service management, and practical controls supporting safe airport operations. As Manager, Technology Services, you will oversee AI and digital tool governance across YVR. Reporting to the Director, Data...
- BlueCat, Toronto, seeks a Product Manager to advance LiveNX and Network Synthetics across observability and DDI. You’ll partner with customers, engineering, design, and go‑to‑market teams to turn complex... ...product management, a passion for AI-driven outcomes, and strong...
- ...leading manufacturer and distributor of air distribution products ( The founding principles of Price have never... ...free Tea and Coffee. Position Summary Join our AI team as an Intermediate AI Engineer, where you'll build and deploy AI applications, agents, and automation...
- ...Blanc Labs is seeking a Software Engineer to help build across the stack—from backend services to web interfaces and AI agents. You will contribute to features used by real clients... ...partners, with ownership from idea to production. The role emphasizes working with Python,...Work at office
- NovoEd, Inc. is seeking a senior AI Engineer to design, build, and deploy production‑grade AI‑powered backend systems. The role emphasizes scalable LLM integration, vector database optimization, and high‑performance Python services. You will work across backend, AI inference...
- ...Java-Holdings in Edmonton, Canada seeks an AI/ML Engineer to design, develop, integrate and deploy AI solutions that boost business... ...across the enterprise. The role emphasizes generative AI, LLMs, RAG and production AI operations with Microsoft technologies, third-party platforms...
- eBay is hiring for an AI/ML focused role within the Depop team to shape the future... ...of-the-art AI/ML models, partnering with engineering, product, and data teams to deliver measurable business impact. This position emphasizes building scalable data pipelines, deploying models...
- Production troubleshooting and observability define this experienced Site Reliability Engineer role with Porter in Toronto’s Downtown Office.You will improve reliability, scalability, and performance through code, monitoring, and operational tooling. The role partners with developers...Work at office
- ...is seeking a Site Reliability Engineer to define day‑2 operations standards... ...platform. You will build robust systems, automate mitigations, and develop observability tooling to keep services reliable... ...engineering, forward‑deployed and product teams, turning recurring failures...
- ...Wiser is seeking a Senior ML Engineer to own the full ML lifecycle for our customer-facing AI platform. You will drive prototype-to-production work, focusing on matching, classification, and... ...extraction using classical ML, embeddings, and LLMs. You’ll ship RAG systems, manage...Remote work
- ...AItoolnavio and its partner are seeking an AI Forward Deployed Engineer based in Canada to design and operate production-ready AI-powered services. You will enable agents to interact safely with external systems, building reusable capabilities for meetings, browsing, search...Remote work
- ...Chubb Canada through responsible AI, model risk management, and resilient engineering. The role is full-time.As Assistant... ...and regional teams to implement production-grade capabilities. Cost,... ...responsible AI, model risk, and AI governance practicesEnsure solutions meet security...Full time
$85k - $125k per year
...through stretching themselves, where they can work on innovative products and projects, and where employees are supported and engaged in doing so. We are seeking a Mid-Level Observability Engineer to help build, maintain, and enhance our enterprise monitoring and...Work at office- Kraft Heinz is seeking a Group Lead, AI Governance in Toronto to establish and operate a technical governance and platform controls... ...the enterprise. This hands-on leader will drive policy-to-engineering in productivity AI, low-code agents, and production AI/ML solutions,...
- Shape the future of home management technology as an AI Engineer in Toronto. Leverage your SaaS background to build LLM-powered features in a dynamic, hybrid role. Join a dedicated engineering team focused on developing intelligent solutions for homeowners in the Greater Toronto...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Ai Observability Engineer — Build & Govern Production Llms (Hybrid). Be the first to apply!

