Senior Llm Platform Observability Engineer
Aimlroles
Shape LLM platform observability at BMO, using OpenTelemetry, Prometheus, and Grafana in a hybrid engineering environment.The Senior AI Engineer builds capabilities for tracing agent workflows and managing production AI behavior. Responsibilities include capturing spans, prompts, tool calls, and intermediate outputs, while controlling token costs and log cardinality. You will also standardize pipelines, configure dashboards, and support automated anomaly detection and incident response.Key Responsibilities:
Implement OpenTelemetry-based agent tracing frameworksCapture prompts, spans, tools, and outputsBuild telemetry strategies for token optimizationConfigure logging sidecars and centralized dashboardsReplace static thresholds with anomaly detectionRequirements:
Bachelor's degree in Computer Science or EngineeringSeven to ten years of Site Reliability Engineering experienceExperience automating detection, investigation, and remediationPython experience for custom evaluationsSQL or LogQL/PromQL querying experienceUse LLM tracing, platform engineering, and intelligent monitoring to govern BMO’s autonomous AI workflows.
#J-18808-Ljbffr
Implement OpenTelemetry-based agent tracing frameworksCapture prompts, spans, tools, and outputsBuild telemetry strategies for token optimizationConfigure logging sidecars and centralized dashboardsReplace static thresholds with anomaly detectionRequirements:
Bachelor's degree in Computer Science or EngineeringSeven to ten years of Site Reliability Engineering experienceExperience automating detection, investigation, and remediationPython experience for custom evaluationsSQL or LogQL/PromQL querying experienceUse LLM tracing, platform engineering, and intelligent monitoring to govern BMO’s autonomous AI workflows.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Senior Llm Platform Observability Engineer in Winnipeg, MB vacancy
- Shape IBM’s global observability platform through distributed systems engineering, OpenTelemetry, and Kubernetes operations across multiple cloud environments.As a Senior Software Engineer I, you will architect, build, and operate mission-critical observability capabilities...Senior
$250k - $280k per year
Senior Software Engineer II - LLM ObservabilityRemote - Canada What We’re Building Honeycomb is a service for the near and present future, defining observability and raising expectations of what developer tools can do! We’re working with well known companies like HelloFresh...SeniorInternshipWork at officeLocal areaRemote workWork from homeHome officeShift work$250k - $280k per year
...and present future, defining observability and raising expectations of what... ...debug them. We’re bringing LLM and agent observability... ...small, cross-functional group of engineers with a dedicated product manager... ...infrastructure that let us observe agents and their ecosystems across...SeniorInternshipWork at officeRemote workWork from homeHome officeVisa sponsorshipShift work- Develop LLM workflows and data pipelines for AXIS Capital’s enterprise AI platforms using Databricks, PySpark, and Python. The work supports business teams.This Senior AI Platform Engineer builds reusable capabilities for underwriting, claims, operations, and strategic functions...Senior
- Build production LLM services in Downtown Toronto using Python, Go, and modern AI coding assistants within a hybrid engineering team. This full-time role centers on enterprise AI platform development.As a Senior AI Engineer, you will design, ship, and run services used across...SeniorFull time
- Okta is seeking an Observability Engineer to join the Auth0 Platform Observability team. You will help ensure product and platform engineers can monitor and observe... ...while we rapidly ship software customers love. As a Senior Engineer, you will champion best observability...Senior
- ...Build scalable machine learning platforms at PointClickCare using Python, Java, and... ...products across healthcare. As a Senior Machine Learning Systems Engineer, you will design, build, and operate... ...develops traditional and hybrid ML/LLM solutions. Key Responsibilities:...Senior
- Develop production LLM infrastructure in Montreal with Python, model serving, evaluation, and observability for conversational phone and SMS products.This senior developer role spans shared machine learning... ...Six or more years of relevant engineering experienceTrack record...Senior
$94.4k - $157.3k per year
...Canada B2C Digital Solution. Main application in the portfolio is a B2C Platform for pharmacy patients. Team of around 20 people. McKesson is seeking a Senior Lead Engineer, Platform Operations & Observability to lead the reliability, observability, and operational excellence...SeniorLong term contractWork at office- Work Style: Hybrid — Minimum 3 days onsite Observability Engineer (Dynatrace)Experience Required: 4+ years managing observability solutions (Dynatrace‑focused) Job PurposeThe Observability Platform Engineer will work closely with infrastructure, development,...
- Senior AI EngineerLocation: Toronto, ON | Hybrid (3 days onsite:... ...and highly motivated Senior AI Engineer to join the Technology... ...infrastructure, AI services, CI/CD, observability, and enterprise-scale... ...Neo4j, MongoDB Atlas, or similar platforms.Develop ingestion, extraction...SeniorInternship
- Join our Observability team as a motivated Platform Engineer focused on optimizing cloud-native and hybrid applications. Utilize your expertise in observability tools and strategies to enhance application reliability in public and private cloud environments. This role requires...
- MedMe Health is hiring a senior platform engineer (infrastructure and observability) for Nova in Toronto. You’ll own major platform initiatives, deepen AWS/CDK know‑how (TypeScript), and help consolidate deployment pipelines with a bias for accuracy. Join a small, high‑trust...Senior
- IBM Software in Vancouver, BC, Canada, is seeking a Senior Software Engineer I with a passion for observability to help define and operate a global-scale observability platform. You will work across clouds and regions, shaping how we collect, store, and analyze signals from...Senior
- RBC in Toronto is seeking a senior Platform Engineer to design and implement observability-as-code across AWS, Azure, and OpenShift using Terraform. You will build CI/CD pipelines for Dynatrace configurations and automate provisioning across multi-cloud environments. You will...Senior
- ...Mississauga seeks an experienced software engineer to design and deploy Python-based AI/LLM applications, using FastAPI/Flask... ...will build REST APIs, analytics platforms, and optimized data pipelines,... ...with strong reliability. As a senior contributor, you will mentor teams...Senior
$80k - $175k per year
...models and agent workflows. Trace LLM calls, monitor token usage,... ...Degree in Computer Science, Engineering or other relevant domain 7-... ...in Artificial Intelligence Observability Engineering, facilitating the... ...and Remediate Exposure to Platform Engineering, building AI capabilities...SeniorPart time- ...Description: We are seeking an experienced and motivated engineer to join the Observability fleet which focuses on delivering tools in private and public... ...role focuses on developing and modernizing Observability platforms for cloud-native and hybrid applications. This role...
$85k - $125k per year
...supported and engaged in doing so. We are seeking a Mid-Level Observability Engineer to help build, maintain, and enhance our enterprise... ...tuning, instrumentation, and operational reporting for critical platforms and applications. The ideal candidate will partner with Cloud...SeniorWork at office- Make AI platforms visible and dependable through OpenTelemetry, distributed tracing, and AWS observability engineering. This consulting engagement requires hands-on reliability expertise.As a... ..., CUR, and taggingExperience monitoring LLM or agent-based applicationsApply platform...Senior
- # Platform DevOps Engineer - Observability & ECSStackAdapt Inc. · Calgary, Alberta, CABack to resultsPlatform DevOps Engineer - Observability & ECSStackAdapt Inc.Calgary, Alberta, CA Posted November 3, 2026 Via JobLeads### Full Job DescriptionStackAdapt Inc. is seeking an Engineering...Internship
- Insight Global in Vancouver is seeking a Platform Engineer, Network Operations, to design and build internal developer platforms and core... ...teams to provision infrastructure safely. You will also build observability platforms, run DR tests, and lead incident response,...
- Appnovation, AI Product Company, seeks an experienced SRE/observability engineer to build and scale an internal agent platform on AWS Bedrock. You will implement OpenTelemetry instrumentation, connect with CloudWatch and Datadog-like tools, and define SLOs with actionable alerts...
- ...Plusgrade seeks a Senior Applied AI Developer to architect and productionize next-gen ML and LLM platforms for real-time, low-latency recommendation engines at scale. You will own the lifecycle of production models and build AI systems with AWS and Kubernetes. The role requires...Senior
- A global technology company in Waterloo is seeking a Manager, Software Engineering to lead high-impact teams focused on innovative solutions. The role requires strong leadership in an agile environment and a solid background in software development, particularly in C++ and...
- ...We are looking for a Senior Routing Engine Developer to design and build the next generation interaction routing platform powering enterprise-scale contact center operation. You will... ..., concurrency, security, privacy, observability, disaster recovery, and supportability....SeniorInternshipRemote workRelocation
$138.3k - $185.9k per year
...businesses and people. The Elastic Search AI Platform, used by more than 50% of the Fortune... ...solutions for search, security, and observability help organizations deliver on the promise... .... The observability clusters show Cloud engineers how production is behaving right now, and...SeniorLocal areaFlexible hours- Smart IT Frame LLC in Mississauga is seeking a senior Python engineer to design, build, and deploy AI/LLM applications using FastAPI or Flask, and to develop robust... ...for performance, drive scalable analytics platforms, and provide technical leadership to mentor engineering...Senior
- ...Tata Consultancy Services Canada is seeking a skilled Platform Engineer to design, implement, and automate enterprise-scale platform infrastructure. You will focus on reliability, observability, and performance across mission-critical applications. The role requires hands...
- Clio is seeking an experienced Director of Engineering to build and maintain a highly secure, scalable internal platform for tooling and LLM usage. You will lead from the front, implement infrastructure-as-code, and mentor managers and ICs across the engineering organization...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Llm Platform Observability Engineer. Be the first to apply!
Related searches
- senior disability case manager Winnipeg, MB
- senior hardware engineer Winnipeg, MB
- senior cook Winnipeg, MB
- amica senior lifestyles Winnipeg, MB
- senior building operator Winnipeg, MB
- senior project manager Winnipeg, MB
- senior communications Winnipeg, MB
- sr. IT support analyst Winnipeg, MB
- senior marketing Winnipeg, MB
- senior manager investigations Winnipeg, MB

