Senior LLM Platform Observability Engineer
Aimlroles
This position requires local presence. Please view similar jobs below.
Shape LLM platform observability at BMO, using OpenTelemetry, Prometheus, and Grafana in a hybrid engineering environment.
The Senior AI Engineer builds capabilities for tracing agent workflows and managing production AI behavior. Responsibilities include capturing spans, prompts, tool calls, and intermediate outputs, while controlling token costs and log cardinality. You will also standardize pipelines, configure dashboards, and support automated anomaly detection and incident response.
Key Responsibilities:
- Implement OpenTelemetry-based agent tracing frameworks
- Capture prompts, spans, tools, and outputs
- Build telemetry strategies for token optimization
- Configure logging sidecars and centralized dashboards
- Replace static thresholds with anomaly detection
Requirements:
- Bachelor's degree in Computer Science or Engineering
- Seven to ten years of Site Reliability Engineering experience
- Experience automating detection, investigation, and remediation
- Python experience for custom evaluations
- SQL or LogQL/PromQL querying experience
Use LLM tracing, platform engineering, and intelligent monitoring to govern BMO’s autonomous AI workflows.
#J-18808-LjbffrVacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior LLM Platform Observability Engineer in Toronto, ON vacancy
$135k - $150k per year
...Kinross is a Canadian-based senior gold mining company with operations... ...our global technology platforms to enable secure, scalable, and... ...and hands-on Senior Platform Engineer to drive the evolution of our... ...platforms, automation frameworks, observability tooling, and enterprise...SeniorLong term contractTemporary workCasual workLocal areaImmediate startRemote work$140k - $192.5k per year
...If you are too, let's talk. The Auth0 Platform Observability team owns the observability tooling that... ...we are looking for an Observability Engineer to help ensure our Product and Platform... ...and development in these areas. As a Senior Engineer on this team, you will act as...SeniorLocal areaWorldwide$113k - $163k per year
...As a Senior Platform Engineer, you will build and operate the shared platform that application teams use to deploy and run services on Azure Kubernetes... ...to validate recovery capabilities. Integrate observability, service-level indicators, service-level objectives, release...SeniorLong term contractTemporary workLocal areaFlexible hours$140k - $192.5k per year
...If you are too, let's talk. The Auth0 Platform Observability team owns the observability tooling that... ...we are looking for an Observability Engineer to help ensure our Product and Platform... ...and development in these areas. As a Senior Engineer on this team, you will act as...SeniorLocal areaWorldwide$111.4k - $161.4k per year
...Senior Software Engineer, Search Platform Our vision We are building the next-generation search platform, with a vision to democratize knowledge construction... ...explicit latency budgets, and result payloads sized for LLM context windows. Contribute to the move from...SeniorFull timeWork at officeLocal areaFlexible hours$136k - $187k per year
...If you are too, let's talk. The Auth0 platform secures more than 100 million logins each... ...Platform Infrastructure team enables Auth0 engineers to move faster by giving them tools to... ...resiliency, scale, and cost. Use observability tools like DataDog and Prometheus to design...SeniorLocal areaRemote workWorldwide$100k - $145k per year
...Job Description As a Machine Learning Engineer, you will build and deploy production machine learning and large language model (LLM) systems that extract actionable insights from complex legal documents and data. You will work on challenging natural language processing problems...SeniorFull timeWork at officeLocal areaRemote workFlexible hours$95k - $145k per year
...Employment Type: Full-Time CGI is seeking an experienced Senior Platform Engineering Specialist to join our growing Platform Engineering consulting... ...enable self-service infrastructure, application delivery, observability, automation, and software delivery. Contribute to...SeniorLong term contractPermanent employmentFull time- ...advantage. Cresta’s unified AI platform combines conversational AI... ...for strong versatile backend engineers who want to work at the intersection... ..., low latency, and strong observability for real-time conversation... ...AI Agents, Virtual Agents, or LLM-based systems is a plus. ~...SeniorLong term contractWork at officeLocal areaRemote workWork from homeHome office
usd190.5k - usd262k per year
...Faire Faire is a technology wholesale platform built on the belief that the future is... ...fast Faire can move. We’re hiring a Senior Engineering Manager to lead Faire’s Analytics Platform... ...cost tracking for workloads Build AI/LLM-powered tooling and automation that make...SeniorLong term contractWork at officeLocal areaRemote workWork from homeMonday to fridayFlexible hours3 days per week$137k - $165k per year
...Combined with industry leading AI, the Motive platform gives you complete visibility and... ...to learn more. About the Role Senior engineer who ships production software and AI systems... ...for apps and model pipelines. Own observability and incident response; partner on SOC 2...SeniorLong term contractTemporary work$227k - $420k per year
...They're responsible for ensuring every observable event—errors, logs, traces, tokens—gets... ...works cross-functionally with product, engineering, BizOps, marketing, and sales to build systems... ...models. About the role As a Senior Software Engineer, you will architect and...SeniorHourly payFull timeFlexible hours- .... About the Role We are seeking a versatile and experienced engineer to join our Inference Core Model Bringup team. This team is responsible... ...main reasons they joined Cerebras: # Build a breakthrough AI platform beyond the constraints of the GPU. # Publish and open source...Full time
- ...do this by building an industry-leading incident management platform that allows companies around the world to consistently and quickly... ...in our weekly changelog . About the Role As a Senior Platform Engineer focused on datastores, you'll be the team's expert on PostgreSQL...SeniorFull timeInternshipHome office
- ...We are looking for a Senior Java Developer with LLM expertise to lead the technical design, development... ...wider developer group adopts AI-assisted engineering. Working Model: This is a hybrid... ...event-driven workflows using streaming platforms such as Kafka. Ensure solutions...SeniorInternshipWork at officeRemote workRelocation2 days per week
$194k - $266k per year
...internal tools used to manage our global network. These Kubernetes platforms are purpose-built from the ground up and run on bare metal Linux... ...this platform helps run parts of the global Internet. As an engineer on the Kubernetes platform team, you'll be building the tools to...SeniorLong term contractFull timeTemporary workInternshipLocal areaFlexible hours$95k - $145k per year
...Montreal Preferred Languages: Bilingual (English/French) Preferred Employment Type: Full-Time CGI is seeking an experienced Senior Data Platform Engineering Specialist to join our growing Data Platform Engineering consulting practice within the Emerging Technologies team. As a...SeniorLong term contractPermanent employmentFull time$136k - $187k per year
...mission. If you are too, let's talk. The Platform Network Engineering Team Auth0 by Okta is an easy-to-... ...can focus on innovation. The Senior Software Engineer Opportunity You... ...service-to-service communication, observability, and security. Knowledge of Istio/...SeniorLocal areaWorldwideFlexible hours- ...We are looking for a Senior Routing Engine Developer to design and build the next generation interaction routing platform powering enterprise-scale contact center operation. You will... ..., concurrency, security, privacy, observability, disaster recovery, and supportability....SeniorInternshipRemote workRelocation
- ...We are looking for a Senior Programmable Voice Engineer to develop programmable voice capabilities, call control... ...similar to Twilio and other CPaaS platforms. The role includes designing and... ...performance, concurrency, security, privacy, observability, disaster recovery, and...SeniorInternshipRemote workRelocation
- ...About Zip Zip is the AI platform for enterprise procurement — built for humans and agents working together. By orchestrating procurement... ...Business, and LinkedIn Top Startups. Your Role As a Senior Software Engineer on the Developer Platform team, you will be responsible for...SeniorFull timeImmediate startRemote workHome officeFlexible hours
$136k - $187k per year
...safely use any technology, and within Okta Platform R&D, we're specifically focused on... ...an experienced full stack Staff Software Engineer (with a focus on UI) who is passionate about... ...proactively sharing knowledge, mentoring Senior Engineers, and establishing best practices...SeniorLong term contractLocal areaWorldwide$170k - $220k per year
...We are looking for a Senior Software Engineer to help build NeMo Platform, NVIDIA’s product for developing, evaluating, deploying, and operating AI systems... ...class agentic coding tools Improving reliability, observability, debuggability, and performance across NeMo Platform...SeniorFull timeLocal areaFlexible hoursusd108k per year
...looking for passionate, driven engineers to build systems that empower... ...environment. The Growth Platforms team owns both the Incentives... ...with moderate guidance from senior engineers Write clean, reliable... ...team's broader testing and observability practices Address...SeniorHourly payWork at officeFlexible hours3 days per week$80k - $105k per year
...and replace cars. Could you be the full-time Cybersecurity Platform Engineer in Toronto, ON, we’re looking for? Your future role Take... ...award-winning learning opportunities Progress towards senior leadership roles or specialized technical roles, depending on...SeniorLong term contractFull timeWorldwideFlexible hours- We are looking for a hands-on BI Platform Operations Engineer to provide production operational support... ...Monitoring & Observability · Use Amazon... ...Advanced Seniority Senior...SeniorFor subcontractor
- ...Cloud Platform Engineer – AWS, Python, DevOps & AI/LLM Required Skillsets: • 3–5+ years of hands-on CI/CD, cloud, and platform engineering... ...management, tool use, agent architectures, evaluation, observability, and reliability. • Experience with Git-based...Permanent employment
- ...-leading incident management platform that allows companies around... ...Role As a Staff Platform Engineer, you'll set the technical direction... ...way. Set the standard for observability across Rootly, and define... ...of our own product. Mentor senior engineers, write the design...SeniorFull timeInternshipHome office
$165k - $200k per year
...Role Overview As a Principal Engineer within the Global Transaction... ...build the next-generation GTB Platform. This is not a strategy-only... ...with technology executives, senior leaders, and engineers, you will... ...Support monitoring, observability, and signal management initiatives...SeniorFull timeWork from home$136k - $187k per year
...We're all in on this mission. If you are too, let's talk. Senior Software Engineer, Security Engineering Okta is The World’s Identity Company... ...any device or app. Our flexible and neutral products, Okta Platform and Auth0 Platform, provide secure access, authentication, and...SeniorLocal areaWorldwideFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior LLM Platform Observability Engineer. Be the first to apply!
Related searches
- senior disability case manager Toronto, ON
- senior hardware engineer Toronto, ON
- senior cook Toronto, ON
- amica senior lifestyles Toronto, ON
- senior building operator Toronto, ON
- senior project manager Toronto, ON
- senior communications Toronto, ON
- sr. IT support analyst Toronto, ON
- senior marketing Toronto, ON
- senior manager investigations Toronto, ON