Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Ai Observability Engineer — Build & Govern Production Llms (Hybrid)

BMO

BMO Financial Group is seeking a Hybrid Senior AI Observability Engineer in Canada to design, build, and operate systems that track and evaluate non-deterministic AI models and agent workflows. You will trace LLM calls, monitor token usage, detect drift, and run automated evaluations in production.You should have 7–10 years of Site Reliability Engineering experience, strong automation and observability skills, and experience with Python, SQL, and telemetry tools (Prometheus, Grafana, Datadog).
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Ai Observability Engineer — Build & Govern Production Llms (Hybrid) in Winnipeg, MB vacancy
  • WiseMatic Inc. is seeking a Senior AI Developer to lead the design and delivery of...  ...for clients. You will architect production AI systems, build ML models, and ensure responsible AI practices. The role blends software engineering with practical AI judgement and mentorship... 
    Suggested
    Work at office

    WiseMatic Inc.

    Winnipeg, MB
    2 hours ago
  • Nesto Group in Canada is seeking a senior software engineer to lead AI-enabled features for Maestro, our AI underwriting and lending engine...  ...-based workflows, and optimize pipelines using Python and LLMs in production. The role emphasizes mentoring, architecture decisions, and... 
    Suggested
    Remote work

    Software Directory

    Winnipeg, MB
    2 hours ago
  •  ...for an Apps Development role focusing on GenAI technologies. The ideal candidate has 8-10 years of experience and strong expertise in LLMs, machine learning, and data science. You'll be responsible for deploying LLM-based applications and developing robust solutions using various... 
    Suggested

    Tekshapers

    Winnipeg, MB
    2 hours ago
  • Thomson Reuters is seeking a Senior Legal Engineer to design, build, and deploy AI-powered software for legal workflows. You will work with legal customers...  ..., mentor engineers, and collaborate across engineering, product, and legal partners to improve the software lifecycle.... 
    Suggested

    Thomson Reuters

    Winnipeg, MB
    2 hours ago
  • Fortiv Technical Inc. seeks an AI Engineer to build production-grade backend systems powering agentic AI workflows in a hybrid environment in Canada. You will design retrieval pipelines, evaluate LLM-powered applications, and collaborate with product and infrastructure teams... 
    Suggested

    Fortiv Technical Inc.

    Winnipeg, MB
    2 hours ago
  • A specialist AI consultancy in Canada is seeking a developer with extensive production Python experience to create innovative AI solutions...  ...financial services. You will build key analytics systems and AI-driven...  ...has a strong background in LLMs, deployed AI architectures, and... 

    Prospect 33

    Winnipeg, MB
    2 hours ago
  • $80k - $175k per year

     ...Family Group:Data Analytics & Reporting Hybrid role Designs, builds, and maintains systems that track, evaluate, and debug non-deterministic AI models and agent workflows. Trace LLM...  ...drift, set up automated evaluations, and govern autonomous agent behaviors in production... 
    Part time

    Aimlroles

    Winnipeg, MB
    2 hours ago
  •  ...Intercast Staffing Ltd. is seeking a Senior AI / Generative AI Engineer to design and deliver enterprise-grade AI...  ...growing Data & AI Marketplace. You will build, scale, and operationalize advanced AI systems in secure, governed Azure environments. The role focuses on delivering... 

    Intercast Staffing Ltd.

    Winnipeg, MB
    2 hours ago
  •  ...Altis in Toronto is seeking an Enterprise AI Engineer to lead AI adoption, development, and governance. The role collaborates with business leaders and IT across...  ...organization to deliver responsible AI solutions that raise productivity and innovation. You’ll design and deploy AI... 
    Remote work

    Altis

    Winnipeg, MB
    2 hours ago
  • $165k - $330k per year

     ...inference for the world's most dynamic AI companies, like Cursor, Notion,...  ...AI to bring cutting-edge models into production. We're growing quickly and recently raised...  ..., and Spark Capital. Join us and help build the platform engineers turn to ship AI products.About Baseten... 
    Flexible hours

    Baseten

    Winnipeg, MB
    2 hours ago
  • Join Honeycomb as a Software Engineer I, focusing on AI observability in a fully remote role. Contribute your software engineering expertise to enhance observability...  ...engineering role, your responsibilities will include building observability tools and contributing to data models that... 
    Remote work

    Candidate

    Winnipeg, MB
    2 hours ago
  • GEI is seeking an AI Engineer to develop AI solutions using pretrained models, Copilot technologies, and Azure-based tooling. You will build, deploy, and integrate AI capabilities into business workflows with a focus on security, scalability, and maintainability. You will collaborate... 

    Urban Ridge Supplies

    Winnipeg, MB
    2 hours ago
  •  ...Stingray Group in Montreal is seeking an AI Software Developer to design, build, and deploy AI applications and agentic systems. You will contribute to our agent platform, working with product and engineering teams to translate business needs into practical AI solutions.... 

    Newfoundland Capital Corporation Limited

    Winnipeg, MB
    2 hours ago
  •  ...will join a world-class team of engineers and data scientists from...  ...ranging from leading startups building impactful technologiesto Fortune...  ...building cutting-edge systems with LLMs and real-world data. In this...  ...to design, prototype, and productize scalable machine learning solutions... 
    Contract work
    Remote work

    Ample Insight Inc

    Winnipeg, MB
    2 hours ago
  •  ...RBC is seeking a Lead AI Engineer to design, develop, and implement AI-driven solutions within the software development lifecycle. You will...  ...to implement AI-powered automation, LLM-driven workflows, and governance frameworks, ensuring secure, scalable, and maintainable systems... 

    RBC

    Winnipeg, MB
    2 hours ago
  • Extend Tempo for AI and agent workloads through structured APIs, observability systems, and scalable engineering. Work remotely with modern coding assistants.As a Senior Engineer on Tempo, you will build capabilities for Grafana’s AI assistant, external integrators, and agent... 
    Remote work

    Grafana Labs

    Winnipeg, MB
    2 hours ago
  •  ...Ample Insight Inc. is seeking a Data Scientist to join a world-class team of engineers and data scientists in Toronto. You will work on real-world problems, building production-grade AI/ML systems and turning cutting-edge research into working prototypes. The role emphasizes... 

    Ample Insight Inc.

    Winnipeg, MB
    2 hours ago
  • Elevate your impact as an AI Engineer focused on Generative AI technologies and data science. Leverage...  ...RAG pipelines. Key Responsibilities: • Build LLM applications and tune models for...  ...technology roles • Hands-on with various LLMs including Google Gemini and OpenAI models... 

    Hallmark Global Solutions Ltd

    Winnipeg, MB
    2 hours ago
  • Okta seeks an Observability Engineer for the Auth0 Platform Observability team. You will monitor, observe, and improve the platform’s reliability, partnering with Product and Platform Engineers to ship software rapidly while strengthening instrumentation and telemetry across... 

    Okta Inc.

    Winnipeg, MB
    2 hours ago
  • Infosys in Mississauga, Ontario, seeks a hands-on Gen AI / Agentic AI Engineer to design, develop, and deploy next‑generation AI solutions using LLMs, RAG, and agentic frameworks in a production‑oriented setting. You will collaborate with product and data teams, apply MLOps... 
    Relocation

    Infosys

    Winnipeg, MB
    2 hours ago
  • BlueCat, Toronto, seeks a Product Manager to advance LiveNX and Network Synthetics across observability and DDI. You’ll partner with customers, engineering, design, and go‑to‑market teams to turn complex...  ...product management, a passion for AI-driven outcomes, and strong... 

    BlueCat

    Winnipeg, MB
    2 hours ago
  •  ...Closetech AI is seeking an AI Developer to design and build AI systems for client engagements and internal products, including PointO and Closetech EcoCore. You will balance rapid prototyping with production hardening to deliver reliable, scalable solutions. You’ll work... 

    CloseTechAi

    Winnipeg, MB
    2 hours ago
  •  ...leading manufacturer and distributor of air distribution products ( The founding principles of Price have never...  ...free Tea and Coffee. Position Summary Join our AI team as an Intermediate AI Engineer, where you'll build and deploy AI applications, agents, and automation... 

    Price Industries Limited

    Winnipeg, MB
    6 days ago
  • $105k - $120k per year

     ...applicant situations, and client-specific rules. Much of that work can now be built rather than staffed. We're hiring an AI Product Engineer to build those solutions. You will work primarily with Claude and similar tools to turn client problems into working product:... 
    Full time
    Casual work
    Remote work

    Urban Ridge Supplies

    Winnipeg, MB
    2 hours ago
  • NovoEd, Inc. is seeking a senior AI Engineer to design, build, and deploy production‑grade AI‑powered backend systems. The role emphasizes scalable LLM integration, vector database optimization, and high‑performance Python services. You will work across backend, AI inference... 

    NovoEd, Inc.

    Winnipeg, MB
    2 hours ago
  • A technology consulting firm in Canada seeks a Data Scientist with Machine Learning Engineer skills. This role involves exploring datasets, developing predictive models, and deploying machine learning models using frameworks like TensorFlow and PyTorch. Candidates should have... 
    Full time

    Tek Tron IT

    Winnipeg, MB
    2 hours ago
  •  ...Lead responsible AI adoption at YVR through digital governance, IT service management, and practical controls supporting safe airport operations. As Manager, Technology Services, you will oversee AI and digital tool governance across YVR. Reporting to the Director, Data... 

    Vancouver Airport Authority

    Winnipeg, MB
    6 days ago
  • Join as a Senior AI Engineer driving innovative solutions through expertise in LLMs and Retrieval-Augmented Generation. Leverage your knowledge in AI fundamentals to build scalable applications. The role requires 8-10 years of relevant experience in Apps Development or systems... 

    Tekshapers

    Winnipeg, MB
    2 hours ago
  • Production troubleshooting and observability define this experienced Site Reliability Engineer role with Porter in Toronto’s Downtown Office.You will improve reliability, scalability, and performance through code, monitoring, and operational tooling. The role partners with developers... 
    Work at office

    Porter Airlines

    Winnipeg, MB
    2 hours ago
  •  ...is seeking a Site Reliability Engineer to define day‑2 operations standards...  ...platform. You will build robust systems, automate mitigations, and develop observability tooling to keep services reliable...  ...engineering, forward‑deployed and product teams, turning recurring failures... 

    Baseten

    Winnipeg, MB
    2 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Ai Observability Engineer — Build & Govern Production Llms (Hybrid). Be the first to apply!