Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Analyst, Ai Performance & Reliability

WestJet

Position Overview:The Senior Analyst, AI Performance & Reliability is accountable for the health, performance and reliability of AI and machine learning solutions in production. The role monitors AI services and model behaviour, identifies emerging issues, coordinates incident response, and drives improvements that keep solutions stable, available, cost-effective and performing as expected.
The role provides ongoing visibility into service availability, latency, errors, usage, cost, data quality and output quality, including model drift and unexpected or inappropriate results. Working closely with AI / ML Developers, Data Scientists, platform teams, business owners, security and governance teams, the role helps ensure production AI and ML solutions can be trusted to operate consistently and recover effectively when issues occur.
Key Deliverables:
Accountable for keeping AI and ML solutions reliable, available and performing as expected through effective monitoring, incident management, troubleshooting, service recovery and continuous improvement.
Monitor AI and ML solutions in production, including availability, latency, errors, throughput, usage, cost, data quality and output quality.
Build and maintain dashboards, alerts, health checks and reusable monitoring patterns that provide timely visibility into solution health.
Detect model drift, data changes, degraded performance, unexpected outputs, harmful or inappropriate responses and other signs of service deterioration.
Work with business and technical owners to define reliability targets, service expectations, operational thresholds and escalation triggers.
Produce regular operational reporting and communicate material trends, risks and service issues to appropriate stakeholders.
Lead the investigation, triage and coordination of production incidents affecting AI and ML solutions.
Assess business and operational impact, establish incident priority, and coordinate response activities across technical and business teams.
Troubleshoot issues across applications, APIs, models, data pipelines, platforms and infrastructure to identify likely causes and required actions.
Coordinate with AI / ML Solutions Developers and platform teams when rollbacks, configuration changes, model replacements, fixes or redeployments are required.
Validate service recovery and confirm that the solution, monitoring controls and outputs are operating as expected.
Conduct post-incident reviews, document root causes and lessons learned, and track corrective and preventive actions to completion.
Maintain support procedures, runbooks, escalation paths, contact lists and recovery plans.
Identify and address risks that could affect solution reliability, availability, performance, resilience or recovery.
Improve monitoring coverage, alert quality, recovery practices, automation and operational support processes.
Assess production readiness and confirm that appropriate monitoring, support documentation, escalation processes and recovery procedures are in place before release.
Support capacity, performance and cost optimization by identifying constraints, inefficient usage patterns and emerging demand.
Partner with AI / ML Solutions Developers, Data Scientists and platform teams to prevent repeat incidents and improve solution supportability.
Contribute operational requirements and lessons learned to solution design, testing and lifecycle decisions.
Monitor model and AI output performance against defined technical, quality and business acceptance measures.
Identify changes in source data, knowledge sources, user behaviour or business conditions that may affect solution performance.
Analyze feedback, exceptions and performance trends to determine when investigation, correction, tuning or retraining may be required.
Escalate identified model or output concerns to the accountable solution, model, business and governance owners.
Maintain traceable records of identified issues, thresholds, findings and follow-up actions.
Monitor production safeguards and elevate material reliability, privacy, security, responsible AI, model risk or compliance concerns.
Support operational evidence, reporting and documentation required for governance reviews, audits and oversight.
Confirm that access, logging, monitoring and incident-management practices follow approved enterprise requirements.
Help define and improve reliability standards, service-health measures, operational controls and reusable monitoring practices.
Promote consistent incident, problem-management and continuous-improvement practices across AI teams.
Use monitoring, incident, usage, cost and feedback data to identify opportunities to improve reliability, performance and supportability.
Identify recurring issues and coordinate longer-term corrective actions with solution and platform owners.
Share operational insights, lessons learned and emerging risks with technical teams, business owners and leadership.
Contribute to operational reviews, reliability planning, knowledge sharing and the ongoing maturity of AI / ML operations.
Communicate technical issues and service impacts clearly to both technical and non-technical stakeholders.
Experience and Qualifications:
Bachelor's degree in Computer Science, Engineering, Data Science, Information Systems or a related field, or equivalent practical experience.
Relevant certifications in cloud platforms, observability, site reliability, IT service management, AI or machine learning are considered an asset.
4+ years experience supporting production systems, AI solutions, ML platforms, data products or cloud-based services.
Experience with monitoring, observability, logging, alerting and incident-management tools and practices.
Experience troubleshooting applications, APIs, data pipelines, infrastructure or distributed cloud services.
Experience investigating production incidents, coordinating recovery and contributing to root-cause analysis and preventive actions.
Experience using operational data and service metrics to identify trends, risks and improvement opportunities.
Experience working with multidisciplinary technology and business teams in a production support environment.
Understanding of model monitoring, drift detection, data quality, AI output evaluation and changing production conditions.
Understanding of reliability, availability, performance, resilience, capacity, recovery and service-management practices.
Knowledge of service-level indicators, service expectations, operational thresholds and effective alert design.
Ability to analyze logs, metrics, traces, model results and other technical evidence to diagnose complex issues.
Familiarity with cloud platforms, APIs, containers, data pipelines and AI / ML solution architectures.
Familiarity with security, privacy, responsible AI, model risk, governance and audit requirements.
Strong analytical, problem-solving, prioritization and decision-making skills.
Strong communication, coordination and documentation skills, particularly during high-priority incidents.
Ability to work calmly and effectively across a matrixed environment when service issues require rapid coordination.
What Success Looks Like
Production issues are detected early, assessed accurately and resolved quickly.
AI and ML solutions consistently meet defined reliability, availability, performance and output-quality expectations.
Model drift, data-quality issues, unexpected outputs and service degradation are identified before they create significant business impact.
Monitoring provides clear, actionable visibility into solution health, usage, cost and emerging risk.
Incident response, escalation and recovery processes are understood, documented and effective.
Root causes are addressed and repeat incidents decrease over time.
Operational risks and material privacy, security, responsible AI or compliance concerns are escalated promptly.
Business users and solution owners can rely on AI and ML services to operate consistently and effectively.
Operational insights lead to measurable improvements in reliability, resilience, performance and supportability.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Senior Analyst, Ai Performance & Reliability in Winnipeg, MB vacancy
  •  ...Senior Evaluation and Performance Analyst Department: Executive and Indigenous Affairs This Job Opening is limited to employees with the GNWT/WSCC in indeterminate and term positions. The Department of Executive and Indigenous Affairs works to provide overall management... 
    Senior
    Performance
    Long term contract

    gov

    Winnipeg, MB
    11 days ago
  •  ...insight they need to deliver faster, more performant, more dependable, and less expensive Java...  ...is built on LLVM. We are looking for a Senior Compiler Performance Engineer to own major...  ...compensation We may use artificial intelligence (AI) tools to support parts of the hiring... 
    Senior
    Performance
    Remote work
    Worldwide
    Flexible hours

    Azul

    Winnipeg, MB
    11 days ago
  • $20 per hour

     ...household tasks such as light cleaning and meal preparation. We are seeking someone with previous experience in infant care, who is reliable, compassionate, and attentive to detail. Potential option for overtime (ie. 10 hour days) based on candidate's interest. Please send... 
    Suggested
    Hourly pay
    Full time
    Live out

    CanadianNanny.ca

    Winnipeg, MB
    10 days ago
  •  ...also offers infrastructure development through NFI Infrastructure Solutions, a service dedicated to providing safe, sustainable, and reliable charging and mobility solutions. Further information is available at . POSITION SUMMARY: The successful candidate will support... 
    Senior
    Full time
    Internship
    Immediate start

    New Flyer

    Winnipeg, MB
    a month ago
  •  ...organization and our culture of Relentless Performance has enabled over 99% of Miratech's...  ...Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain...  ...technical challenges, improve solution reliability, and drive continuous platform enhancements... 
    Senior
    Performance
    Full time
    Internship
    Remote work
    Relocation

    Miratech

    Winnipeg, MB
    10 days ago
  • $22 per hour

    Looking for a responsible and caring nanny to join our family in Winnipeg, Manitoba. We have an infant and a primary school-aged child and require assistance on a part-time, live-out basis. The role will involve childcare, including meal preparation and housekeeping duties. ...
    Hourly pay
    Part time
    Live out

    CanadianNanny.ca

    Winnipeg, MB
    20 days ago
  • $20 per hour

    ****If you do not have a photo uploaded on your profile and/or do not speak reliable English please do not apply. Due to my daughter's health concerns I need a person who can fully communicate in English. **** Seeking a responsible and nurturing nanny to join our family in... 
    Hourly pay
    Part time
    Live out

    CanadianNanny.ca

    Winnipeg, MB
    2 days ago
  •  ...Drive AI innovation as a Senior AI Engineer in Mississauga, Canada. Craft Python-based AI applications using FastAPI or Flask while optimizing performance and scalability for enterprise solutions. We are seeking an experienced Senior AI Engineer with over 8 years in software... 
    Senior
    Performance

    Talentola

    Winnipeg, MB
    11 days ago
  • $75.5k - $125k per year

     ...Permanent Full Time  - We are hiring a Senior IT Business Systems Analyst. This is a hybrid role located in London, Toronto or Winnipeg. Reporting...  ...under time pressure without compromising quality. Reliability Status security clearance - this is a personnel security... 
    Senior
    Permanent employment
    Full time
    Part time
    Internship
    Flexible hours

    Canada Life

    Winnipeg, MB
    11 days ago
  •  ...Salesforce, the leading AI CRM, seeks a Senior Technical Consultant to drive enterprise deployments and AI-driven delivery. You'll partner with clients and internal teams to define architectures, implement solutions, and manage release cycles across desktop, cloud, and mobile... 
    Senior

    Leadout Capital

    Winnipeg, MB
    11 days ago
  •  ..., whatever removes the constraint. We are heavy AI users and we expect you to build, not just prompt...  ...on this team is very good and that is not an accident. You will grow into senior strategy. We want people who want more responsibility. If you perform, you will grow.... 
    Senior
    Performance
    Remote work
    Worldwide
    Shift work

    Sweat Pants Agency

    Winnipeg, MB
    6 days ago
  •  ...settlement, reconciliation, and ISDA documentation. Support accurate processing while mitigating operational risk. GTT seeks a Senior Derivatives Analyst for its Derivatives Operations team. You will support OTC and cleared derivatives across lifecycle events, cashflow... 
    Senior
    Remote work

    Global Technical Talent

    Winnipeg, MB
    11 days ago
  •  ...How You’ll Make an Impact As a Senior Technical Analyst, Data Engineering and Business Intelligence...  ...-based processes, improve data reliability and enable self-service analytics through...  ...related to competitor analysis, performance reporting, risk ratings, fund comparisons... 
    Senior
    Performance
    Work at office
    Flexible hours

    Fidelity International

    Winnipeg, MB
    11 days ago
  •  ...testing of new business systems and system enhancements to ensure performance meets specifications. Facilitating and engaging participants...  ...solutions that are safe, accessible, e­fficient and reliable. NFI Group is a leading independent global bus manufacturer... 
    Performance
    Full time
    Temporary work

    Motor Coach Industries

    Winnipeg, MB
    1 day ago
  •  ...Whitecliffe Global is seeking a senior performance marketer to set paid media strategy for its international campuses. You will direct multiple agencies, allocate budgets by market, and tie media spend to enrolments using GA4 and offline conversion tracking. You will connect... 
    Senior
    Performance

    Financial Edge

    Winnipeg, MB
    11 days ago
  •  ...Business Intelligence Analyst Location: Winnipeg, MB (Onsite)...  ...We design and build high-performance, chassis-mounted mechanical sweepers...  ...for their fuel efficiency, reliability, and low cost of ownership. Our...  ...working directly with ODRA's senior leadership team and company... 
    Senior
    Performance
    Full time
    For contractors

    ODRA Road Sweepers

    Winnipeg, MB
    13 days ago
  •  ...people. Our dependable quality, reliable delivery, and knowledgeable...  ...Coffee. Reporting & Process Analyst Campus: 638 Raleigh St., in...  ...understand how work is actually performed, identify opportunities to...  ...and apply opportunities to use AI, agents and automation tools to... 

    Price Industries Limited

    Winnipeg, MB
    11 days ago
  • Requisition ID: 413673 Position Number: 20088929 Posting End Date: November 11, 2026 City: Winnipeg Employer: Shared Health Site: Shared Health - Health Sciences Centre Department / Unit: Clinical Engineering Asset Management Job Stream: Non-Clinical Union: Non Union Anticipated...
    Performance
    Full time
    Immediate start
    Shift work

    Winnipeg Regional Health Authority

    Winnipeg, MB
    19 days ago
  • $59.8k - $99.7k per year

     ...Permanent Full Time The Senior Financial Reporting Analyst supports SAP-related business, accounting and financial reporting processes within Lifeco Global across Canada, Europe (UK, Germany, Ireland, Reinsurance), and the US. The role provides oversight on processes, recommends... 
    Senior
    Permanent employment
    Full time
    Part time
    Internship
    Work at office
    Flexible hours

    The Canada Life Assurance Company

    Winnipeg, MB
    23 days ago
  •  ...commitment to people. Our dependable quality, reliable delivery, and knowledgeable follow-up...  ...offers free Tea and Coffee. Solution Analyst – Supply Chain Management Location: Winnipeg...  ...when necessary. • Monitor solution performance, user adoption and key operational... 
    Performance
    Long term contract

    Price Industries Limited

    Winnipeg, MB
    7 days ago
  •  ...Pinterest is seeking a Senior Data Scientist to shape the future of people-facing and business-facing products. You will apply quantitative...  ...others. You will build and prototype analysis pipelines, leverage AI to accelerate execution, and communicate insights to cross-functional... 
    Senior

    Pinterest

    Winnipeg, MB
    11 days ago
  • $27 per hour

     ...Best Employers for Women in 2026 and recognized by Newsweek as one of the World's Most Trustworthy Companies in 2026. About Channel Performance: The Channel Performance Service Line is home to the largest mystery shopping agency in the world.  We complete over one million... 
    Performance
    Hourly pay
    Permanent employment
    For contractors
    Second job
    Remote work
    Worldwide
    Monday to friday
    Flexible hours

    Ipsos

    Winnipeg, MB
    19 days ago
  •  ...Paradigm has opportunities for Business Analysts (Intermediate or Senior) to employ their knowledge, skills and techniques to deliver and implement...  ...requirements, report development, and testing activities Perform quality assurance to ensure accuracy, integrity, and functionality... 
    Senior
    Full time
    Contract work
    Remote work

    paradigmconsulting

    Winnipeg, MB
    8 days ago
  •  ...commitment to people. Our dependable quality, reliable delivery, and knowledgeable follow-up...  ...of that. Job Summary A Business Analyst (BA) acts as the connector between business...  ...organizational goals and enhance overall performance. The Successful candidate's responsibilities... 
    Performance
    Work at office

    Price Industries Limited

    Winnipeg, MB
    11 days ago
  • Measure AI model performance at Movable Ink in a senior analytics role focused on Python, SQL, and scalable monitoring. Build diagnostics supporting personalized marketing.As Senior Data Analyst, you will connect deployed AI models with high-impact digital marketing. You will... 
    Senior
    Performance

    Movable Ink

    Winnipeg, MB
    1 hour ago
  •  ...commitment to people. Our dependable quality, reliable delivery, and knowledgeable follow-up...  ...Coffee. Position Summary Join our AI team as an Intermediate AI Engineer, where...  ...and optimize models and applications for performance, reliability, and scalability. •... 
    Performance

    Price Industries Limited

    Winnipeg, MB
    11 days ago
  •  ...opportunities for Healthcare Business Analysts (Intermediate or Senior) to employ their knowledge, skills...  ...the skillset may include: ~5+ years performing analysis on current state and future...  ...development, and testing activities Perform quality assurance to ensure accuracy,... 
    Senior
    Contract work
    Remote work

    paradigmconsulting

    Winnipeg, MB
    3 days ago
  •  ...procedures. Additionally, the AP Payments Analyst is required to respond to internal and...  ...Timely and accurate payment of vendors Performance of vendor statement reconciliations in...  ...stakeholders Self-motivated with proven reliability Excellent customer service skills... 
    Performance
    Full time

    The Boyd Group Inc.

    Winnipeg, MB
    8 days ago
  •  ...Senior Financial Analyst   Location: Alberta, Canada  Job Type: Contract / Temporary  Experience: 7+ Years of Progressive Financial Experience...  ...review financial statements and accompanying notes.  ~ Perform complex financial statement and variance analysis.  ~... 
    Senior
    Contract work
    Temporary work

    Compu-Vision Consulting Inc.

    Winnipeg, MB
    18 days ago
  •  ..., Tax, Technology, Analytics, AI, and Business Transformation....  ...two Finance Business Systems Analyst positions. Both roles partner...  ...Role Focus - Oracle Enterprise Performance Management (EPM): Strategic planning...  ...that are safe, accessible, reliable, and sustainable. Whether you'... 
    Performance
    Permanent employment
    Full time
    Work at office
    Immediate start
    Monday to friday

    NFI Group Inc.

    Winnipeg, MB
    a month ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Analyst, Ai Performance & Reliability. Be the first to apply!