Senior Site Reliability Engineer (Remote Canada)

Senior Site Reliability Engineer – AI Operations

TechInsights is building the reliability and AI operations foundation for its next chapter — an AI-first intelligence platform that runs the most demanding semiconductor intelligence workflows in the world. We’re looking for a Senior Site Reliability Engineer who owns that foundation.

As a senior individual contributor at the technical leadership tier, you will own strategic reliability initiatives end‑to‑end: setting technical direction, defining SLOs and error budgets across our production platform, designing reliability patterns for AI agent pipelines, and enabling our development and AI Engineering teams to build and ship with confidence.

Platform Reliability & AI Operations

• Own SLOs, SLIs, and error budgets for all production services; drive error budget discipline across engineering.
• Design reliability patterns for AI agent pipelines: LLM observability, tool‑use tracking, failure detection, and graceful degradation.
• Architect blast radius containment so agent failures have bounded customer impact through isolation, circuit breaking, and rapid recovery.
• Mature our Canada Central/West active‑active architecture toward 24‑hour RTO with full regional failover.
• Lead incident response and post‑incident reviews that produce durable fixes; maintain DR procedures through regular testing.

Developer & AI Engineering Enablement

• Serve as the primary reliability liaison to Software and AI Engineering, translating requirements into actionable standards.
• Partner with AI Engineering on compute provisioning, model serving, inference latency, and workload isolation.
• Own CI/CD pipeline strategy (Bitbucket Pipelines, GitHub Actions) — set standards, optimize deployment frequency, and ensure teams can ship confidently.
• Drive IDP adoption and enable teams on SRE practices: on‑call readiness, SLO definition, runbook development, and self‑service tooling.
• Represent reliability in architectural discussions; surface risk before it’s committed to design.

Observability, IDP & Service Catalog

• Own the service catalog — a living inventory of all services, AI agents, dependencies, ownership, and SLOs.
• Operate Datadog as the single pane of glass for service health, infrastructure, and agentic pipeline telemetry.
• Extend observability to AI workloads: LLM latency, token consumption, agent completion rates, and pipeline throughput.
• Build golden path templates in Backstage or Atlassian Compass so teams ship reliably without routine SRE involvement.
• Apply AIOps in Datadog to automate anomaly detection, incident triage, and remediation recommendations.

FinOps, IaC & Continuous Improvement

• Own infrastructure as code via Terraform and GitOps; enforce IaC policy in partnership with Trust Assurance.
• Own FinOps visibility into AWS cost segments; model cloud cost impact as AI/ML workloads scale.
• Formally mentor junior and intermediate SRE engineers, with accountability for their technical growth and career progression.
• Build AI‑assisted automation to progressively reduce toil and scale the team's operational capacity.

What You’ll Bring

Technical Requirements

• Bachelor's degree in Computer Science, Engineering, or equivalent combination of education and experience.
• 6–8 years of progressive experience in site reliability engineering, platform engineering, or DevOps, with demonstrated technical leadership at the senior individual contributor level.
• Deep expertise in AWS (EKS, Lambda, CloudWatch, AWS Config) and multi‑region architecture patterns.
• Proficiency with Terraform and GitOps; experience with policy‑as‑code (Sentinel, OPA/Rego, or equivalent).
• Hands‑on Datadog experience at operational depth: dashboards, SLO tracking, alerting, log management, distributed tracing.
• Strong containerization expertise: Docker, Kubernetes (EKS preferred).
• Proficiency in Python and/or Bash; experience building operational tooling; solid understanding of Java and Spring Boot microservice architecture for EKS‑hosted services.
• Deep expertise in CI/CD pipeline design and optimization using Bitbucket Pipelines and GitHub Actions.
• Familiarity with IDP tooling (Backstage, Atlassian Compass, or equivalent) strongly preferred.
• Experience with AI/ML workload infrastructure, LLM API integration, or agentic system operations considered a strong asset.

Professional Skills

• Leads and owns strategic reliability initiatives end‑to‑end with a high degree of autonomy; accountable for outcomes.
• Sets technical direction and influences team and department strategy.
• Solves complex, ambiguous reliability problems through systematic analysis and first‑principles thinking.
• Formally mentors junior and intermediate engineers; builds team capability through coaching and knowledge transfer.
• Communicates technical reliability concepts clearly to engineering, product, and leadership audiences.
• Approaches operational work with an AI‑first posture: builds automation and intelligent tooling as the default.

Preferred Qualifications

• Experience designing reliability architecture for AI systems: agent loop observability, blast radius isolation, graceful degradation for LLM‑dependent services.
• AWS certifications: Solutions Architect Professional, DevOps Engineer Professional, or equivalent.
• FinOps Certified Practitioner or demonstrated cloud cost management experience at scale.
• IDP implementation or developer experience program leadership.
• Experience in semiconductor, SaaS, or data‑intensive platform environments.
• Experience operating in environments with export‑controlled or regulated data.
• Knowledge of BCP/DR program management and formal recovery testing.

Benefits

• Company‑sponsored training and development opportunities.
• Comprehensive benefits package (health, dental, vision, wellness, RRSP Matching, annual fitness reimbursement).
• Flexible vacation policy.
• Community involvement opportunities through charitable alliances.
• Wellness resources and support.
• Inclusive environment that prioritizes diversity, equity, and accessibility.
• High‑growth company driven by high performance.
• Salary range: $125,200 – $132,500 CAD.

Working Arrangement

This is a remote position for candidates based in Canada. Occasional travel may be required.

TechInsights is committed to building an inclusive environment that welcomes you to be your authentic self and allows us to push past the boundaries together.

TechInsights is committed to meeting the needs of people with disabilities. Accommodations are available on request for candidates taking part in all aspects of the selection process.