Member Of Technical Staff (Site Reliability Engineer, Crawler)
Maven Ventures
Keeping a crawler running is not the same as keeping it productive. Queues can grow while servers look healthy, and a small change can become a fleet-wide bottleneck. On Perplexity's Crawler team, you'll improve throughput, plan capacity, and build operational reliability through safer deployments, better observability, and durable fixes.
Responsibilities
Operate and optimize Kubernetes workloads and supporting infrastructure for crawler services, including fetching and rendering fleets.
Build and maintain infrastructure as code and CI/CD pipelines, with safe rollouts, validation, and fast rollback.
Define SLOs and build monitoring, alerting, and observability for availability, latency, throughput, and resource saturation.
Own capacity planning and resource efficiency;
diagnose queue backlogs, network failures, and resource bottlenecks with service owners.
Participate in the team's on-call rotation, lead incident response, and turn blameless postmortems into durable reliability improvements.
Write production software to automate diagnosis and routine remediation, with validation and approval gates for high-impact actions.
Qualifications
5+ years of experience in SRE, production engineering, or infrastructure-heavy backend roles, with strong programming skills in Python, C++, Rust, or Go.
Hands-on experience with cloud infrastructure, production Kubernetes, infrastructure as code such as Terraform, and automated deployment workflows.
Strong Linux and networking fundamentals, including TCP/IP, DNS, TLS, and load balancing.
Experience building observability with tools such as Datadog, Prometheus, or Grafana, and using SLOs to guide reliability improvements.
Proven experience diagnosing distributed-system failures, leading production incidents, and improving system performance or resource efficiency.
Nice to have
Experience operating web crawlers, search infrastructure, or browser fleets at scale.
Experience with distributed queues, backpressure, workload isolation, or multi-region recovery.
#J-18808-Ljbffr
Responsibilities
Operate and optimize Kubernetes workloads and supporting infrastructure for crawler services, including fetching and rendering fleets.
Build and maintain infrastructure as code and CI/CD pipelines, with safe rollouts, validation, and fast rollback.
Define SLOs and build monitoring, alerting, and observability for availability, latency, throughput, and resource saturation.
Own capacity planning and resource efficiency;
diagnose queue backlogs, network failures, and resource bottlenecks with service owners.
Participate in the team's on-call rotation, lead incident response, and turn blameless postmortems into durable reliability improvements.
Write production software to automate diagnosis and routine remediation, with validation and approval gates for high-impact actions.
Qualifications
5+ years of experience in SRE, production engineering, or infrastructure-heavy backend roles, with strong programming skills in Python, C++, Rust, or Go.
Hands-on experience with cloud infrastructure, production Kubernetes, infrastructure as code such as Terraform, and automated deployment workflows.
Strong Linux and networking fundamentals, including TCP/IP, DNS, TLS, and load balancing.
Experience building observability with tools such as Datadog, Prometheus, or Grafana, and using SLOs to guide reliability improvements.
Proven experience diagnosing distributed-system failures, leading production incidents, and improving system performance or resource efficiency.
Nice to have
Experience operating web crawlers, search infrastructure, or browser fleets at scale.
Experience with distributed queues, backpressure, workload isolation, or multi-region recovery.
#J-18808-Ljbffr
Vacancy posted 32 minutes ago
Similar jobs that could be interesting for youBased on the Member Of Technical Staff (Site Reliability Engineer, Crawler) in Winnipeg, MB vacancy
- Perplexity is hiring a Web Access Engineer for the Crawler team to build reliable fetching and rendering systems for AI-powered search. You'll work on freely available public web content, within site permissions and approved access policies, and develop the infrastructure that...Suggested
- Improve crawler throughput with Kubernetes operations and observability on Perplexity’s Crawler team. Build safer deployments and durable reliability fixes for production services.As a Site Reliability Engineer, you will operate fetching and rendering fleets while improving...Suggested
- ...position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Staff Engineer, Site Reliability based in Canada. We are looking for a Staff Site Reliability Engineer to shape the reliability, security, and...SuggestedLong term contractInternshipLocal areaRemote workHome officeFlexible hoursWeekend work
$140k per year
...information.This is a hands-on senior engineering role focused on improving... ...teams to ship secure, reliable, and scalable software with confidence... ...cloud-native technologies, site reliability engineering... ...communication, collaboration, and technical leadership...SuggestedPermanent employmentFull timeInternshipRemote workFlexible hours$109.4k - $191.5k per year
It all started when engineer Fred Luddy wrote code that automated a... ...completion of a Government of Canada Reliability Status screening as a... ...SRE team is a group of highly technical engineers responsible for... ...engineering teams. The RoleAs a Staff SRE, you'll set the technical...SuggestedPermanent employmentContract workManual laborWork at officeImmediate startRemote workFlexible hoursShift work- ...position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Staff Site Reliability Engineer – Networking based in Canada. In this senior technical role, you will define and lead networking strategy across a...Long term contractRemote workWorldwide
- ...Join a growing financial technology organization where your engineering expertise will make a meaningful difference in how schools across... ...North America manage their financial operations. As a Staff Site Reliability Engineer, you'll have the opportunity to take real ownership...Full time
- ...Development & Operations (PDO) organization as a cornerstone of our Site Reliability Engineering team. We are the architects of stability for the Guidewire... ...can depend on our mission-critical applications. As a Staff Site Reliability Engineer, you aren't just maintaining systems...Long term contractFull timePart timeWork at office
- Shape the future of financial operations as a Staff Site Reliability Engineer at a leading organization. Leverage your expertise with Microsoft Azure to enhance platform reliability and drive innovation. You will take real ownership of platform reliability, engaging in hands...
$132.5k - $165k per year
...technology organization is looking for a Staff DevOps Engineer to take ownership of the cloud... ...processing high-volume telemetry to ensuring reliable, continuous operations.You'll have significant... ..., making this a role with genuine technical depth, ownership, and long-term impact....Long term contractFull time- ...experienced and versatile software engineer to work on the tools and... ...work across projects and technical domains, joining teams or existing... ...layers, improving reliability, performance, observability,... ...applications from everyone, including members of all equity‑seeking communities...Long term contractImmediate startHome office
- ...our small but mighty team of engineers all report directly to the CTO... ..., with remote team members in Nova Scotia, New Brunswick... ...and cloud infrastructure.Build reliable, event-driven pipelines that... ...You balance pragmatism with technical excellence, and you know which...InternshipWork at officeRemote workFlexible hours
$220k - $405k per year
...Perplexity is seeking strong engineers with a passion for delivering... ...scaling these interfaces. As a member of our team, you'll work on... ...alike. You'll also define technical strategy for how we scale to... ...Harden system security and reliability across heterogeneous compute...Contract work- ...effectively with cross-functional teams to understand requirements and provide technical guidance. What We're Looking For (qualifications) MS/PhD in Computer Science, Electrical Engineering or a related field with a focus on computer vision. Proven research experience...Remote workNight shift
$144k - $200k per year
Platform Engineering is the department within SRE that is responsible for a range of critical infrastructure and operational functions that... ...and maintains our continuous delivery infrastructure, ensuring reliable code deployment from development through production for all...WorldwideFlexible hours$100k - $150k per year
...excel and make a profound global impact. We are seeking a Site Reliability Operations Technical Lead to serve as the senior technical individual... ...teams, and provides technical leadership to site support engineers. Be responsible for the hardest issues across Active Directory...Permanent employmentWork at officeLocal areaRelocation- Perplexity is seeking a Web Access Engineer for the Crawler team to build reliable fetching and rendering systems powering AI-powered search. You will diagnose network and rendering issues, implementing production fixes that improve content quality at scale. You will investigate...
$140k - $240k per year
Location: Toronto (Office) On-site | Full-time Compensation: $140K - $240KThe Role: Member of Technical Staff (Applied AI) The Senior Applied AI Engineer will play a pivotal role in defining how AI agents navigate the web. This individual will focus on building open-source...Full timeInternshipWork at office$250k per year
...value they drive for ourcustomers. Cohere is a team of researchers, engineers, designers, and more, whoare all passionate about their craft.We... ...tools to help Cohere'smission of providing efficient and reliable language understanding andgeneration capabilities and drive innovation...Full timeWork at officeLocal areaRemote workHome office$160k - $210k per year
...Cockroach Continuum. We're looking for a staff software engineer to help build out the Migration... ...database teams.Take part in a collaborative, technically rigorous culture, and help shape... ...projects.After 3 months, you’ll be a full member of the team, contributing to the MOLT...InternshipWork at officeLocal areaRemote workWorldwideFlexible hours- ...portfolio of business, technology, and engineering services and solutions is delivered... ...than by you.Change and Release reliability:Design and operate change management... ...and bot management that protects the site without blocking the crawlers you need.A real observability practice...
$125.45k - $175.45k per year
It all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker, Phyllis. She cried tears of joy... ...Join us to put AI to work for people. Role OverviewAs a Staff Site Reliability Engineer supporting our Canada Protected B regulated cloud environment...Permanent employmentWork at officeImmediate startRemote workMonday to fridayFlexible hoursShift workNight shiftDay shiftAfternoon shift- The SRE will focus on ensuring reliable, resilient systems through task automation, observability... ...in on-call rotation with global team members, ensuring responsiveness during agreed... ...dependencies. Identify and prioritize technical debt impacting client satisfaction or operational...
- ...forward.YOUR CONTRIBUTION TO MAKING A POSITIVE IMPACT As a Site Reliability Engineer (SRE), you will help ensure the availability, performance,... ...service reliability. You will also act as a Level 3 technical expert, supporting Project teams with complex issues related...Long term contractPermanent employmentFull timeFixed term contractInternshipRemote workWork visaFlexible hours
- Job SummaryPorter is hiring an experienced Site Reliability Engineer to help improve the reliability, scalability, and performance of a modern cloud... ...solutions. Provide guidance and knowledge to other team members, and promote efficiency, productivity, innovations, and...Work at office
- ...Physical AI. We're a small, fast-moving team of engineers and researchers from leading AI labs,... ...Science, Computer Graphics, Robotics, or a related technical field. Experience building or substantially extending a physics engine or simulation framework (Newton, MuJoCo,...
$155k - $230k per year
...direct, inspect, and use their output. Take on engineering problems with depth. Make long-running agents reliable, stream progress into responsive interfaces, deliver... ...travel and accommodation. This role will be on-site in Toronto. We'll start remotely for the first few...InternshipWork at officeRemote work$155k - $230k per year
...We are building a commercial engine that allows pharmaceutical marketers... ...and rapidly iterating technical approaches at the frontiers of... ...accommodation. This role will be on-site in Toronto. We'll start... ...Workers & queues: Stand up a reliable background job platform with Celery...Work at officeRemote workNight shift$82.95k - $135.3k per year
...The Job You're ConsideringWe are seeking a highly motivated Site Reliability Engineer to help build and operate reliable, scalable, and secure services... .... It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year...Full timeLocal area- Job Title: Site Reliability Engineer – Azure / DatabricksLocation: Toronto, ON (Hybrid – 4 days onsite per week)Contract: 1 Year (Extension... ..., and CI/CD. The successful candidate will be the first member of a new team and must demonstrate strong ownership, an engineering...Contract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Member Of Technical Staff (Site Reliability Engineer, Crawler). Be the first to apply!
Related searches
- service support technician Winnipeg, MB
- sr. IT support analyst Winnipeg, MB
- technical analyst Winnipeg, MB
- technical system analyst Winnipeg, MB
- desktop support analyst Winnipeg, MB
- senior technical analyst Winnipeg, MB
- network technical analyst Winnipeg, MB
- service desk analyst Winnipeg, MB
- senior technical specialist Winnipeg, MB
- decision support analyst Winnipeg, MB

