Member Of Technical Staff (Site Reliability Engineer, Crawler)
Perplexity
Keeping a crawler running is not the same as keeping it productive. Queues can grow while servers look healthy, and a small change can become a fleet-wide bottleneck. On Perplexity's Crawler team, you'll improve throughput, plan capacity, and build operational reliability through safer deployments, better observability, and durable fixes.
Responsibilities
Operate and optimize Kubernetes workloads and supporting infrastructure for crawler services, including fetching and rendering fleets.
Build and maintain infrastructure as code and CI/CD pipelines, with safe rollouts, validation, and fast rollback.
Define SLOs and build monitoring, alerting, and observability for availability, latency, throughput, and resource saturation.
Own capacity planning and resource efficiency;
diagnose queue backlogs, network failures, and resource bottlenecks with service owners.
Participate in the team's on-call rotation, lead incident response, and turn blameless postmortems into durable reliability improvements.
Write production software to automate diagnosis and routine remediation, with validation and approval gates for high-impact actions.
Qualifications
5+ years of experience in SRE, production engineering, or infrastructure-heavy backend roles, with strong programming skills in Python, C++, Rust, or Go.
Hands-on experience with cloud infrastructure, production Kubernetes, infrastructure as code such as Terraform, and automated deployment workflows.
Strong Linux and networking fundamentals, including TCP/IP, DNS, TLS, and load balancing.
Experience building observability with tools such as Datadog, Prometheus, or Grafana, and using SLOs to guide reliability improvements.
Proven experience diagnosing distributed-system failures, leading production incidents, and improving system performance or resource efficiency.
Nice to have
Experience operating web crawlers, search infrastructure, or browser fleets at scale.
Experience with distributed queues, backpressure, workload isolation, or multi-region recovery.
#J-18808-Ljbffr
Responsibilities
Operate and optimize Kubernetes workloads and supporting infrastructure for crawler services, including fetching and rendering fleets.
Build and maintain infrastructure as code and CI/CD pipelines, with safe rollouts, validation, and fast rollback.
Define SLOs and build monitoring, alerting, and observability for availability, latency, throughput, and resource saturation.
Own capacity planning and resource efficiency;
diagnose queue backlogs, network failures, and resource bottlenecks with service owners.
Participate in the team's on-call rotation, lead incident response, and turn blameless postmortems into durable reliability improvements.
Write production software to automate diagnosis and routine remediation, with validation and approval gates for high-impact actions.
Qualifications
5+ years of experience in SRE, production engineering, or infrastructure-heavy backend roles, with strong programming skills in Python, C++, Rust, or Go.
Hands-on experience with cloud infrastructure, production Kubernetes, infrastructure as code such as Terraform, and automated deployment workflows.
Strong Linux and networking fundamentals, including TCP/IP, DNS, TLS, and load balancing.
Experience building observability with tools such as Datadog, Prometheus, or Grafana, and using SLOs to guide reliability improvements.
Proven experience diagnosing distributed-system failures, leading production incidents, and improving system performance or resource efficiency.
Nice to have
Experience operating web crawlers, search infrastructure, or browser fleets at scale.
Experience with distributed queues, backpressure, workload isolation, or multi-region recovery.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Member Of Technical Staff (Site Reliability Engineer, Crawler) in Winnipeg, MB vacancy
- Perplexity is hiring a Web Access Engineer for the Crawler team to build reliable fetching and rendering systems for AI-powered search. You'll work on freely available public web content, within site permissions and approved access policies, and develop the infrastructure that...Suggested
- Improve crawler throughput with Kubernetes operations and observability on Perplexity’s Crawler team. Build safer deployments and durable reliability fixes for production services.As a Site Reliability Engineer, you will operate fetching and rendering fleets while improving...Suggested
- Lead reliable, observable data platforms at General Motors from the Markham office three days weekly in a hybrid Staff Engineer role.This senior technical leadership role supports GM’s Software-Defined Vehicle platform through scalable infrastructure, production operations,...SuggestedWork at office
$140k per year
...information.This is a hands-on senior engineering role focused on improving... ...teams to ship secure, reliable, and scalable software with confidence... ...cloud-native technologies, site reliability engineering... ...communication, collaboration, and technical leadership...SuggestedPermanent employmentFull timeInternshipRemote workFlexible hours$147k - $196.6k per year
...operational decision-making, and connected customer experiences. We are seeking a Staff Engineer to help make GM’s data platforms reliable, observable, operable, and scalable. This is a senior technical leadership role for someone who can move comfortably between system-level...SuggestedTemporary workWork at officeRotating shift$109.4k - $191.5k per year
It all started when engineer Fred Luddy wrote code that automated a... ...completion of a Government of Canada Reliability Status screening as a... ...SRE team is a group of highly technical engineers responsible for... ...engineering teams. The RoleAs a Staff SRE, you'll set the technical...Permanent employmentContract workManual laborWork at officeImmediate startRemote workFlexible hoursShift work- ...technology organization is looking for a Staff DevOps Engineer to take ownership of the cloud... ...processing high-volume telemetry to ensuring reliable, continuous operations. You’ll have... ...systems, making this a role with genuine technical depth, ownership, and long-term impact....Long term contractFull time
- ...market evolves. At the core of it all is our engineering-first culture. Our engineers tackle... ...designing and building systems at scale. As a Staff Platform Engineer, you will own... ...scale infrastructure projects, and shape the technical direction of a platform that processes more...Flexible hours1 day per week
- ...Development & Operations (PDO) organization as a cornerstone of our Site Reliability Engineering team. We are the architects of stability for the Guidewire... ...can depend on our mission-critical applications. As a Staff Site Reliability Engineer, you aren’t just maintaining systems...Long term contractFull timePart timeWork at office
$200k - $300k per year
...listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Mobile Engineer (Member of Technical Staff) based in Canada. We are looking for an experienced Mobile Engineer to build and shape a next-generation mobile...Full timeInternshipLocal areaRemote work- ...experienced and versatile software engineer to work on the tools and... ...work across projects and technical domains, joining teams or existing... ...layers, improving reliability, performance, observability,... ...applications from everyone, including members of all equity‑seeking communities...Long term contractImmediate startHome office
- ...our small but mighty team of engineers all report directly to the CTO... ..., with remote team members in Nova Scotia, New Brunswick... ...cloud infrastructure. Build reliable, event-driven pipelines that... ...You balance pragmatism with technical excellence, and you know which...InternshipWork at officeRemote workFlexible hoursNight shift
$220k - $405k per year
...Perplexity is seeking strong engineers with a passion for delivering... ...scaling these interfaces. As a member of our team, you'll work on... ...alike. You'll also define technical strategy for how we scale to... ...Harden system security and reliability across heterogeneous compute...Contract work- ...effectively with cross-functional teams to understand requirements and provide technical guidance. What We're Looking For (qualifications) MS/PhD in Computer Science, Electrical Engineering or a related field with a focus on computer vision. Proven research experience...Remote workNight shift
- ...customers. Cohere is a team of researchers, engineers, designers, and more, who are all... ...Cohere's mission of providing efficient and reliable language understanding and generation... ...for effective collaboration. As a Member Of Technical Staff, You Will Design and write high...Full timeWork at officeLocal areaRemote workHome office
- ...companies offering meaningful virtual support to patients across an expansive array of specialties, in all 50 states. Staff Site Reliability Engineer, AWS & DatabasesAbout the RoleOpenLoop runs telehealth services for clients in all 50 states, and the AWS platform and databases...Flexible hoursShift workRotating shift
$140k - $240k per year
Location: Toronto (Office) On-site | Full-time Compensation: $140K - $240KThe Role: Member of Technical Staff (Applied AI) The Senior Applied AI Engineer will play a pivotal role in defining how AI agents navigate the web. This individual will focus on building open-source...Full timeInternshipWork at office$150k - $200k per year
...:We are seeking a skilled and experienced Senior Infrastructure Engineer to join our dynamic team in Toronto. As a Senior Infrastructure... ...microservices.Strong communication and teamwork skills, embracing technical challenges and innovation.Base Salary Range:CAD $150,000 - $200,...Worldwide$100k - $150k per year
...excel and make a profound global impact. We are seeking a Site Reliability Operations Technical Lead to serve as the senior technical individual... ...teams, and provides technical leadership to site support engineers. Be responsible for the hardest issues across Active Directory...Permanent employmentWork at officeLocal areaRelocation$144k - $200k per year
Platform Engineering is the department within SRE that is responsible for a range of critical infrastructure and operational functions that... ...and maintains our continuous delivery infrastructure, ensuring reliable code deployment from development through production for all...WorldwideFlexible hours- ...Fortune 100 companies. Our work covers audio, video, and other new data types that advance perceptual intelligence. We are hiring Members of Technical Staff to create new data infrastructure as well as improve upon existing infrastructure.The Role As a Member of Technical Staff...Long term contractInternshipWork at office
- Member of Technical Staff – Robotics About Us Veeda AI is building the next generation of multimodal foundation world models for Physical AI. We're a small, fast-moving team of engineers and researchers from leading AI labs, tackling some of the most challenging problems...
- Perplexity is seeking a Web Access Engineer for the Crawler team to build reliable fetching and rendering systems powering AI-powered search. You will diagnose network and rendering issues, implementing production fixes that improve content quality at scale. You will investigate...
$125.45k - $175.45k per year
It all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker, Phyllis. She cried tears of joy... ...Join us to put AI to work for people. Role OverviewAs a Staff Site Reliability Engineer supporting our Canada Protected B regulated cloud environment...Permanent employmentWork at officeImmediate startRemote workMonday to fridayFlexible hoursShift workNight shiftDay shiftAfternoon shift$155k - $230k per year
...direct, inspect, and use their output. Take on engineering problems with depth. Make long-running agents reliable, stream progress into responsive interfaces, deliver... ...travel and accommodation. This role will be on-site in Toronto. We'll start remotely for the first few...InternshipWork at officeRemote work- ...portfolio of business, technology, and engineering services and solutions is delivered... ...than by you.Change and Release reliability:Design and operate change management... ...and bot management that protects the site without blocking the crawlers you need.A real observability practice...
- ...drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft... ...on where you can be located for this role. As a Member Of Technical Staff, You Will Design, build and scale AI systems for serving...Full timeWork at officeLocal areaRemote workHome office
$155k - $230k per year
...We are building a commercial engine that allows pharmaceutical marketers... ...and rapidly iterating technical approaches at the frontiers of... ...accommodation. This role will be on-site in Toronto. We'll start... ...Workers & queues: Stand up a reliable background job platform with Celery...Work at officeRemote workNight shift- ...Physical AI. We're a small, fast-moving team of engineers and researchers from leading AI labs,... ...Science, Computer Graphics, Robotics, or a related technical field. Experience building or substantially extending a physics engine or simulation framework (Newton, MuJoCo,...
- Job SummaryPorter is hiring an experienced Site Reliability Engineer to help improve the reliability, scalability, and performance of a modern cloud... ...solutions. Provide guidance and knowledge to other team members, and promote efficiency, productivity, innovations, and...Work at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Member Of Technical Staff (Site Reliability Engineer, Crawler). Be the first to apply!
Related searches
- IT support analyst Winnipeg, MB
- senior technical specialist Winnipeg, MB
- service support technician Winnipeg, MB
- adjoint technique Winnipeg, MB
- assistant technique Winnipeg, MB
- decision support analyst Winnipeg, MB
- computer support technician Winnipeg, MB
- network support technician Winnipeg, MB
- technical business analyst Winnipeg, MB
- user support technician - IT Winnipeg, MB

