Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Member Of Technical Staff (Web Access Engineer, Crawler)

Perplexity

Perplexity is hiring a Web Access Engineer for the Crawler team to build reliable fetching and rendering systems for AI-powered search. You'll work on freely available public web content, within site permissions and approved access policies, and develop the infrastructure that supplies content to downstream indexing and retrieval systems.
Your focus will be diagnosing network errors, page-loading issues, and incomplete rendering. You'll trace problems from network protocols through client-side execution, distinguish technical failures from intentional access restrictions, and turn findings into production fixes that improve content quality and efficiency at scale.
Responsibilities
Own fetching and rendering improvements end to end, from investigation through implementation and production rollout, partnering with crawler engineers and SREs.
Investigate fetch and rendering failures across DNS, TLS, caching, redirects, and client-side rendering, and classify root causes.
Improve page loading, completion detection, and content capture to preserve relevant content and handle dynamic pages reliably.
Ensure the crawler respects site-imposed access restrictions and rate limits, identifies itself clearly, and retries only transient technical errors.
Build tools to reproduce failures, compare crawler output against expected page content, and turn findings into regression tests.
Define metrics for fetching reliability, content completeness, and error classification, and use them to prioritize improvements.
Qualifications
5+ years of software engineering experience in web infrastructure, browsers, CDNs, or crawling, with strong programming skills in at least one of Go, Python, Rust, or C++.
Deep understanding of and including status semantics, caching, conditional requests, content encoding, and redirects;
strong knowledge of TLS, DNS, cookies, and sessions.
Understanding of CDN caching and content delivery, error handling, retry backoff, and server-defined rate limits.
Knowledge of page lifecycle, network idle, service workers, client-side rendering, and shadow DOM;
experience debugging JavaScript and fluency with Chrome DevTools, CDP, HAR files, curl, and packet captures.
Comfort working independently when the path forward is not fully defined.
Nice to have
Experience developing CDN, caching, or web performance systems.
Experience operating crawlers, headless browsers, or distributed content-acquisition systems at scale.
Contributions to a browser engine or JavaScript runtime.
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Member Of Technical Staff (Web Access Engineer, Crawler) in Winnipeg, MB vacancy
  • Keeping a crawler running is not the same as keeping it productive. Queues can grow while...  ...years of experience in SRE, production engineering, or infrastructure-heavy backend roles,...  ...Nice to have Experience operating web crawlers, search infrastructure, or browser fleets... 
    Suggested

    Perplexity

    Winnipeg, MB
    2 hours ago
  •  ...drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft...  ..., Berlin and Seoul. Join us! Role Overview: As a Senior Member of Technical Staff specializing in web data for pre-training, you will play a... 
    Suggested
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Avenue.io Inc.

    Winnipeg, MB
    2 hours ago
  •  ...our small but mighty team of engineers all report directly to the CTO...  ...Newfoundland, with remote team members in Nova Scotia, New Brunswick,...  ...You balance pragmatism with technical excellence, and you know which...  ...5+ years building production web products across frontend and backend... 
    Suggested
    Internship
    Work at office
    Remote work
    Flexible hours

    SiftMed

    Winnipeg, MB
    2 hours ago
  • Perplexity is seeking a Web Access Engineer for the Crawler team to build reliable fetching and rendering systems powering AI-powered search. You will diagnose network and rendering issues, implementing production fixes that improve content quality at scale. You will investigate... 
    Suggested

    Perplexity

    Winnipeg, MB
    2 hours ago
  •  ...effectively with cross-functional teams to understand requirements and provide technical guidance. What We're Looking For (qualifications) MS/PhD in Computer Science, Electrical Engineering or a related field with a focus on computer vision. Proven research experience... 
    Suggested
    Remote work
    Night shift

    Moonvalley

    Winnipeg, MB
    2 hours ago
  • $140k - $240k per year

    Location: Toronto (Office) On-site | Full-time Compensation: $140K - $240KThe Role: Member of Technical Staff (Applied AI) The Senior Applied AI Engineer will play a pivotal role in defining how AI agents navigate the web. This individual will focus on building open-source... 
    Full time
    Internship
    Work at office

    MLabs

    Winnipeg, MB
    2 hours ago
  • $220k - $405k per year

     ...This Role Perplexity is seeking strong engineers with a passion for delivering frontier...  ...implementing, and scaling these interfaces. As a member of our team, you'll work on an eclectic...  ...experience alike. You'll also define technical strategy for how we scale to meet... 
    Contract work

    Perplexity

    Winnipeg, MB
    2 hours ago
  •  ...informed and see every side of the story. Our mobile app, web app, and browser extension are home to a community of...  ...Winner of Mobile Apps Showdown at CES The Opportunity:As a Staff Engineer, you'll own the technical direction of the web properties that convert curious... 
    Remote work

    Ground News

    Winnipeg, MB
    2 hours ago
  • $160k - $210k per year

     ...Cockroach Continuum. We're looking for a staff software engineer to help build out the Migration...  ...database teams.Take part in a collaborative, technically rigorous culture, and help shape...  ...projects.After 3 months, you’ll be a full member of the team, contributing to the MOLT... 
    Internship
    Work at office
    Local area
    Remote work
    Worldwide
    Flexible hours

    Cockroach Labs

    Winnipeg, MB
    2 hours ago
  • $250k per year

     ...contributing toincreasing the capabilities of our models and the value they drive for ourcustomers. Cohere is a team of researchers, engineers, designers, and more, whoare all passionate about their craft.We are a global technology company headquartered in Toronto with key... 
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    Winnipeg, MB
    2 hours ago
  • $155k - $230k per year

     ...We are building a commercial engine that allows pharmaceutical marketers...  ...and rapidly iterating technical approaches at the frontiers of...  ...layer: Model clean schemas and access patterns for Postgres; use...  ...Strong proficiency in full-stack web development technologies such... 
    Work at office
    Remote work
    Night shift

    Solstice

    Winnipeg, MB
    2 hours ago
  •  ...Physical AI. We're a small, fast-moving team of engineers and researchers from leading AI labs,...  ...Science, Computer Graphics, Robotics, or a related technical field. Experience building or substantially extending a physics engine or simulation framework (Newton, MuJoCo,... 

    Veeda AI

    Winnipeg, MB
    2 hours ago
  •  ...customers. Cohere is a team of researchers, engineers, designers, and more, who are all...  ...systems work at scale. This role demands deep technical expertise in production environments and...  ...depending on organizational needs. We provide access to world class compute resources, data,... 
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere Inc.

    Winnipeg, MB
    2 hours ago
  •  ...Physical AI. We're a small, fast-moving team of engineers and researchers from leading AI labs,...  ..., Computer Engineering, or a related technical field. Deep hands-on experience with PyTorch...  ...a kernel will stall from its memory access pattern before profiling. Experience profiling... 

    Veeda AI

    Winnipeg, MB
    2 hours ago
  •  ...Cohere is a team of researchers, engineers, designers, and more, who are...  ...scale. This role demands deep technical expertise in production...  ...organizational needs. We provide access to world class compute resources...  ...can do your best work. As a Member of Technical Staff, you will:... 
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    Winnipeg, MB
    2 hours ago
  • Enhance AI capabilities at Onix as a Member of Technical Staff with a focus on small language models. Engage in innovative projects combining efficient...  ...learning and retrieval methods • Ability to balance engineering and research expertise • Clear articulation of technical narratives... 

    E+E Consulting

    Winnipeg, MB
    2 hours ago
  •  ...world models for Physical AI. We're a small, fast-moving team of engineers and researchers from leading AI labs, tackling some of the most...  ...'s or Ph.D. in Computer Science, Engineering, or a related technical field, or equivalent hands-on experience. Demonstrated ability... 

    Veeda AI

    Winnipeg, MB
    2 hours ago
  •  ...types that advance perceptual intelligence. We are hiring Members of Technical Staff to create new data infrastructure as well as improve upon existing...  ...in applied machine learning, AI research, or research engineering. Exceptional candidates with equivalent research... 
    Long term contract
    Temporary work
    Work at office

    Mundo AI Inc.

    Winnipeg, MB
    2 hours ago
  • Contribute to groundbreaking Physical AI innovations at Veeda AI as a Technical Staff Member. Engage in multi-node video world model training while tackling key performance challenges. Veeda AI is seeking a Technical Staff Member to enhance its world-class team working with... 

    Veeda AI

    Winnipeg, MB
    2 hours ago
  • Member of Technical Staff, Small Language ModelsFull-time Onix is the Personal Intelligence platform. Each onix is a small language model trained...  ...our experts and users care about. Privacy is an engineering surface, not a compliance line. Per‑expert isolation, on‑device... 
    Live In
    Relocation

    E+E Consulting

    Winnipeg, MB
    2 hours ago
  •  ...themThis is a product and platform engineering role with end-to-end...  ...provisioning, fine‑granular role‑based access across connectors, tool...  ...admin APIs for audit logs, members, groups, roles, and settingsBuild...  ...support complianceSet the technical bar for authorization correctness... 
    Internship

    Perplexity AI

    Winnipeg, MB
    2 hours ago
  • Shape web and mobile experiences at Affirm using React or Vue and JavaScript or TypeScript, remotely from eligible Canadian provinces.The Auth Experiences team seeks a Staff Software Engineer to set technical direction for customer access and checkout journeys. You will build... 
    Remote work

    Affirm, Inc.

    Winnipeg, MB
    2 hours ago
  • Lead full-stack web engineering at Synopsys as a Staff Engineer, owning architecture, implementation, deployment, and operational reliability for enterprise...  ....This full-time Staff-level role suits an autonomous technical leader with expertise in JavaScript, TypeScript,... 
    Full time

    Synopsys, Inc.

    Winnipeg, MB
    2 hours ago
  •  ...best for our customers. Cohere is a team of researchers, engineers, designers, and more, who are passionate about their craft....  ...our mission and shape the future! Why this role? As a Member of Technical Staff in the Safety for Agents team, you will make a meaningful impact... 
    Full time
    Work at office
    Remote work
    Flexible hours

    Cohere

    Winnipeg, MB
    2 hours ago
  •  ...Cohere is seeking a Senior Member of Technical Staff specializing in web data for pre-training. You will design and own the large-scale web data pipeline that feeds Cohere’s language models, transforming raw internet data into high-quality training data. You will work with... 
    Remote work

    Avenue.io Inc.

    Winnipeg, MB
    2 hours ago
  •  ...part of Kong’s product portfolio. As a Staff Software Engineer on the Konnect team at Kong, you’ll architect...  ...of Kong Identity's extensible claims engine supporting dynamic attribute resolution...  ...for legacy system integration. Lead technical strategy for Kong Identity's developer... 
    Worldwide

    Kong

    Winnipeg, MB
    2 hours ago
  • $240k - $300k per year

     ...you need to grow your career. Engineering at BrexEngineering at Brex is...  ...builders grow by solving meaningful technical problems. What you’ll doThe Identity and Access Management team builds and...  ...core vendor integrations. As a Staff Engineer on IAM, you will lead projects... 
    Work at office
    Remote work
    Work from home

    Brex

    Winnipeg, MB
    2 hours ago
  • Improve crawler throughput with Kubernetes operations and observability on Perplexity’s Crawler team. Build safer deployments and durable...  ...reliability fixes for production services.As a Site Reliability Engineer, you will operate fetching and rendering fleets while improving... 

    Perplexity

    Winnipeg, MB
    2 hours ago
  •  ...growth (a forward-deployed GTM engineer?) who goes deep into portfolio...  ...equity, rollups, and AI. Access proprietary learnings about vertical...  ..., mini-products) that less technical folks can use to run GTM...  ...application is reviewed by a member of our team, and all decisions... 
    Internship

    Beacon Holdings

    Winnipeg, MB
    2 hours ago
  • Lead web application architecture at scale as Clio’s Staff Software Developer, working across Canada outside Quebec. Apply broad technical knowledge to complex systems.As a Staff Software Developer,...  ...expertise to strengthen Clio’s engineering solutions for customers. #J-18808... 

    Clio

    Winnipeg, MB
    2 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Member Of Technical Staff (Web Access Engineer, Crawler). Be the first to apply!