Web Crawling Infrastructure Engineer
TinEye
Build large-scale web crawling infrastructure in Toronto with Python, Go, Rust, or C++ and asynchronous network programming expertise. This is an in-office position.TinEye seeks a Web Crawling and Scraping Engineer for its small Toronto development team. You will design crawling strategies and operate high-throughput ingestion systems. The work connects crawled data with indexing and matching for TinEye’s image search technologies.Key Responsibilities:
Architect crawling strategies for client-requested page prioritizationMaintain frontier scheduling, rate limiting, deduplication, parsing, and proxiesImprove monitoring and logging for crawler performance and healthEliminate crawling and extraction bottlenecks for scalable resource usageDocument debugging procedures and support data flow into indexingRequirements:
4+ years designing large-scale crawling and indexing infrastructureExtensive distributed systems and real-time URL prioritization experienceExpertise with crawling frameworks, scraping libraries, and protocolsExperience with Puppeteer, Selenium, asynchronous I/O, queues, and storageKnowledge of SQL and NoSQL databases with strong problem-solving skillsApply web crawling, distributed systems, and asynchronous programming expertise to TinEye’s Toronto image search infrastructure.
#J-18808-Ljbffr
Architect crawling strategies for client-requested page prioritizationMaintain frontier scheduling, rate limiting, deduplication, parsing, and proxiesImprove monitoring and logging for crawler performance and healthEliminate crawling and extraction bottlenecks for scalable resource usageDocument debugging procedures and support data flow into indexingRequirements:
4+ years designing large-scale crawling and indexing infrastructureExtensive distributed systems and real-time URL prioritization experienceExpertise with crawling frameworks, scraping libraries, and protocolsExperience with Puppeteer, Selenium, asynchronous I/O, queues, and storageKnowledge of SQL and NoSQL databases with strong problem-solving skillsApply web crawling, distributed systems, and asynchronous programming expertise to TinEye’s Toronto image search infrastructure.
#J-18808-Ljbffr
Vacancy posted 41 minutes ago
Similar jobs that could be interesting for youBased on the Web Crawling Infrastructure Engineer in Winnipeg, MB vacancy
- ...profitable and founder-led, and we're looking for a Web Crawling and Scraping Engineer to join our team. We value ingenuity, hard work and problem... ...and operating large-scale web crawling and indexing infrastructure. Extensive experience with distributed systems, crawler...WebWork at officeHome office
- ...rich consumer experiences, from mobile and web applications to advanced analytics and... ...partnerships. We are seeking a Web Platform Engineer to be the hands-on technical expert for... ...You will work closely with the client's infrastructure, engineering and product teams, turning...WebLong term contractWork at officeShift work
- ...every side of the story. Our mobile app, web app, and browser extension are home to a... ...Showdown at CES The Opportunity:As a Staff Engineer, you'll own the technical direction of... ...layers: architecture, experimentation infrastructure, performance, and making non-engineers self...WebRemote work
- ...Lead IT infrastructure projects at CBC/Radio-Canada using detailed engineering design, cloud technologies, and hands-on deployment expertise in a hybrid work model. This full-time permanent Engineering Project Lead position is based in Toronto, with projects focused on technology...SuggestedPermanent employmentFull time
- ...Own cloud infrastructure and CI/CD automation as a Senior DevOps Engineer with Bounteous, supporting secure, scalable, reliable platforms remotely across Canada or Mexico. This contract position requires six-plus years in DevOps, Cloud Engineering, SRE, or Infrastructure...SuggestedContract workInternshipRemote work
- Automate web security services at Intact with Terraform, Python or Bash, CI/CD integration, and WAF policy testing in a hybrid work... ...incident response.As a Security Advisor Specialist, you will apply Infrastructure as Code practices to CDN and WAF configurations. The work...Web
- ...America. We’re looking for a Software Engineer to join our product development team... ..., test, and maintain features across our web and mobile applications. Build and... ...frameworks React and TypeScript Cloud infrastructure and deployment CI/CD and automated testing...Web
- ...seamless for customers.Role Overview We are looking for a Web Engineer to join our team. As a Web Engineer, you will lead the web development... ..., build, test, and deploy scalable backend services and infrastructure across Robinhood Wallet, Tokenization, and Web3 platform...WebContract workWork at officeFlexible hoursShift work3 days per week
- Be a key technical leader with Pantheon as a Principal Engineer for our Collaborative Web Platform. Contribute to innovative solutions in real-time collaboration, AI workflows, and web application architecture. We seek a Principal Engineer to shape and drive our engineering...WebRemote work
- Engineer cloud-based web applications for Netflix Animation Studios using TypeScript, React, Vite, and Apollo Client. Work hybrid in Vancouver with at least three office days weekly.This front-end engineering role supports Production Management technology across Netflix Animation...WebWork at office
$115k - $140k per year
...accessible for the members who rely on us every day. About the roleWe’re looking for a product-minded engineer to own and elevate our frontend experience across mobile and web. In this role, you’ll partner directly with our lean product and design team to build intuitive...WebFull timeRemote work- Build Robinhood’s web-first trading product in Toronto using backend engineering and blockchain integrations. Work onsite at least three days weekly with multidisciplinary... ..., and Web3 platforms while connecting brokerage infrastructure with on-chain systems. The work includes product-...WebContract work
$170.56k - $185.12k per year
Software Engineering Manager - Web Interfaceshybrid5296 Bell School Line, Burlington, Ontario, Canada, L7M 0P1full-time. October 20, 2026 Description... ...Hands-on experience with React and TypeScript, cloud infrastructure, and CI/CD Real-time GUIs for data-intensive...WebPermanent employmentFull timeContract workInternshipImmediate startRemote workRelocationShift work- Build reliable consumer web experiences as a Senior Software Engineer at Affir, using React or Vue with JavaScript and TypeScript. This remote role is open to candidates across nine Canadian provinces.Within Marketing & Privacy Engineering, you will shape high-traffic logged...WebRemote work
- Perplexity is seeking a Web Access Engineer for the Crawler team to build reliable fetching and rendering systems powering AI-powered search. You will... ...side rendering, ensuring access policies are respected while advancing crawling performance and reliability. #J-18808-LjbffrWeb
$120k - $150k per year
EverPro - Senior Web Engineer### EverPro - Senior Web EngineerApply: Remote (Canada): Full time: Posted Yesterday: R-106614**EverPro -Sr. Web Engineer– REMOTE (Canada)** EverCommerce (Nasdaq: EVCM) is a leading service commerce platform, providing vertically-tailored, integrated...WebLong term contractFull timeFor contractorsWork at officeLocal areaImmediate startRemote work- Elevate your engineering expertise as a WordPress Engineer focusing on technical architecture and performance scaling. Join us to design custom... ...We seek an experienced WordPress Engineer to take charge of our web platform's architecture and scaling. This advanced role requires...Web
- Build Xcode Cloud web interfaces in Vancouver with accessibility and performance at the center. Shape developer workflows across Apple platforms.As a Web Engineer at Apple, you will design and build Xcode Cloud’s web experience with Human Interface designers and server engineers...WebWorldwide
- Build scalable web-first financial products as a Backend Web Engineer with Robinhood in Toronto, working on-site at least three days weekly.This Web Engineer... ...multidisciplinary product teams. You will build backend services, infrastructure, and product-facing features supporting...Web
- Perplexity is hiring a Web Access Engineer for the Crawler team to build reliable fetching and rendering... ...access policies, and develop the infrastructure that supplies content to downstream... ...web infrastructure, browsers, CDNs, or crawling, with strong programming skills in at...Web
- ...threats AI presents: mass‑manufactured social engineering. Countless scams, deepfakes, and other... ..., social media accounts, apps, dark‑web forums, and leverage AI agents to identify... ...backend engineer to build out the infrastructure required to rapidly scale up our engineering...WebInternshipWork at officeFlexible hours
$120k - $160k per year
...implementing, and managing cutting-edge network and infrastructure solutions, as well as providing support... ..., database administrators, DevOps engineers, architectsQualifications & Skills 5+... ...systemsExperience with Google Cloud Platform or Amazon Web ServicesUnderstanding of information...Web- Develop scalable web applications on site while strengthening automated testing, CI/CD delivery, and software quality across full-stack... ...with Claude, VS Code, or CursorUse full-stack engineering, automated testing, and CI/CD expertise to deliver reliable Media...WebFull time
- PCT partners with venture-backed technology companies looking for Infrastructure Engineers to build the systems, platforms, and tooling that enable engineering teams and products to operate reliably at scale. Infrastructure opportunities across our portfolio range from...Internship
- Shape scalable, content-driven web features at Electronic Arts with TypeScript, React, Next.Js, and integrations across multiple data sources.This Full Stack Web Developer role combines frontend delivery, backend services, and headless CMS work. You will create reusable components...Web
- ...Toronto five days a week. The role You'll own the cloud platform General Magic runs on: reliable, secure, observable infrastructure that lets our engineers ship fast and meets the bar carriers and regulators expect when handling sensitive insurance data. In this role, you...
- Develop, optimize, and maintain secure cloud infrastructure to ensure high availability, performance, and scalability. About the jobAs an Infrastructure Engineer, you will design, deploy, and maintain our Decisions cloud platform infrastructure, ensuring high availability...Work at office
$155k - $190k per year
Staff Software Engineer, Web Application Services Remote CanadaWhy Thunderbird?Thunderbird is one of the world’s most trusted open-source... ...proposing technology choices.Build and evolve analytics and infrastructure that help the team use user-generated data to inform...WebLong term contractPermanent employmentFull timeLocal areaRemote work- Combine web services engineering with LLM experience using Next.Js, TypeScript, and Claude Code to improve application capabilities and performance.This Software Engineer role involves implementing scalable applications and APIs with Next.Js, Firestore, Node.Js, and TypeScript...Web
- Improve live streaming quality with Kake remotely, diagnosing playback behavior through QoE metrics, ABR knowledge, and web player engineering.As a senior web engineer, you will own player performance across web and Connected TV platforms. Your work will address startup time...WebRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Web Crawling Infrastructure Engineer. Be the first to apply!
Related searches
- web accessibility specialist Winnipeg, MB
- web developer Winnipeg, MB
- remote junior web developer Winnipeg, MB
- développeur web Winnipeg, MB
- web designer developer Winnipeg, MB
- web developer internship Winnipeg, MB
- no experience web developer Winnipeg, MB
- entry level web developer Winnipeg, MB
- alternance developpeur web Winnipeg, MB
- web developer intern Winnipeg, MB

