Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Web Crawling Infrastructure Engineer

TinEye / Idee Inc.

Build large-scale web crawling infrastructure in Toronto with Python, Go, Rust, or C++ and asynchronous network programming expertise. This is an in-office position.TinEye seeks a Web Crawling and Scraping Engineer for its small Toronto development team. You will design crawling strategies and operate high-throughput ingestion systems. The work connects crawled data with indexing and matching for TinEye’s image search technologies.Key Responsibilities:
Architect crawling strategies for client-requested page prioritizationMaintain frontier scheduling, rate limiting, deduplication, parsing, and proxiesImprove monitoring and logging for crawler performance and healthEliminate crawling and extraction bottlenecks for scalable resource usageDocument debugging procedures and support data flow into indexingRequirements:
4+ years designing large-scale crawling and indexing infrastructureExtensive distributed systems and real-time URL prioritization experienceExpertise with crawling frameworks, scraping libraries, and protocolsExperience with Puppeteer, Selenium, asynchronous I/O, queues, and storageKnowledge of SQL and NoSQL databases with strong problem-solving skillsApply web crawling, distributed systems, and asynchronous programming expertise to TinEye’s Toronto image search infrastructure.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Web Crawling Infrastructure Engineer in Winnipeg, MB vacancy
  •  ...profitable and founder-led, and we're looking for a Web Crawling and Scraping Engineer to join our team. We value ingenuity, hard work and problem...  ...and operating large-scale web crawling and indexing infrastructure. Extensive experience with distributed systems, crawler... 
    Web
    Work at office
    Home office

    TinEye / Idee Inc.

    Winnipeg, MB
    1 hour ago
  •  ...Lead IT infrastructure projects at CBC/Radio-Canada using detailed engineering design, cloud technologies, and hands-on deployment expertise in a hybrid work model. This full-time permanent Engineering Project Lead position is based in Toronto, with projects focused on technology... 
    Suggested
    Permanent employment
    Full time

    CBC/Radio-Canada

    Winnipeg, MB
    7 days ago
  •  ...Own cloud infrastructure and CI/CD automation as a Senior DevOps Engineer with Bounteous, supporting secure, scalable, reliable platforms remotely across Canada or Mexico. This contract position requires six-plus years in DevOps, Cloud Engineering, SRE, or Infrastructure... 
    Suggested
    Contract work
    Internship
    Remote work

    Devopsroles

    Winnipeg, MB
    7 days ago
  •  ...every side of the story. Our mobile app, web app, and browser extension are home to a...  ...Showdown at CES The Opportunity:As a Staff Engineer, you'll own the technical direction of...  ...layers: architecture, experimentation infrastructure, performance, and making non-engineers self... 
    Web
    Remote work

    Ground News

    Winnipeg, MB
    1 hour ago
  • $136k - $160k per year

     ...building reliable, scalable solutions that make global expansion faster, safer, and more seamless for customers. We are looking for a Web Engineer to join our team. As a Web Engineer, you will lead the web development process and build products from inception to deployment. We... 
    Web
    Full time
    Work at office
    Flexible hours
    Shift work
    3 days per week

    Coinsquare

    Winnipeg, MB
    1 hour ago
  •  ...America. We’re looking for a Software Engineer to join our product development team...  ..., test, and maintain features across our web and mobile applications. Build and...  ...frameworks React and TypeScript Cloud infrastructure and deployment CI/CD and automated testing... 
    Web

    InTouchLink

    Winnipeg, MB
    1 hour ago
  • Automate web security services at Intact with Terraform, Python or Bash, CI/CD integration, and WAF policy testing in a hybrid work...  ...incident response.As a Security Advisor Specialist, you will apply Infrastructure as Code practices to CDN and WAF configurations. The work... 
    Web

    Intact FC

    Winnipeg, MB
    1 hour ago
  •  ...rich consumer experiences, from mobile and web applications to advanced analytics and...  ...partnerships. We are seeking a Web Platform Engineer to be the hands-on technical expert for...  ...You will work closely with the client's infrastructure, engineering and product teams, turning... 
    Web
    Long term contract
    Work at office
    Shift work

    Appnovation

    Winnipeg, MB
    1 hour ago
  • $120k - $150k per year

    EverPro -Sr. Web Engineer– REMOTE (Canada) EverCommerce (Nasdaq: EVCM) is a leading service commerce platform, providing vertically-tailored, integrated SaaS solutions that help more than 745,000 global service-based businesses accelerate growth, streamline operations, and increase... 
    Web
    Long term contract
    For contractors
    Work at office
    Local area
    Immediate start
    Remote work

    Joist Software Inc.

    Winnipeg, MB
    1 hour ago
  • Build reliable consumer web experiences as a Senior Software Engineer at Affir, using React or Vue with JavaScript and TypeScript. This remote role is open to candidates across nine Canadian provinces.Within Marketing & Privacy Engineering, you will shape high-traffic logged... 
    Web
    Remote work

    Affirm, Inc.

    Winnipeg, MB
    1 hour ago
  • Elevate your engineering expertise as a WordPress Engineer focusing on technical architecture and performance scaling. Join us to design custom...  ...We seek an experienced WordPress Engineer to take charge of our web platform's architecture and scaling. This advanced role requires... 
    Web

    WP AutoMagic

    Winnipeg, MB
    1 hour ago
  • Build Xcode Cloud web interfaces in Vancouver with accessibility and performance at the center. Shape developer workflows across Apple platforms.As a Web Engineer at Apple, you will design and build Xcode Cloud’s web experience with Human Interface designers and server engineers... 
    Web
    Worldwide

    Apple, Inc.

    Winnipeg, MB
    1 hour ago
  • Perplexity is seeking a Web Access Engineer for the Crawler team to build reliable fetching and rendering systems powering AI-powered search. You will...  ...side rendering, ensuring access policies are respected while advancing crawling performance and reliability. #J-18808-Ljbffr
    Web

    Perplexity

    Winnipeg, MB
    1 hour ago
  • $115k - $140k per year

     ...accessible for the members who rely on us every day. About the roleWe’re looking for a product-minded engineer to own and elevate our frontend experience across mobile and web. In this role, you’ll partner directly with our lean product and design team to build intuitive... 
    Web
    Full time
    Remote work

    Poparide

    Winnipeg, MB
    1 hour ago
  • Aplin seeks a Cloud Web Application Engineer for primarily remote contract work, focused on AWS solutions, scalable services, and responsive user experiences. Edmonton attendance may occasionally be required.You will contribute to modern web applications supporting large-scale... 
    Web
    Contract work
    Remote work

    Aplin

    Winnipeg, MB
    1 hour ago
  • Build Robinhood’s web-first trading product in Toronto using backend engineering and blockchain integrations. Work onsite at least three days weekly with multidisciplinary...  ..., and Web3 platforms while connecting brokerage infrastructure with on-chain systems. The work includes product-... 
    Web
    Contract work

    Robinhood

    Winnipeg, MB
    1 hour ago
  • Build scalable web-first financial products as a Backend Web Engineer with Robinhood in Toronto, working on-site at least three days weekly.This Web Engineer...  ...multidisciplinary product teams. You will build backend services, infrastructure, and product-facing features supporting... 
    Web

    Neobankbeat

    Winnipeg, MB
    1 hour ago
  • Be a key technical leader with Pantheon as a Principal Engineer for our Collaborative Web Platform. Contribute to innovative solutions in real-time collaboration, AI workflows, and web application architecture. We seek a Principal Engineer to shape and drive our engineering... 
    Web
    Remote work

    Webhosting

    Winnipeg, MB
    1 hour ago
  • $120k - $160k per year

     ...implementing, and managing cutting-edge network and infrastructure solutions, as well as providing support...  ..., database administrators, DevOps engineers, architectsQualifications & Skills 5+...  ...systemsExperience with Google Cloud Platform or Amazon Web ServicesUnderstanding of information... 
    Web

    Workingames

    Winnipeg, MB
    1 hour ago
  • Build Tailscale’s unified web console through React platforms, shared libraries, and scalable frontend testing across multiple products.As a full-time Frontend Engineer, you will create infrastructure that enables teams to ship within one console experience. Your work includes... 
    Web
    Full time
    Local area

    Tailscale

    Winnipeg, MB
    1 hour ago
  •  ...that flies the aircraft, whereas the new Web Interfaces team builds software that lets...  ...the team from the ground up: hiring the engineers, setting the direction for the web GUI and...  ...experience with React and TypeScript, cloud infrastructure, and CI/CDReal-time GUIs for data-... 
    Web
    Permanent employment
    Full time
    Contract work
    Internship
    Immediate start
    Remote work
    Shift work

    Ribbit

    Winnipeg, MB
    1 hour ago
  •  ...threats AI presents: mass‑manufactured social engineering. Countless scams, deepfakes, and other...  ..., social media accounts, apps, dark‑web forums, and leverage AI agents to identify...  ...backend engineer to build out the infrastructure required to rapidly scale up our engineering... 
    Web
    Internship
    Work at office
    Flexible hours

    Wilco

    Winnipeg, MB
    1 hour ago
  • Perplexity is hiring a Web Access Engineer for the Crawler team to build reliable fetching and rendering...  ...access policies, and develop the infrastructure that supplies content to downstream...  ...web infrastructure, browsers, CDNs, or crawling, with strong programming skills in at... 
    Web

    Perplexity

    Winnipeg, MB
    1 hour ago
  • Job Title: Kafka AdministratorDuration: 07+ months contractJob Type: Contract and T4 (No visa sponsorship)Responsibilities Partnership & Integration: Collaborate with multiple technology teams and management to ensure appropriate integration of functions to meet organizational...
    Contract work
    Visa sponsorship

    Kelly

    Winnipeg, MB
    1 hour ago
  • PCT partners with venture-backed technology companies looking for Infrastructure Engineers to build the systems, platforms, and tooling that enable engineering teams and products to operate reliably at scale. Infrastructure opportunities across our portfolio range from... 
    Internship

    People Culture Talent

    Winnipeg, MB
    1 hour ago
  • Lead Web Interfaces at Ribbit through React, TypeScript, and production software delivery in a hybrid Burlington position. Build operator tools for autonomous aircraft.As Software Engineering Manager, you will establish a new team and its technical foundation. You will hire... 
    Web
    Internship

    Rainfall Ventures

    Winnipeg, MB
    1 hour ago
  • Test Java and MS .Net web applications with Selenium, SQL, and accessibility knowledge as a hybrid Senior Web Application Test Engineer. Onsite work is required three days weekly.This senior testing specialist develops maintainable test plans, test cases, automation scripts... 
    Web

    Rubicon Path

    Winnipeg, MB
    1 hour ago
  • Shape PCMI web products with AI-assisted development tools, .NET Core, Angular, and SQL Server within a global SaaS company. Help modernize application architecture.PCMI seeks a Software Engineer to contribute features, system design, and maintenance across its extended warranty... 
    Web
    Contract work

    PCMI Corp.

    Winnipeg, MB
    1 hour ago
  • Shape scalable, content-driven web features at Electronic Arts with TypeScript, React, Next.Js, and integrations across multiple data sources.This Full Stack Web Developer role combines frontend delivery, backend services, and headless CMS work. You will create reusable components... 
    Web

    Electronic Arts

    Winnipeg, MB
    1 hour ago
  • Lead full-stack web engineering at Synopsys as a Staff Engineer, owning architecture, implementation, deployment, and operational reliability for enterprise applications.This full-time Staff-level role suits an autonomous technical leader with expertise in JavaScript, TypeScript... 
    Web
    Full time

    Synopsys, Inc.

    Winnipeg, MB
    1 hour ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Web Crawling Infrastructure Engineer. Be the first to apply!