Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer (Evaluation Infrastructure)

Waabi

Overview

Waabi, founded by AI visionary Raquel Urtasun, is the leader in Physical AI. With a world-class team, we\u2019re unlocking the next era of autonomous transportation with technology that\u2019s powering commercial autonomous trucks and robotaxis. Waabi is backed by and partners with world leaders in AI, automotive, logistics, and deep tech.

With offices in Toronto, San Francisco, Dallas, and Pittsburgh, Waabi is growing quickly and looking for diverse, innovative and collaborative candidates who want to impact the world in a positive way. To learn more visit:

The Evaluation Algorithms team is responsible for building the algorithms & tooling required to comprehensively evaluate our autonomy system\u2019s performance across all development stages. In this role, you will work closely with the systems & safety teams, responsible for defining the requirements & evaluation criteria, and simulation teams to leverage Waabi World, our highly realistic closed-loop simulation engine built with the latest in generative AI technologies to deliver the evaluation capabilities needed to support the safe development of the next generation of autonomous vehicles!

You will\u2026

  • Develop the tooling, infrastructure, and pipelines to support complex statistical analyses of driving performance scale.
  • Implement metrics and tags to provide a holistic understanding of model performance and enable the discovery of interesting scenarios for training and evaluation.
  • Develop and maintain a high availability query service to enable low-latency analysis and curation over large volumes of metric and tag data
  • Work with large datasets from various sources including real world driving as well as Waabi World, our high-fidelity simulator.
  • Champion engineering excellence, ensuring high-quality, well structured and tested code.
  • Assist in project roadmap planning, prioritisation, and delivery.

Qualifications

  • MS/Bachelors degree with 2+ years of industry experience in Computer Science, Machine Learning and/or similar technical field(s) of study.
  • Proficient in Python programming and strong software engineering fundamentals with real-world experience writing high quality, well-structured, and well-tested code.
  • Open-minded and collaborative team player with the willingness to help others.
  • Passionate about self-driving technologies, solving hard problems, and creating innovative solutions.

Bonus Points

  • Experience in data processing pipelines, ETL pipelines, distributed computing.
  • Experience in building highly reliable and scalable web services
  • Understanding of cloud job orchestration, monitoring, and instrumentation best-practices.
  • Experience in evaluating complex ML models or self-driving software stacks.

Salary & Benefits

The US yearly salary range for this role is: $127,000 - $223,000 USD in addition to competitive perks & benefits. Waabi (US) Inc.’s yearly salary ranges are determined based on several factors in accordance with the Company’s compensation practices. The salary base range is reflective of the minimum and maximum target for new hire salaries for the position across all US locations. Note: The Company provides additional compensation for employees in this role, including equity incentive awards and an annual performance bonus.

Perks / Benefits

  • Competitive compensation and equity awards.
  • Health and Wellness benefits encompassing Medical, Dental and Vision coverage (for full-time employees only).
  • Unlimited Vacation.
  • Flexible hours and Work from Home support.
  • Daily drinks, snacks and catered meals (when in office).
  • Regularly scheduled team building activities and social events both on-site, off-site & virtually.
  • As we grow, this list continues to evolve!

Waabi is a technology start-up building technologies to transform the way the world moves. Join our talented team to be a part of the future and to make an impact!

Waabi is an equal opportunity employer. We celebrate diversity and are committed to creating a supportive, inclusive, and accessible workplace for all our employees. We seek applicants of all backgrounds and identities, across race, color, ethnicity, national origin or ancestry, age, citizenship, religion, sex, sexual orientation, gender identity or expression, military or veteran status, marital status, pregnancy or parental status, caregiver status, disability, or any other characteristic protected by law. We make workplace accommodations for qualified individuals with disabilities as required by applicable law. If reasonable accommodation is needed to participate in the job application or interview process please let our recruiting team know.

#J-18808-Ljbffr
Vacancy posted 8 days ago
Similar jobs that could be interesting for youBased on the Software Engineer (Evaluation Infrastructure) in Toronto, ON vacancy
  • $171k - $225k per year

     ...to apply. Snapshot of the Role We’re looking for a Staff Infrastructure Engineer who operates as a technical leader and force multiplier across...  ...for someone who combines deep systems expertise with strong software engineering, thrives in ambiguity, and takes ownership from... 
    Suggested
    Long term contract
    Local area
    Remote work

    Quiet Capital

    Toronto, ON
    2 days ago
  • Become an Infrastructure Software Engineer at Doppel, developing AI-driven solutions to combat digital threats. Focus on building scalable backend systems to monitor and neutralize social engineering attacks. Doppel is looking for a talented Infrastructure Software Engineer... 
    Suggested

    United States Digital Space LLC

    Toronto, ON
    8 days ago
  • Cohere is on the lookout for a Data Infrastructure Software Engineer to drive the development of advanced data systems for AI workloads. Bring your skills in data storage and processing to this innovative team. In this comprehensive role, you will focus on building data infrastructures... 
    Suggested

    Cohere

    Toronto, ON
    8 days ago
  • Senior Staff Software Engineer, Infrastructure Rippling gives businesses one place to run HR, IT, and Finance. It brings together all of the workforce systems that are normally scattered across a company, like payroll, expenses, benefits, and computers. For the first time ever... 
    Suggested
    Long term contract
    Internship
    Work at office
    Local area
    3 days per week

    Rippling

    Toronto, ON
    8 days ago
  • Accelerate your career at ZoomInfo as a Senior Software Engineer focused on Internal Developer Platforms using advanced technologies like TypeScript and Node.js. Dive into API design and cloud infrastructure management. At ZoomInfo, you'll harness your experience to build... 
    Suggested

    ZoomInfo

    Toronto, ON
    8 days ago
  •  ...Lead the ML infrastructure at Stripe, enhancing systems for machine learning innovations. Bring your expertise in software to this impactful Staff Engineer role. Join the ML Platform team at Stripe, where your decades of experience will guide the technical evolution of our... 

    Monograph

    Toronto, ON
    5 hours ago
  • Join Ripple as a Staff Software Engineer within the Platform team, focusing on infrastructure and automation. This role emphasizes building resilient systems, automating processes, and coaching junior engineers to ensure superior performance. As a Staff Software Engineer,... 

    Ripple

    Toronto, ON
    11 hours ago
  •  ...development of scalable search solutions with Autodesk as a Search Infrastructure Engineering Manager. Ensure high-quality delivery across industry...  ...outcomes • Collaborate with stakeholders for timely software delivery • Mentor team members to enhance productivity and... 

    Autodesk, Inc.

    Toronto, ON
    2 days ago
  • Position Description Senior Software Engineer Reporting to: Director of Software Engineering...  ...solutions in both technological (pre‑evaluation, post‑evaluation, LLM monitoring, agent...  ...with Product, ML, Security, Infrastructure and other engineering teams. Qualifications... 
    Internship

    signal1

    Toronto, ON
    2 days ago
  • Step into a crucial Infrastructure Engineer role focusing on AutoSys and Windows with BeachHead. Your significant...  ...• Collaborate on best practices for software deployment • Contribute to governance and compliance initiatives • Evaluate and propose enhancements for scheduling... 

    BeachHead Inc.

    Toronto, ON
    8 days ago
  •  ...streaming. We are seeking a Director of Machine Learning Engineering and Infrastructure to lead a hybrid team bridging advanced ML engineering with...  ...pipelines: data ingestion, feature engineering, model training, evaluation, and serving. Architect distributed systems to support ML... 
    Work at office

    Tubi Tv

    Toronto, ON
    8 days ago
  •  ..., a division of Fox Corporation. About the Role This Software Engineering team works closely with Machine Learning and Product teams...  ...Kubernetes Bonus Familiarity with the machine learning infrastructure Previous experience with Akka Ability to debug... 
    Remplacement
    Full time
    Temporary work
    Flexible hours

    Tubi

    Toronto, ON
    8 days ago
  • Join to apply for the IT Infrastructure Solutions Engineer role at CI Financial 17 hours ago Be among the first 25 applicants Join to apply for...  ...configure AIX & RHEL operating systems and other system software on-premises and on AWS Cloud. Keep hardware firmware, operating... 
    Internship

    CI Financial

    Toronto, ON
    8 days ago
  • Senior Software Engineer, Feature Team HireArt is a modern staffing platform for companies to...  ...Datastores: PostgreSQL, Redis Infrastructure: Heroku CI/CD: GitHub Actions...  ...or critique) technical decisions Be evaluated on clarity, humility, and impact—not just... 
    Contract work
    Internship
    Work at office
    Remote work
    Work from home
    Home office

    business

    Toronto, ON
    8 days ago
  • $160k - $185k per year

     ...stay connected anywhere. As a Senior Software Engineer, you’ll lead technically significant...  ...PostgreSQL schemas, and strengthening infrastructure resiliency. You won't be siloed; you'll...  ...problems by breaking them down, evaluating trade‑offs, and finding better ways forward... 
    Remote work
    Flexible hours

    Roadpost

    Toronto, ON
    15 days ago
  • $132k - $165k per year

     ...with team members to elevate engineering quality across the team....  ...building and operating platform software using Kubernetes, and cloud‑...  ...on AWS. Familiarity with infrastructure‑as‑code and observability...  ...learning mindset and curiosity to evaluate and adopt new tools or... 
    Long term contract
    Full time
    Part time
    Flexible hours

    ProNavigator

    Toronto, ON
    8 days ago
  •  ...Building and maintaining application infrastructure in Amazon Web Services (AWS) with AWS Cloud...  ...You have 5+ years of experience in Software Development You have exceptional communication...  ...of software development and computer engineering You have the ability to break... 
    Flexible hours

    Spellbook

    Toronto, ON
    8 days ago
  • Requirements 4+ years of software engineering experience Some exposure to client-facing or production...  ...with workflow orchestration engines (Step Functions, Cadence, Temporal, Prefect...  ...workflows, and standing up the infrastructure to run reliably in a real provider environment... 
    Long term contract
    Contract work

    PocketHealth

    Toronto, ON
    8 days ago
  • Join Kora as a Cloud Infrastructure Engineer and tackle complex distributed systems. Play a key role in...  ...a scalable, reliable storage engine that excels in performance. This position...  ...Responsibilities Build the foundational software for multi‑tenant storage solutions Independently... 
    Long term contract

    Recognized

    Toronto, ON
    11 hours ago
  • $85k - $95k per year

    Build Better Systems. Prevent Problems. Engineer Stability. BlueBird IT Solutions specializes...  ...as Tier 3 escalation point for complex infrastructure issues. Administer Windows Server,...  ...Microsoft Defender SQL Server Healthcare software environments MSP experience... 
    Casual work
    Immediate start

    BlueBird IT Solutions

    Toronto, ON
    5 hours ago
  • Support the Ontario Line Project as an Infrastructure Validation Engineer in Toronto. This role focuses on verification, validation activities, and documentation preparation while coordinating between disciplines. A leading construction firm is seeking an engineer with strong... 

    Leading Construction Firm

    Toronto, ON
    5 hours ago
  • Job Description Insight Global is seeking a senior security infrastructure engineer to join their security operations team in a hands on implementation capacity. This is not purely an operational monitoring role, it will require someone who is designing, deploying and configuring... 
    2 days per week
    1 day per week

    Insight Global

    Toronto, ON
    11 hours ago
  • $62k - $90k per year

     ...Job Overview Entry‑level Software Engineer I – AI, Toronto, ON (on‑site). This full‑time position focuses on developing AI‑enabled solutions...  .... Document and verify system components, applications, infrastructure, security, integration, operability, and architecture... 
    Full time

    TryApplyNow

    Toronto, ON
    5 hours ago
  • $115k - $149k per year

     ...competitive intelligence. We are hiring an Software Engineer, AI to join our team in Toronto....  ...workflows, retrieval pipelines, and evaluation frameworks to ensure our systems are...  ...Experience with vector database infrastructure (FAISS, Milvus, Weaviate, Pinecone, PGVector... 
    Full time
    Work at office

    Klue

    Toronto, ON
    8 days ago
  • Support autonomous fleet operations as a Cloud Infrastructure Engineer with Hire Art in Foster City, CA. This role focuses on scalable backend and...  ...: • Bachelor's degree in computer science • 7+ years of software engineering experience • Proven track record in backend service... 

    Business

    Toronto, ON
    8 days ago
  • Take on a leadership role in cloud infrastructure as a Lead Engineer. Focus on automating and securing hybrid environments, while bringing your expertise in identity management to the forefront. This critical role requires a deep understanding of both Microsoft 365 and cloud... 

    Momentum Financial Services Group

    Toronto, ON
    8 days ago
  • A leading engineering firm is seeking an experienced Civil Engineer - Airport Infrastructure in Toronto, Canada. The job involves providing guidance on airside civil design,...  ...aerodrome standards, and proficiency in CAD software. The position is entirely in-office, offering... 
    Work at office

    AtkinsRéalis

    Toronto, ON
    8 days ago
  • Drive innovation at Spellbook as a Generalist Platform and Infrastructure Engineer focused on enhancing system reliability and boosting developer productivity in a fast-paced tech environment. At Spellbook, you will engage with a broad array of technologies, including AWS... 

    Spellbook

    Toronto, ON
    8 days ago
  • Join a progressive technology organization in Toronto as a Senior SRE & Platform Engineer. This role focuses on Kubernetes management, cloud infrastructure, and observability within a collaborative work environment. In this full-time position, you will apply your 7–10+ years... 
    Full time

    United States Digital Space LLC

    Toronto, ON
    8 days ago
  •  ...Description CUSTOMER Develop new components as required for engineering programs and projects within assigned area and may also work...  ...Document and verify system components, applications, system infrastructure, security, integration, operability and engineering related architecture... 

    JobPath Partners LLC

    Toronto, ON
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer (Evaluation Infrastructure). Be the first to apply!