Senior Software Engineer, Evaluation Infrastructure
waabi
Waabi, founded by AI visionary Raquel Urtasun, is the leader in Physical AI. With a world-class team, we're unlocking the next era of autonomous transportation with technology that's powering commercial autonomous trucks and robotaxis. Waabi is backed by and partners with world leaders in AI, automotive, logistics, and deep tech.
With offices in Toronto, San Francisco, Dallas, and Pittsburgh, Waabi is growing quickly and looking for diverse, innovative and collaborative candidates who want to impact the world in a positive way. To learn more visit:
The Evaluation Algorithms team is responsible for building the algorithms & tooling required to comprehensively evaluate our autonomy system’s performance across all development stages. In this role, you will work closely with the systems & safety teams, responsible for defining the requirements & evaluation criteria, and simulation teams to leverage Waabi World, our highly realistic closed-loop simulation engine built with the latest in generative AI technologies to deliver the evaluation capabilities needed to support the safe development of the next generation of autonomous vehicles!
You will…
- Develop the tooling, infrastructure, and pipelines to support complex statistical analyses of driving performance scale.
- Implement metrics and tags to provide a holistic understanding of model performance and enable the discovery of interesting scenarios for training and evaluation.
- Develop and maintain a high availability query service to enable low-latency analysis and curation over large volumes of metric and tag data
- Work with large datasets from various sources including real world driving as well as Waabi World, our high-fidelity simulator.
- Champion engineering excellence, ensuring high-quality, well structured and tested code.
- Assist in project roadmap planning, prioritisation, and delivery.
Qualifications:
- MS/Bachelors degree with 2+ years of industry experience in Computer Science, Machine Learning and/or similar technical field(s) of study.
- Proficient in Python programming and strong software engineering fundamentals with real-world experience writing high quality, well-structured, and well-tested code.
- Open-minded and collaborative team player with the willingness to help others.
- Passionate about self-driving technologies, solving hard problems, and creating innovative solutions.
Bonus Points:
- Experience in data processing pipelines, ETL pipelines, distributed computing.
- Experience in building highly reliable and scalable web services
- Understanding of cloud job orchestration, monitoring, and instrumentation best-practices.
- Experience in evaluating complex ML models or self-driving software stacks.
- ...needs to cover everything from functionality to routine updates. We’re looking for a senior software engineer who loves working at the boundary between product code and infrastructure. This is not a traditional DevOps or SRE role. You’ll spend most of your time writing application...SeniorPermanent employmentFull timeSummer workInternshipWork at officeRemote workWork from home
Motion
Toronto, ON5 days ago $170k - $220k per year
...movement of money through stablecoin infrastructure. Backed by premier investors such as... .... They are currently seeking a Senior Infrastructure Engineer to design and build an internal platform... ...empowers product teams to deploy software with confidence, reliability, and speed...SeniorFull timeInternshipRemote work$130k - $145k per year
...role We are seeking a highly skilled and passionate Senior DevOps Engineer, AI infrastructure to join our team! You will play a key role in designing,... ...refine advanced prompting strategies for LLMs. Test, evaluate, and analyze the performance of LLM and other GenAI models...SeniorFull timeInternshipWork at officeFlexible hours- ...This is an exciting time to be joining CIBC's Infrastructure Technology team. We are looking for a Senior Infrastructure Cloud Engineer who brings experience specifically in... ...in a multi-platform environment. Lead the evaluation, selection and implementation of new and emerging...SeniorFull timeLocal areaRemote work
$160k - $185k per year
...and partners depend on to stay connected anywhere. As a Senior Software Engineer, you’ll lead technically significant initiatives across... ...APIs, and designing PostgreSQL schemas, and strengthening infrastructure resiliency. You won't be siloed; you'll follow features from...SeniorFull timeRemote workFlexible hours$107k - $157.3k per year
...Job Requisition ID # 26WD96510 Software Engineer, DataOS Infra Platform — P3 Position Overview Autodesk’s Analytics Data division... ...and operate compute, storage, orchestration, and other data infrastructure through secure and reliable self-service experiences. We...SeniorFull timeFor contractors$145k - $190k per year
...Opportunity We're on the lookout for a Senior Software Engineer to join our Merchant Identity... ...Experience with Kubernetes and modern infrastructure is important. Fintech or Payments... ...anticiper, à faire preuve d’initiative et à évaluer l’impact global de votre travail sur le...SeniorFull timeApprenticeshipSummer workSummer holidayLocal areaRemote work$80k - $180k per year
.... What’s the Opportunity? The AI Evaluation Engineer ensures AI agent solutions are accurate... ...3–10+ years of relevant experience in software quality engineering, AI evaluation, AI... ...quality initiatives is advantageous for more senior levels. Degree in Computer Science,...SeniorFull time- ...About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies... ...will work closely with machine learning engineers, data scientists, and product... ...requirements ~2+ years of professional software development experience with a solid background...
- ...opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization at the... ...of change. We are looking for a talented Software Engineer to design, build, and optimize the core engine of our high-performance database system. This is...Senior
$160k - $200k per year
...Traditional handoffs between product, design, and engineering are giving way to smaller, faster teams... ...and user experiences, build scalable software, and measure business impact. Design... ..., and iterate faster. Continuously evaluate and adopt new tools, AI capabilities,...SeniorLong term contractPermanent employmentFull timeInternship- ...capabilities, and being the engineer teams turn to when a deploy doesn... ...in Go (Golang) to manage infrastructure metadata and lifecycle. Design... ...you bring: ~8+ years of software engineering experience, or... ...Temporal (or similar workflow engines like Cadence or Airflow) for...SeniorWorldwide
$131k - $181k per year
...Who are we? Equinix is the world’s digital infrastructure company®, shortening the path to connectivity to enable the innovations... ...Summary Equinix's Digital Innovation Office is seeking a Senior Software Engineer - Marketing to support key Marketing Technology...SeniorFull timeWork at office- ...Look no further. What You'll Be Doing Own Venn’s data infrastructure, including pipelines, models, warehouses, and reporting layers... ...access, understand, and use across the company. Partner with engineering on event schemas, tracking requirements, and measurement...SeniorFull timeInternship
- ...products — and AI is at the heart of it. We're looking for a Senior Software Engineer who doesn't just implement but helps shape how they should... ...teams, translating complex consumer data needs into infrastructure that is scalable, governed, and built to last. Cloud architecture...SeniorWorldwideFlexible hours
$90k - $140k per year
...Job Description: Microchips FPGA software engineering team is at the forefront of developing... ...using state-of-the-art LLVM/MLIR compiler infrastructure. The PolarFire System Designer further... ...any fees related to unsolicited resumes. Required Experience: Senior IC...SeniorFull timeManual laborWork at office$150k - $200k per year
...scale. About the Role Verto builds software that takes on some of the most... ...systems we serve, reliably and at scale. As Senior Engineering Manager, Software, you own that side of... ...cost, then faster inference. Bring infrastructure cost and inference time down by evaluating...SeniorFull timeLive InWork at officeRemote workFlexible hours- ...Bill & Melinda Gates Foundation, and Estee Lauder. We have more than 18,000 customers and 12 million users globally. Emburse software engineers contribute to the development of an engaging and interconnected set of system solutions. As an engineer, you will enhance the...SeniorFull time
- ...Job Summary We are seeking a talented and motivated Senior Software Engineer to contribute to the development and evolution of our SaaS... ...strong asset but is not required. Our platform runs on AWS infrastructure and leverages modern engineering practices including CI/CD...SeniorFull timeWork at officeRemote work
$104k - $156k per year
...potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era.... ...are too, let's talk. Role Overview We are seeking a Senior Software Engineer to build and evolve Okta’s web platform using React and...SeniorLocal areaWorldwide- ...to, weekly/bi-weekly/monthly events in the office with your specific team. This is a requirement for this role. Job title: Senior Software Engineer What your day-to-day will look like: · Identify, prioritize and execute tasks in the software development life cycle...SeniorLong term contractFull timeWork at officeRemote work
- ...Leveraging proprietary AI Studio and AI Engines, the company helps drive the clients’... ...Remote About the Role We are seeking a Senior Software Engineer to build and operate high-... ...with software, machine learning, data, infrastructure, and product teams to deliver reliable...SeniorFull timeContract workLocal areaRemote work
- ...we’ve assembled a world-class engineering team with staff-level talent... .... Role Overview As a senior/staff engineer, you will be driving... ...layer Building the infrastructure that powers our agentic systems... ...), or complex workflow engines is a strong plus Loves in-...SeniorFull timeWork at office
$136k - $187k per year
...secures AI by building the trusted, neutral infrastructure that enables organizations to safely... ...If you are too, let's talk. Datastores Engineer, Platform Infrastructure The Auth0 platform... ...a good fit if you: Have 5-8 years of software development experience. Are...SeniorLocal areaWorldwide$92.84k - $98.64k per year
...and implementing enterprise infrastructure, including networks, data centers... ...including, IT hardware, software, servers, clients and... ...components as business needs evolve. Evaluating and operationalizing new... ...degree in Computer Science, Engineering, or a related discipline, or...SeniorPermanent employmentWork at officeRemote workFlexible hours$136k - $187k per year
...potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era.... ...wait to talk to you. What you’ll be doing Collaborate with engineers both inside and outside the team to design and deliver...SeniorLocal areaWorldwide$136k - $187k per year
...potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era.... ...wait to talk to you. What you’ll be doing Collaborate with engineers both inside and outside the team to design and deliver...SeniorLocal areaWorldwide- About PocketHealth Burnout, staffing shortages, chronic underfunding — healthcare is under more strain than it has ever been. A disproportionate share of available resources never reach patients; they're consumed by the administrative layer that sits between a provider and...SeniorFull time
$90k - $170k per year
...looking for a Principal security engineer responsible for development... ...security in S&P Ratings Infrastructure and Services including IAM applications... ...position will work across software development, QA, SRE and... ...technical risks, identify and evaluate critical failure points, determine...SeniorPermanent employmentFull timeSecond jobLive InRemote workWorldwideFlexible hoursShift work- ...of API-based payment processing and wallet management infrastructure. We’re 100% cloud-native, hyper-configurable, and a “Top... ...We are a growing fintech organization looking to add a Senior Software Development Engineer in Test! What you’ll be responsible for in this role:...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, Evaluation Infrastructure. Be the first to apply!
- développeur logiciel Toronto, ON
- junior software developer Toronto, ON
- new graduate software developer Toronto, ON
- software developer entry level Toronto, ON
- software engineer co-op Toronto, ON
- software developer co-op Toronto, ON
- software engineer - ai machine learning Toronto, ON
- software engineer salary in canada Toronto, ON
- software engineer devops Toronto, ON
- linux software engineer Toronto, ON