Inference Performance Engineer at Baseten
Baseten
Elevate AI workloads with Baseten as an Inference Performance Engineer. Focus on optimizing cutting-edge inference techniques while working in a dynamic, fast-paced environment. At Baseten, we're seeking an Inference Performance Engineer committed to improving AI model performance. This role requires expertise in runtime internals and includes skills such as quantization, decoder specs, and KV-cache management. You’ll be directly impacting how our customers’ models run and how efficiently we serve them. Key Responsibilities:
- Implement advanced inference techniques for runtime optimization
- Optimize end-to-end performance, identifying bottlenecks
- Provide clear latency/throughput/cost tradeoffs to stakeholders
- Bring up new model architectures on release day
- Develop benchmarking frameworks for performance measurement
- Degree in Computer Science, Engineering, or related field
- Proficient in Python, C++, or similar languages
- Familiarity with LLM optimization techniques
- Strong experience with ML libraries like PyTorch
- Deep understanding of GPU architecture
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Inference Performance Engineer at Baseten in Montréal, QC vacancy
$180k - $360k per year
...About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion... ...us and help build the platform engineers turn to ship AI products. About... ...We're looking for inference performance engineers who want to make the world...PerformanceFlexible hours- Join Baseten as a Distributed Systems Engineer and revolutionize AI inference. This role focuses on building large-scale systems for deployed models, optimizing cost-efficiency... ...to create an infrastructure that supports high-performance AI models in production. You'll be responsible...Performance
$180k - $360k per year
...About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion... ...us and help build the platform engineers turn to ship AI products. About... ...models with industry-leading performance, scalability, and reliability. It...PerformanceFlexible hours- .... We’re hiring a Staff Backend Engineer to build and operate the infrastructure... ...decisions, with a focus on the performance, reliability, and scalability of inference systems. Join us and help... ...NYSE: U] is the world’s leading game engine, powering play for more than 3 billion...PerformanceWork at officeWorldwideRelocation package
- ...across time zones to support projects on all major platforms, engines and styles - from AAA titles to emerging technologies. Our team... ..., you will own and drive the development of core systems and performance initiatives from planning and design through implementation and...PerformanceFull timeRemote workFlexible hours
- ...QA Engineer – Performance & Automation Testing Montreal, QC - Onsite (5 Days WFO) 6-12 months Experience level: 4-8 years Key tasks of candidate: • Contribute to DevOps automation and improvements. • Evolve/Build Integration and System test suites with...PerformancePermanent employment
- ...for you! About the Role We are looking for a hands-on Performance Tester with strong experience investigating performance issues... ...: ~5+ years of hands-on performance or scalability engineering experience. Recent experience testing applications in cloud...PerformanceRemote jobPermanent employmentFull time
- ...across North America. Paid acquisition is one of our main growth engines. Every dollar we spend on Meta, Google or LinkedIn has to turn... ...landing page did it. We are building the future of AI-native performance marketing, and we need someone to own it. Role Overview...PerformanceFull timeInternshipLive InWork at officeWork from home2 days per week3 days per week
$123k - $180.4k per year
...Machine Learning Operations Developer, Inference, AI/ML Platform Position Overview Autodesk, a global leader in 3D design, engineering, manufacturing, and entertainment software... ...and logging systems to track model performance, system health, and overall platform efficiency...PerformanceApprenticeship- ...opportunity We’re looking for a Head of Field Operations & Performance to b uild, lead and optimize all field-based service delivery... .../escalation. ~ Bachelor’s degree in Business, Operations, Engineering, or related field (or equivalent practical experience). ~ Demonstrable...PerformanceFull timeFlexible hours
- ...Montreal, On-site Summary Valnet is hiring a Director of Performance Marketing to lead and scale paid acquisition across our portfolio... ...etc. to turn paid acquisition into a durable, compounding growth engine. Responsibilities Own the performance marketing strategy...PerformanceFull time
- ...continu, Tecsys pourrait être un excellent choix pour vous! À propos du rôle Nous sommes à la recherche d’un(e) testeur(euse) de performance pratique et autonome, possédant une solide expérience dans l’analyse et la résolution de problèmes de performance au sein d’...PerformancePermanent employmentApprenticeshipWork at officeRemote work
- ...Opportunity We are seeking a highly motivated and proactive Endpoint Performance Specialist to join our Digital IT team. In this fast-paced... ...optimizing endpoint management, automation, and performance engineering solutions that enhance the digital employee experience across...PerformanceLong term contractFull timeWork at office
- ...guidance through a mobile app designed to help people better understand and take action on their health. About the Role Lead performance marketing and growth for a consumer health platform. This role sits at the intersection of analytical rigor and creative...PerformanceFull timeInternshipRemote workFlexible hours
$74k - $102k per year
...Richter Montreal Office The Role: The Richter Risk,performance and technology Team is looking for a Senior Cybersecurity Advisor... ...for Computer Science, Information Security or Computer Engineering ~ Foundational knowledge of threat intelligence and threat hunting...PerformanceFull timeWork at office- ...sécuritaire, inclusif et équitable qui te permettra de t’épanouir. Description du poste En tant que Spécialiste senior, médias de performance , tu es le chef d'orchestre technique et stratégique des campagnes de nos clients. Tu ne te contentes pas de "cliquer" : tu...PerformanceDaily paidFull timeApprenticeshipWork at officeRemote workWork from home
- ...measurable business results. You lead BDC’s digital growth, acquisition, performance marketing, marketing automation, Martech and website operations... ...Team, you help evolve Marketing into a value creation engine driven by data, measurable performance and continuous optimization...PerformanceFlexible hours
$91.37k - $120k per year
...une grande importance à l'humain. Et une expertise aussi exceptionnelle mérite d'être partagée! Le responsable acquisition & performance marketing est un acteur clé de notre croissance. Au sein d'une petite équipe agile et en étroite collaboration avec le vice-président...PerformancePermanent employmentFull timeWork at officeRemote workFlexible hours- ...quotidien. \ \ Envie de relever un défi palpitant ? Nous sommes à la recherche d’un conseiller ou d’une conseillère en audit de performance \ qui se joindra à l’équipe des services -conseils au bureau de Québec \ , de Trois -Rivières \ , de Terrebonne \ ou de...PerformanceDaily paidFull timeWork at officeFlexible hours
- ...BDC is seeking a senior leader to drive digital growth and performance marketing for Canadian entrepreneurs. You will shape marketing strategy, lead the acquisition funnel, and optimize Martech and website operations to generate measurable business results. As a member...Performance
- ...aptitudes de l’équipe, tout en recherchant continuellement des façons d’améliorer la valeur des prestations. Diriger une équipe très performante; fournir une rétroaction continue et des évaluations de rendement; coacher et former les employés; faire en sorte que des activités...PerformanceDaily paid
- ...de premier plan à travers toutes ses activités. Le Rôle Charton Hobbs est à la recherche d’un Directeur, Finance (Contrôle et Performance) qui jouera un rôle clé dans la gouvernance financière, la performance d’affaires et l’amélioration continue des opérations....PerformancePermanent employmentFull time
- Permacon, division d'Oldcastle Architectural, est un leader nord-américain dans la fabrication de produits en béton pour l'aménagement extérieur et la maçonnerie. Le Directeur des opérations dirige les activités de production en contrôlant les coûts, la productivité et le développement...Performance
- ...adoption plans that enable the organization to fully leverage it. Job description: The client is looking for a Performance Test Engineer to join the Guidewire team. Their daily work involves designing, automating, and executing load scenarios with Grafana K6 to...PerformanceFull time
- ...responsable de programme senior , vous dirigerez la mise en œuvre d’initiatives clés au sein du portefeuille d’activités de marketing à la performance de Lightspeed, en favorisant les avancées stratégiques, l’efficacité opérationnelle et une croissance mesurable. Vous collaborerez...PerformanceFull timeApprenticeshipRemote workFlexible hoursDay shift
- ...Location: Montreal, On-site Summary: Valnet is hiring a Senior Performance Marketing Manager to directly manage and scale paid acquisition for one or more assigned products within our digital portfolio. This is a hands on role with day to day ownership of campaign execution...PerformanceFull time
- ...partager leur savoir. Description du poste Notre Gestionnaire principal·e, aura pour fonction d'assurer le dimensionnement et la performance de l'ensemble des réseaux, systèmes et plateformes de la Direction technologique. Plus précisément, ses principales...PerformanceFull timeRemote work
- ...Desjardins recherche un Directeur(-trice) principal(e), Performance financière, pour piloter les activités financières et stratégiques du secteur assurance de dommages. Vous assurerez l'exécution des plans et le respect des objectifs, tout en développant les talents et en...Performance
- ...Solution SFT cherche un (e) Conseiller en performance organisationnelle , dans ce poste vous interviendrez dans le cadre d'un projet client qui relève du secteur public dans la ville du Québec , Montreal et Laval . Activités à réaliser : Le conseiller en performance...PerformanceDaily paidDay shift
- ...Senior Performance Marketing Manager About the Role We’re seeking a Senior Performance Marketing Manager to own and scale our digital acquisition strategy across our brand. This is a high-impact role for a data-driven marketer who thrives on optimizing performance...PerformanceFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Inference Performance Engineer at Baseten. Be the first to apply!
Related searches
- ingénieur en planification Montréal, QC
- ingénieur d'usine Montréal, QC
- traveling engineer Montréal, QC
- evaluation engineer Montréal, QC
- failure analysis engineer Montréal, QC
- storage engineer Montréal, QC
- entry level engineer Montréal, QC
- seismic engineer Montréal, QC
- engineer in training Montréal, QC
- engineer Montréal, QC