Gpu Kernel Engineer Cuda C++
Baseten
CUDA C++ engineers can design GPU kernels at Baseten, optimizing matrix multiplication and attention for production machine learning inference. Work model is not specified.As a GPU Kernel Engineer, you will support Baseten’s Model Performance team and its inference stack. You will write CUDA and PTX code, apply GPU architecture knowledge, and optimize modern AI workloads. The work includes collaboration with research teams and production systems.Key Responsibilities:
Design high-performance kernels for matrix multiplicationsOptimize attention mechanisms and mixture-of-experts routingApply memory coalescing and warp-level programmingUse tensor cores and compute-memory overlapContribute to internal and open-source GPU librariesRequirements:
Understand GPU architecture and programming paradigmsKnow memory hierarchy and thread organizationMitigate race conditions using synchronization techniquesDemonstrate C++ proficiency and profiling-tool experienceUnderstand CUDA C++ APIs and bandwidth optimizationBuild Baseten’s inference performance through CUDA C++, GPU architecture, kernel optimization, and production-focused machine learning systems.
#J-18808-Ljbffr
Design high-performance kernels for matrix multiplicationsOptimize attention mechanisms and mixture-of-experts routingApply memory coalescing and warp-level programmingUse tensor cores and compute-memory overlapContribute to internal and open-source GPU librariesRequirements:
Understand GPU architecture and programming paradigmsKnow memory hierarchy and thread organizationMitigate race conditions using synchronization techniquesDemonstrate C++ proficiency and profiling-tool experienceUnderstand CUDA C++ APIs and bandwidth optimizationBuild Baseten’s inference performance through CUDA C++, GPU architecture, kernel optimization, and production-focused machine learning systems.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Gpu Kernel Engineer Cuda C++ in Winnipeg, MB vacancy
$180k - $360k per year
...Spark Capital. Join us and help build the platform engineers turn to ship AI products. THE ROLEWe’re seeking a GPU Kernel Engineer to join our team at the cutting edge... ...routing Write and optimize code using CUDA, PTX assembly, and architecture‑specific techniques...SuggestedFlexible hours- ...AMD is looking for a senior software engineer to join our growing team in Ontario. You will drive and enhance AMD's software, delivering... ...to market. The ideal candidate has deep experience in C/C++, kernel or embedded development, and strong OS fundamentals. You will collaborate...Suggested
- Baseten is seeking a GPU Kernel Engineer to design and optimize high-performance GPU kernels for AI workloads. You will work on low-level optimization, leveraging CUDA C++ and tensor cores to accelerate core ML operations, with exposure to state-of-the-art inference systems....Suggested
- ...; over 10 times faster than GPU-based hyperscale cloud inference... ...on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer... ...communication libraries, kernels, drivers, firmware, networking,... ...Strong programming ability in C++ and Python, including experience...Suggested
- ...Technology (SST) is a technology and engineering solutions company specializing... ...Learning Software Engineer – GPU & AI Optimization to join... ...optimizing machine learning kernels, leveraging agentic AI... ...clean, maintainable, and testable C++ and Python code, including microbenchmarks...Suggested
- Company Qualcomm Canada ULCJob Area Engineering Group, Engineering Group GPU ASICS EngineeringGeneral Summary... ...Verilog, UVM, Verilog or VHDL, C/C++ skills required.Constrained random,... ...Performance AnalysisWindows and/or Linux OS Kernel ArchitectureC/C++, GNU Toolchain,...
$150.7k - $251.7k per year
...Inferentia and Trainium.The Acceleration Kernel Library team is at the forefront... ...hardware-software boundary, our engineers craft high-performance kernels... ...- * Experience with GPU kernel optimization and GPGPU computing such as CUDA, NKI, Triton, OpenCL, SYCL, or ROCm...Internship- Build machine learning software in Markham, Ontario, using C++ and Python to optimize GPU kernels, workloads, and next-generation computing platforms... ...Sapphire Stream Technology seeks a Machine Learning Software Engineer focused on GPU and AI optimization. You will develop...
- ...is seeking a strategic software engineering lead to advance performance for... ...and contribute to open-source GPU-accelerated libraries such as rocPRIM... ...will bring 15+ years of C++ experience, strong leadership,... ...software development across HIP, CUDA, or OpenCL, #J-18808-Ljbffr
- ...Devices, Inc. is seeking a strategic software engineering lead to advance ROCm libraries and GPU-accelerated algorithms. You will lead a... ...software. The role requires 15+ years in C++, strong leadership, and experience with HIP/CUDA/OpenCL, plus Linux/Windows development. Collaboration...
- ...Intel compiler software for CPU and GPU architectures in Toronto’s hybrid work model, using C/C++ and compiler optimization... ....As an experienced-hire Compiler Engineer, you will develop production-quality... ...experienceExperience with C/C++, SYCL, CUDA, and DSLsExpertise in compiler...
- Lead GPU code optimization and model acceleration remotely from Canada or the UK as a full-time Senior Machine Learning Engineer. Improve efficiency at high request volume.Raydar is recruiting for... ...systems. Relevant work includes C++, CUDA, Rust, optimized Python, and inference...Full timeRemote work
- ...innovation.We’re redefining what’s possible with GPU-powered, datacenter-scale infrastructure—... ...we’re seeking a GPU Cluster Solutions Engineer to join our product development team.... ...hardware and software, such as NVIDIA CUDA, AMD ROCm, collective communication libraries...Work at officeLocal area
- Optimize GPU kernels and machine learning software onsite in Markham, Ontario, using C++ and Python for advanced computing platforms.Sapphire Stream Technology seeks a Machine Learning Software Engineer focused on GPU and AI optimization. You will develop machine learning kernels...
- As a Low-Level Software Engineer on Tenstorrent’s Low-Level Kernel (LLK) team, you’ll work at the intersection of software and AI hardware to build the primitives... ...hardware teams and influence technical decisionsStrong C/C++ engineer with significant experience building low-level,...
- ...together, we'll advance your career. THE ROLE: As a GPU Design Verification Engineer on the verification team, you will work with leading industry... ...Experienced with Verilog, System Verilog, C/C++ Developing UVM based verification frameworks and testbenches...Internship
$165k - $330k per year
...us and help build the platform engineers turn to ship AI products.About... ...foundational engineers to lead our GPU Networking efforts, making RDMA... ...system behaviors.Optimize Kernels: You will work with communication... ...data movement.You are fluent in C++ or Python, with the ability to...Flexible hours- Advance Linux kernel networking at Arista Networks through C development, upstream collaboration... ...problem solving for EOS.This senior engineering role supports the Linux Kernel team responsible... ...plus three yearsExpert C programming; C++ and Python knowledge is desirableLinux...
$153.91k - $217.28k per year
...talented professionals who are passionate about technology and dedicated to excellence. We are seeking a skilled and experienced GPU Validation Engineer to join our dynamic team. This role requires regular onsite presence to effectively collaborate with cross‑functional teams...Local areaShift work$120k - $195k per year
...several prestigious awards, such as Best Engineering Team, Best Company for Diversity,... ...for developing and maintaining the Linux kernel in EOS. This includes keeping pace with... ...maintainEOS Kernelfeatures and tests using C,C++andPython, review and contribute to functional and...- SystemVerilog and UVM verification define this GPU Engineering role at Qualcomm Canada ULC. Execute testing across pre-silicon and post-silicon... ...related experienceSystemVerilog, UVM, Verilog or VHDL, and C/C++ skillsTest planning, scripting, simulation, debugging, and functional...
- ...value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.... ..., Paris, Berlin and Seoul. Join us! Why this team? The GPU Clusters team builds and operates the superclusters that train Cohere...Full timeWork at officeLocal areaRemote workHome office
- ...looking for a strategic software engineering lead who is passionate about... ...will support our open-source, GPU-accelerated libraries of algorithms... ..., with over 15 years of C++ experience Ability to write... ...software development using HIP, CUDA, or OpenCL Hands-on experience...Internship
- ...5000, a DUNS 100 Top Startup to Work For, and a multi-year Inc. Best Workplace awardee.We are seeking an experienced Senior C++ Software Engineer with strongsystem-level programming expertise and advanced troubleshooting capabilities.The ideal candidate will have a...Work at officeLocal areaRemote work3 days per week
$120k - $140k per year
Aversan Inc. () is a trusted multi-service engineering and electronics manufacturing company. Aversan delivers leading-edge and reliable safety... ...Engineering or Computer Science. Strong experience in C++ software development Solutions implemented on bare metal....- Build low-level kernels for Tenstorrent AI hardware using strong C/C++ skills and hardware-aware performance optimization. Work close to the hardware on foundational software primitives.As a Low-Level Software Engineer on Tenstorrent’s Low-Level Kernel team, you will create...
- ...global OS for distributed AI hardware. We seek a foundational engineer to lead GPU networking, co-optimizing communication and compute for... ...serving and WideEP. You will blend open-source tech with custom kernels to push wire-speed data movement. Join Baseten to shape the next...
- Lead safety-critical embedded software design at Aversan Inc. in Brampton, Ontario, using C++ and real-time operating systems in a hybrid arrangement.As a Senior Embedded Software Engineer, you will develop safety-critical, real-time software for aerospace, defence, and space...
- GPU validation expertise meets Intel’s hybrid Toronto workplace, focused on SV/UVM validation, silicon debug, and graphics interfaces.... ...regularly with cross-functional teams.As an experienced GPU Validation Engineer, you will define and execute functional validation for media,...
- Build production software for NVIDIA DGX Cloud, using Go or Python to automate bare-metal GPU infrastructure. Apply SRE expertise to large-scale AI workloads.As a Senior Software Engineer, you will create operational tooling that moves installed NVIDIA systems into IaaS...Permanent employment
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Gpu Kernel Engineer Cuda C++. Be the first to apply!

