Gpu Kernel Engineer Cuda C++
Baseten
CUDA C++ engineers can design GPU kernels at Baseten, optimizing matrix multiplication and attention for production machine learning inference. Work model is not specified.As a GPU Kernel Engineer, you will support Baseten’s Model Performance team and its inference stack. You will write CUDA and PTX code, apply GPU architecture knowledge, and optimize modern AI workloads. The work includes collaboration with research teams and production systems.Key Responsibilities:
Design high-performance kernels for matrix multiplicationsOptimize attention mechanisms and mixture-of-experts routingApply memory coalescing and warp-level programmingUse tensor cores and compute-memory overlapContribute to internal and open-source GPU librariesRequirements:
Understand GPU architecture and programming paradigmsKnow memory hierarchy and thread organizationMitigate race conditions using synchronization techniquesDemonstrate C++ proficiency and profiling-tool experienceUnderstand CUDA C++ APIs and bandwidth optimizationBuild Baseten’s inference performance through CUDA C++, GPU architecture, kernel optimization, and production-focused machine learning systems.
#J-18808-Ljbffr
Design high-performance kernels for matrix multiplicationsOptimize attention mechanisms and mixture-of-experts routingApply memory coalescing and warp-level programmingUse tensor cores and compute-memory overlapContribute to internal and open-source GPU librariesRequirements:
Understand GPU architecture and programming paradigmsKnow memory hierarchy and thread organizationMitigate race conditions using synchronization techniquesDemonstrate C++ proficiency and profiling-tool experienceUnderstand CUDA C++ APIs and bandwidth optimizationBuild Baseten’s inference performance through CUDA C++, GPU architecture, kernel optimization, and production-focused machine learning systems.
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Gpu Kernel Engineer Cuda C++ in Winnipeg, MB vacancy
$180k - $360k per year
...Spark Capital. Join us and help build the platform engineers turn to ship AI products. THE ROLEWe’re seeking a GPU Kernel Engineer to join our team at the cutting edge... ...routing Write and optimize code using CUDA, PTX assembly, and architecture‑specific techniques...SuggestedFlexible hours- Build efficient machine learning kernels with C++ and Python onsite at Sapphire Stream Technology in Markham, Ontario.This Machine Learning Software Engineer role centers on advanced software development, kernel fusion, and GPU computing. You will create maintainable code, microbenchmarks...Suggested
- Become an integral part of Wayve as a GPU Kernel Engineer, specializing in enhancing AI model performance for autonomous vehicles. Utilize your... ...engineers to advance inference capabilities. Your proficiency in C++ and familiarity with tools like TensorRT will help drive...SuggestedFull time
- Where you will have an impactAs an Embedded Kernel Engineer within our dynamic team, you'll be... ...kernels for efficient inferencing on embedded GPU environments. Through close collaboration... ...computational challenges.Advanced C++ Skills: Proficiency in C++ programming, with...SuggestedHourly payFull timeWork at officeWork from home
- Baseten is seeking a GPU Kernel Engineer to design and optimize high-performance GPU kernels for AI workloads. You will work on low-level optimization, leveraging CUDA C++ and tensor cores to accelerate core ML operations, with exposure to state-of-the-art inference systems....Suggested
- Advance machine learning acceleration through kernel optimization, GPU expertise, and parallel programming for Amazon's Neuron platform in Toronto.As a Senior GPU and ML Kernel Optimization Engineer, you will work at the hardware-software boundary within Amazon's Acceleration...
- ...frontier language-model training with CUDA and Python at Cohere, working... ...AI systems.As a Performance Engineer on Cohere’s Pre-Training team,... ...learning, and low-level kernel development. You will identify... ...and XLA/MLIRExperience writing GPU kernels using CUDA or TritonExperience...Remote work
- ...Mozilla in Toronto is seeking aGraphics Engineer to maintain and advance Firefox’s Graphics area, including rendering, compositing, images, canvas, and WebGL. You will help keep the graphics code healthy and scalable in a large, mature codebase. You will diagnose cross‑platform...Contract work
- ...Technology (SST) is a technology and engineering solutions company specializing... ...Learning Software Engineer – GPU & AI Optimization to join... ...optimizing machine learning kernels, leveraging agentic AI... ...clean, maintainable, and testable C++ and Python code, including microbenchmarks...
- ...; over 10 times faster than GPU-based hyperscale cloud inference... ...on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer... ...communication libraries, kernels, drivers, firmware, networking,... ...Strong programming ability in C++ and Python, including experience...
- ...; over 10 times faster than GPU-based hyperscale cloud inference... ...of the Cerebras Wafer-Scale Engine. Our work spans efficient LLM training... ..., runtimes, and low-level kernels to implement new algorithmic capabilities... ...Strong programming skills in C++ and Python. Solid...
$150.7k - $251.7k per year
...Inferentia and Trainium.The Acceleration Kernel Library team is at the forefront... ...hardware-software boundary, our engineers craft high-performance kernels... ...- * Experience with GPU kernel optimization and GPGPU computing such as CUDA, NKI, Triton, OpenCL, SYCL, or ROCm...Internship- Company Qualcomm Canada ULCJob Area Engineering Group, Engineering Group GPU ASICS EngineeringGeneral Summary... ...Verilog, UVM, Verilog or VHDL, C/C++ skills required.Constrained random,... ...Performance AnalysisWindows and/or Linux OS Kernel ArchitectureC/C++, GNU Toolchain,...
- Location: Canada or United StatesFocus: GPU Compilers, Graphics, Performance OptimizationTalentLab is recruiting GPU Compiler Engineers at multiple levels to join a team... ....Strong programming skills, particularly C/C++.Understanding of compiler architecture, optimization...
- Kernel Engineer (AI Accelerator)We are seeking a full remote Kernel Engineer to join a heavily funded ($150m+ Series B) team building next generation hardware AI accelerators for neural net inference.You’ll join a superb group of Engineers realizing the full capabilities of...Remote work
$94.5k - $227.2k per year
...expertise across a range of fields: software engineering, data science, biology, chemistry, protein... ...need you! Responsibilities Develop GPU-accelerated software targeted for real-... ...developing GPU-accelerated software in C/C++, with familiarity in Python for signal processing...Relocation package$95k - $145k per year
...several prestigious awards, such as Best Engineering Team, Best Company for Diversity, Compensation... ...You’ll Work WithArista’s Linux Kernel team is responsible for developing and maintaining... ...maintain EOS Kernel features and tests using C, C++ and Python, review and contribute to...- ...QualificationsEducation : Computer Science, Computer Engineering, Electrical Engineering, or a related technical field.... ...: Familiarity with Heterogeneous Computing and GPU software interfaces such as NVIDIA CUDA or AMD ROCm, or NOS like SoNIC.We are an Equal Opportunity...InternshipLocal area
- ...Intel compiler software for CPU and GPU architectures in Toronto’s hybrid work model, using C/C++ and compiler optimization... ....As an experienced-hire Compiler Engineer, you will develop production-quality... ...experienceExperience with C/C++, SYCL, CUDA, and DSLsExpertise in compiler...
- Build machine learning software in Markham, Ontario, using C++ and Python to optimize GPU kernels, workloads, and next-generation computing platforms... ...Sapphire Stream Technology seeks a Machine Learning Software Engineer focused on GPU and AI optimization. You will develop...
- Advance Linux kernel networking at Arista Networks through C development, upstream collaboration... ...problem solving for EOS.This senior engineering role supports the Linux Kernel team responsible... ...plus three yearsExpert C programming; C++ and Python knowledge is desirableLinux...
- Join to apply for the GPU Cloud Platform Engineer role at Yotta Labs . About Yotta LabsYotta Labs is pioneering the development of a Decentralized... ...or performance optimization projects. Proficiency in CUDA programming and the NCCL communication library;...Full timeRemote workFlexible hours
- Modern C++ drives desktop, embedded, and cloud applications at DarkVision, with fully on... ...BC headquarters.DarkVision seeks Software Engineers across junior, intermediate, and senior levels... ...C++ expertise to desktop visualization, CUDA algorithms, embedded systems, and high-...
- As a Low-Level Software Engineer on Tenstorrent’s Low-Level Kernel (LLK) team, you’ll work at the intersection of software and AI hardware to build the primitives... ...hardware teams and influence technical decisionsStrong C/C++ engineer with significant experience building low-level,...
$153.91k - $217.28k per year
...talented professionals who are passionate about technology and dedicated to excellence. We are seeking a skilled and experienced GPU Validation Engineer to join our dynamic team. This role requires regular onsite presence to effectively collaborate with cross‑functional teams...Local areaShift work- Develop GPU compiler software for Intel AI platforms in Toronto, combining systems programming... ...execution.As an Experienced Hire Compiler Engineer, you will build software for Triton, domain... ...with zero years or PhD acceptedStrong C++ and/or Python programming backgroundDebugging...
- ...foundational AI systems in Montreal as a hybrid engineer connecting high-level frameworks with low-level software and GPU-scale execution.This System Software Engineer role... ...across thousands of GPUs. The position combines C++, Python, Linux development, and performance-focused...
- Test GPU kernels and AI frameworks in a hybrid Montreal SDET role, creating automation that challenges system reliability and performance.You will engineer testing foundations for core AI infrastructure supporting distributed training and inference. The position combines test...
$165k - $330k per year
...us and help build the platform engineers turn to ship AI products.About... ...foundational engineers to lead our GPU Networking efforts, making RDMA... ...system behaviors.Optimize Kernels: You will work with communication... ...data movement.You are fluent in C++ or Python, with the ability to...Flexible hours- ...global OS for distributed AI hardware. We seek a foundational engineer to lead GPU networking, co-optimizing communication and compute for... ...serving and WideEP. You will blend open-source tech with custom kernels to push wire-speed data movement. Join Baseten to shape the next...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Gpu Kernel Engineer Cuda C++. Be the first to apply!

