Gpu Kernel Engineer Cuda C++
Baseten
CUDA C++ engineers can design GPU kernels at Baseten, optimizing matrix multiplication and attention for production machine learning inference. Work model is not specified.As a GPU Kernel Engineer, you will support Baseten’s Model Performance team and its inference stack. You will write CUDA and PTX code, apply GPU architecture knowledge, and optimize modern AI workloads. The work includes collaboration with research teams and production systems.Key Responsibilities:
Design high-performance kernels for matrix multiplicationsOptimize attention mechanisms and mixture-of-experts routingApply memory coalescing and warp-level programmingUse tensor cores and compute-memory overlapContribute to internal and open-source GPU librariesRequirements:
Understand GPU architecture and programming paradigmsKnow memory hierarchy and thread organizationMitigate race conditions using synchronization techniquesDemonstrate C++ proficiency and profiling-tool experienceUnderstand CUDA C++ APIs and bandwidth optimizationBuild Baseten’s inference performance through CUDA C++, GPU architecture, kernel optimization, and production-focused machine learning systems.
#J-18808-Ljbffr
Design high-performance kernels for matrix multiplicationsOptimize attention mechanisms and mixture-of-experts routingApply memory coalescing and warp-level programmingUse tensor cores and compute-memory overlapContribute to internal and open-source GPU librariesRequirements:
Understand GPU architecture and programming paradigmsKnow memory hierarchy and thread organizationMitigate race conditions using synchronization techniquesDemonstrate C++ proficiency and profiling-tool experienceUnderstand CUDA C++ APIs and bandwidth optimizationBuild Baseten’s inference performance through CUDA C++, GPU architecture, kernel optimization, and production-focused machine learning systems.
#J-18808-Ljbffr
Vacancy posted 49 minutes ago
Similar jobs that could be interesting for youBased on the Gpu Kernel Engineer Cuda C++ in Winnipeg, MB vacancy
$180k - $360k per year
...Spark Capital. Join us and help build the platform engineers turn to ship AI products. THE ROLEWe’re seeking a GPU Kernel Engineer to join our team at the cutting edge... ...routing Write and optimize code using CUDA, PTX assembly, and architecture‑specific techniques...SuggestedFlexible hours- Build efficient machine learning kernels with C++ and Python onsite at Sapphire Stream Technology in Markham, Ontario.This Machine Learning Software Engineer role centers on advanced software development, kernel fusion, and GPU computing. You will create maintainable code, microbenchmarks...Suggested
- Baseten is seeking a GPU Kernel Engineer to design and optimize high-performance GPU kernels for AI workloads. You will work on low-level optimization, leveraging CUDA C++ and tensor cores to accelerate core ML operations, with exposure to state-of-the-art inference systems....Suggested
- ...AMD is looking for a senior software engineer to join our growing team in Ontario. You will drive and enhance AMD's software, delivering... ...to market. The ideal candidate has deep experience in C/C++, kernel or embedded development, and strong OS fundamentals. You will collaborate...Suggested
- Advance machine learning acceleration through kernel optimization, GPU expertise, and parallel programming for Amazon's Neuron platform in Toronto.As a Senior GPU and ML Kernel Optimization Engineer, you will work at the hardware-software boundary within Amazon's Acceleration...Suggested
- ...frontier language-model training with CUDA and Python at Cohere, working... ...AI systems.As a Performance Engineer on Cohere’s Pre-Training team,... ...learning, and low-level kernel development. You will identify... ...and XLA/MLIRExperience writing GPU kernels using CUDA or TritonExperience...Remote work
- ...Technology (SST) is a technology and engineering solutions company specializing... ...Learning Software Engineer – GPU & AI Optimization to join... ...optimizing machine learning kernels, leveraging agentic AI... ...clean, maintainable, and testable C++ and Python code, including microbenchmarks...
- ...; over 10 times faster than GPU-based hyperscale cloud inference... ...on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer... ...communication libraries, kernels, drivers, firmware, networking,... ...Strong programming ability in C++ and Python, including experience...
$150.7k - $251.7k per year
...Inferentia and Trainium.The Acceleration Kernel Library team is at the forefront... ...hardware-software boundary, our engineers craft high-performance kernels... ...- * Experience with GPU kernel optimization and GPGPU computing such as CUDA, NKI, Triton, OpenCL, SYCL, or ROCm...Internship- Company Qualcomm Canada ULCJob Area Engineering Group, Engineering Group GPU ASICS EngineeringGeneral Summary... ...Verilog, UVM, Verilog or VHDL, C/C++ skills required.Constrained random,... ...Performance AnalysisWindows and/or Linux OS Kernel ArchitectureC/C++, GNU Toolchain,...
- ...Intel compiler software for CPU and GPU architectures in Toronto’s hybrid work model, using C/C++ and compiler optimization... ....As an experienced-hire Compiler Engineer, you will develop production-quality... ...experienceExperience with C/C++, SYCL, CUDA, and DSLsExpertise in compiler...
- ...QualificationsEducation : Computer Science, Computer Engineering, Electrical Engineering, or a related technical field.... ...: Familiarity with Heterogeneous Computing and GPU software interfaces such as NVIDIA CUDA or AMD ROCm, or NOS like SoNIC.We are an Equal Opportunity...InternshipLocal area
$95k - $145k per year
...several prestigious awards, such as Best Engineering Team, Best Company for Diversity, Compensation... ...You’ll Work WithArista’s Linux Kernel team is responsible for developing and maintaining... ...maintain EOS Kernel features and tests using C, C++ and Python, review and contribute to...- Build machine learning software in Markham, Ontario, using C++ and Python to optimize GPU kernels, workloads, and next-generation computing platforms... ...Sapphire Stream Technology seeks a Machine Learning Software Engineer focused on GPU and AI optimization. You will develop...
- ...foundational AI systems in Montreal as a hybrid engineer connecting high-level frameworks with low-level software and GPU-scale execution.This System Software Engineer role... ...across thousands of GPUs. The position combines C++, Python, Linux development, and performance-focused...
- Advance Linux kernel networking at Arista Networks through C development, upstream collaboration... ...problem solving for EOS.This senior engineering role supports the Linux Kernel team responsible... ...plus three yearsExpert C programming; C++ and Python knowledge is desirableLinux...
- Develop GPU compiler software for Intel AI platforms in Toronto, combining systems programming... ...execution.As an Experienced Hire Compiler Engineer, you will build software for Triton, domain... ...with zero years or PhD acceptedStrong C++ and/or Python programming backgroundDebugging...
$153.91k - $217.28k per year
...talented professionals who are passionate about technology and dedicated to excellence. We are seeking a skilled and experienced GPU Validation Engineer to join our dynamic team. This role requires regular onsite presence to effectively collaborate with cross‑functional teams...Local areaShift work$165k - $330k per year
...us and help build the platform engineers turn to ship AI products.About... ...foundational engineers to lead our GPU Networking efforts, making RDMA... ...system behaviors.Optimize Kernels: You will work with communication... ...data movement.You are fluent in C++ or Python, with the ability to...Flexible hours- Test GPU kernels and AI frameworks in a hybrid Montreal SDET role, creating automation that challenges system reliability and performance.You will engineer testing foundations for core AI infrastructure supporting distributed training and inference. The position combines test...
- As a Low-Level Software Engineer on Tenstorrent’s Low-Level Kernel (LLK) team, you’ll work at the intersection of software and AI hardware to build the primitives... ...hardware teams and influence technical decisionsStrong C/C++ engineer with significant experience building low-level,...
- Join Arista Networks as a Software Engineer focused on Linux Kernel advancements. Drive innovation in the evolving landscape of client-to-cloud networking... ...with 3+ years’ experience • Proficiency in C programming; C++ and Python are a plus • Strong understanding of Linux...
- Build low-level kernels for Tenstorrent AI hardware using strong C/C++ skills and hardware-aware performance optimization. Work close to the hardware on foundational software primitives.As a Low-Level Software Engineer on Tenstorrent’s Low-Level Kernel team, you will create...
- ...value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.... ..., Paris, Berlin and Seoul. Join us! Why this team? The GPU Clusters team builds and operates the superclusters that train Cohere...Full timeWork at officeLocal areaRemote workHome office
- ...advance your career.THE ROLE: As a Systems Validation Engineer within the Datacenter and GPU Accelerated Processing division, you will execute on SOC and... ...FPGA/prototyping environments.Proficiency in Python and C/C++ for automation, test infrastructure, or debug-analysis...Internship
- ...global OS for distributed AI hardware. We seek a foundational engineer to lead GPU networking, co-optimizing communication and compute for... ...serving and WideEP. You will blend open-source tech with custom kernels to push wire-speed data movement. Join Baseten to shape the next...
- ...5000, a DUNS 100 Top Startup to Work For, and a multi-year Inc. Best Workplace awardee.We are seeking an experienced Senior C++ Software Engineer with strongsystem-level programming expertise and advanced troubleshooting capabilities.The ideal candidate will have a...Work at officeLocal areaRemote work3 days per week
$120k - $140k per year
Aversan Inc. () is a trusted multi-service engineering and electronics manufacturing company. Aversan delivers leading-edge and reliable safety... ...Engineering or Computer Science. Strong experience in C++ software development Solutions implemented on bare metal....- GPU programming and computational physics define this AI Specialist... ...software using profiling, kernels, and HPC platformsBuild simulators... ..., computer science, engineering, or related fieldSix-plus years... ...ecosystem knowledgeGPU acceleration, CUDA, kernel, and JAX...
$140k - $190k per year
...state-of-the-art machine learning, GPU programming, and computational... ...researchers, scientists, engineers, and software developers, using... ...leveraging GPU programming, custom kernels, code profiling and... ...Experience with GPU programming (e.G., CUDA), kernel development, and GPU computing...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Gpu Kernel Engineer Cuda C++. Be the first to apply!

