Senior Ml Inference Engineer — Model Efficiency
Cohere
A leading AI technology company is seeking a Member of Technical Staff to enhance model efficiency. This role involves improving performance metrics, optimizing bottlenecks, and collaborating with various teams. The ideal candidate has 5+ years in high-performance coding, strong skills in C++ or Python, and familiarity with large language models. Competitive perks include a flexible work environment, health benefits, and generous vacation time.#J-18808-Ljbffr
- Build machine learning inference APIs with Python and distributed systems expertise at Cerebras... ...connecting GPU prefill with Cerebras decode.As a Senior Software Engineer, you will develop production software across inference APIs, model integration, and request-routing services....Senior
- Randstad Canada in Toronto is seeking a Senior Software Developer for a 7-month onsite contract to lead AI/ML engineering, LLM pipelines, and model inference workloads. You will run batch inferences in Databricks and cloud ML environments, work with DSPy, LangChain, and Hugging...SeniorContract work
- ...deliver industry-leading training and inference speeds; over 10 times faster than GPU-... ...computation. Cerebras works with the leading model labs, global enterprises, and cutting-... ...decode on the Cerebras Wafer-Scale Engine. We are hiring a Senior Software Engineer to build and evolve...Senior
$250k per year
...build cutting-edge foundation AI models and end-to-end products that are... ...Cohere is a team of researchers, engineers, designers, and more, who are all... ...of what AI systems can do — but inference is still the bottleneck. The Model Efficiency team is responsible for pushing the...SuggestedFull timeWork at officeLocal areaRemote workHome office- Cohere is hiring a Backend Engineer to optimize model inference systems. You will build low-latency serving infrastructure, implement batching strategies, and develop the backend services that power Cohere's enterprise API.Requirements 5+ years of backend engineering experienceStrong...SuggestedWork at office
- ...forward. The RoleThe AMD AI Group is looking for a Senior Software Development Engineer to own the end-to-end model execution stack on AMD Instinct GPUs - spanning... ...infrastructure at scale and high-performance inference serving. The PersonThis role demands someone who...SeniorInternshipManual labor
- Member of Technical Staff, Model Efficiency1 day ago Be among the first 25 applicants Get... ...is a fast-growing group of researchers and engineers focused on building reliable ML systems and pushing the boundaries of LLM inference efficiency. We develop techniques that improve...SeniorFull timeWork at officeRemote workFlexible hours
$114.4k - $164.4k per year
Company: Qualcomm Canada ULCJob Area: Engineering Group, Engineering Group Machine Learning EngineeringGeneral... ...team, you will conduct advanced research on model efficiency, model compression techniques, and ML system optimization to push the boundaries of efficient...Work from home- ...applications and next steps. Our partner is looking for an Applied ML Engineer – Model R&D based in Canada. We are looking for a hands-on Applied... ...data ingestion, feature engineering, model integration, inference, serving, monitoring, and reliability. Work closely with...Remote workHome officeFlexible hours
$100k - $145k per year
Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams to enhance capacity forecasting for AI... ..., and Enterprise AI teams to onboard new research models into production. About The Role Within Platform Engineering...SeniorWork at officeLocal areaFlexible hours2 days per week3 days per week- Senior Data Architect / Data Modeller, AI/ML & CloudLocation: Toronto, ON (Hybrid, 3 days onsite per week, near Union Station) Language: Strong written... ...role, you'll collaborate with business leaders, data engineers, architects, and governance teams to design modern,...SeniorContract work3 days per week
- Staff + Senior Software Engineer, InferenceAbout AnthropicAnthropic’s mission is to create reliable,... ...beneficial AI systems. About the roleOur Inference team is responsible for building and... ...bring Claude to life by serving our models via the industry’s largest compute-...SeniorLong term contractWork at officeWorldwideVisa sponsorshipFlexible hours
- ...collaborative team at Katalyst Data Management (KDM)! KDM is seeking a Senior AI/ML Engineer to help design, build, and operate the infrastructure that... ...GPU environments supporting AI workloads, including inference/model serving, OCR and vision models, embeddings, and large‑...SeniorFull timeCasual workWork at officeLocal areaWorldwideMonday to friday
$150.7k - $251.7k per year
...performance for Amazon's custom ML accelerators. Working at the... ...hardware-software boundary, our engineers craft high-performance kernels... ..., enabling unparalleled ML inference and training performance.As part... ...customers to enable their models and ensure optimal performance...SeniorInternship$176.76k - $232k per year
...product innovation, unlocks measurable value, elevates guest and educator experiences, and drives enterprise efficiency. Core responsibilitiesAs a Senior AI/ML Engineer, you will lead the delivery of scalable AI/ML solutions to business problems. You will build, deploy,...SeniorPermanent employmentContract workPart timeWork visa$150.7k - $251.7k per year
DescriptionAre you the kind of engineer who obsesses over performance... ...its infrastructure. The Efficiency Red Team has already driven billions... ...generation, and every new AI model Amazon deploys. You would be... ...management in generative AI inference pipelines to DRAM allocation...SeniorImmediate start- ...learning performance at Waabi through CPU and GPU profiling, memory analysis, and efficient training frameworks. Support research and production systems.This Senior ML Training Optimization Engineer focuses on identifying performance bottlenecks across model runtime and memory....Senior
- Senior AI Engineer, AI Inference Systems Join to apply for the Senior AI Engineer, AI Inference Systems role at Brix .Location : Palo Alto... ...engine to ensure performance, scalability, and cost-efficiency.Collaborate with teammates to implement cutting-edge AI inference...Senior
- Enhance AI capabilities as a Senior Inference Engineer with Thomson Reuters, where hybrid work enables flexibility. Collaborate with cross-functional... ...observability of pipelines Requirements: • 5+ years in AI/ML environments • Proficiency in GPU programming and CUDA • Experience...Senior
- ...deliver industry-leading training and inference speeds; over 10 times faster than GPU... ...computation. Cerebras works with the leading model labs, global enterprises, and cutting-... .... About The RoleWe’re hiring a Senior Frontend Engineer to own and scale critical parts of the...SeniorLong term contractShift work
- ...experienced Machine Learning Engineer to contribute to development of... ...and deploying large language modeling systems at significant scale.... ...community.Create and improve novel ML methods applicable to LLM... ...relevant and accurate responses by efficiently retrieving and incorporating...
$165k - $330k per year
...Baseten powers mission-critical inference for the world's most dynamic... ...frontier of AI to bring cutting-edge models into production. We're growing... ...and help build the platform engineers turn to ship AI products.THE... ...due to its relevance in ML projects.Drive customer impact...InternshipFlexible hours- ...Aspire Software We are hiring for an AI-ML Engineer to join our growing team at Ampliphi in... ...to drive both revenue and operational efficiency. Our roadmap includes the deep productization... ...level insights, and we're looking for a senior engineer who wants to help build and...SeniorWork at office
- Elevate AI workloads with Baseten as an Inference Performance Engineer. Focus on optimizing cutting-edge... ...Performance Engineer committed to improving AI model performance. This role requires... ...our customers’ models run and how efficiently we serve them. Key Responsibilities:...
$180k - $360k per year
...Baseten powers mission-critical inference for the world's most dynamic... ...of AI to bring cutting-edge models into production. We're... ...and help build the platform engineers turn to ship AI products.About... ...Kubernetes and route traffic efficiently. Your job is to make sure every...Flexible hours- ...industry-leading training and inference speeds; over 10 times faster... ...works with the leading model labs, global enterprises, and... ...at massive scale. As an Engineering Manager, Inference Router, you... ...cloud/platform, hardware, and ML teams to optimize end‑to‑end performance...
$180k - $360k per year
...Baseten powers mission-critical inference for the world's most dynamic... ...of AI to bring cutting-edge models into production. We're... ...and help build the platform engineers turn to ship AI products.About... ...workloads run faster and more efficiently. You'll work across the stack...Flexible hours$145k - $170k per year
A leading analytics firm is seeking a Sr. Software Engineer (ML Researcher) in Vancouver. This hybrid position requires expertise in deep learning and geospatial models. Responsibilities include researching and implementing cutting-edge technologies for Earth observation datasets...Senior- ...industry-leading training and inference speeds; over 10 times faster... ...works with the leading model labs, global enterprises, and... ...decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer... ..., tail latency, and capacity efficiency. This is a hands-on role...
- Shellex Groupe Conseil is seeking a Process Engineer to join our Industrial Process Department. Based from one of our... ...processes and contribute to decarbonization and energy-efficiency projects. You will work with senior engineers and multidisciplinary teams, lead technical...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Ml Inference Engineer — Model Efficiency. Be the first to apply!

