Senior Ml Inference Engineer — Model Efficiency
Cohere
A leading AI technology company is seeking a Member of Technical Staff to enhance model efficiency. This role involves improving performance metrics, optimizing bottlenecks, and collaborating with various teams. The ideal candidate has 5+ years in high-performance coding, strong skills in C++ or Python, and familiarity with large language models. Competitive perks include a flexible work environment, health benefits, and generous vacation time.#J-18808-Ljbffr
- Build machine learning inference APIs with Python and distributed systems expertise at Cerebras... ...connecting GPU prefill with Cerebras decode.As a Senior Software Engineer, you will develop production software across inference APIs, model integration, and request-routing services....Senior
- Randstad Canada in Toronto is seeking a Senior Software Developer for a 7-month onsite contract to lead AI/ML engineering, LLM pipelines, and model inference workloads. You will run batch inferences in Databricks and cloud ML environments, work with DSPy, LangChain, and Hugging...SeniorContract work
- ...deliver industry-leading training and inference speeds; over 10 times faster than GPU-... ...computation. Cerebras works with the leading model labs, global enterprises, and cutting-... ...decode on the Cerebras Wafer-Scale Engine. We are hiring a Senior Software Engineer to build and evolve...Senior
$250k per year
...build cutting-edge foundation AI models and end-to-end products that are... ...Cohere is a team of researchers, engineers, designers, and more, who are all... ...of what AI systems can do — but inference is still the bottleneck. The Model Efficiency team is responsible for pushing the...SuggestedFull timeWork at officeLocal areaRemote workHome office- Cohere is hiring a Backend Engineer to optimize model inference systems. You will build low-latency serving infrastructure, implement batching strategies, and develop the backend services that power Cohere's enterprise API.Requirements 5+ years of backend engineering experienceStrong...SuggestedWork at office
- ...forward. The RoleThe AMD AI Group is looking for a Senior Software Development Engineer to own the end-to-end model execution stack on AMD Instinct GPUs - spanning... ...infrastructure at scale and high-performance inference serving. The PersonThis role demands someone who...SeniorInternshipManual labor
$135k - $185k per year
A leading technology company located in Toronto is seeking a Senior Machine Learning Applications and Compiler Engineer to develop and optimize algorithms for inference and compiler stacks. Ideal candidates should have a strong background in C/C++, compiler development, and...Senior- Cohere is seeking an experienced engineer to join the Model Efficiency team, focusing on building reliable ML systems and optimizing LLM inference. You will improve the inference stack, reduce latency, and boost throughput across diverse workloads. The role offers remote-friendly...Remote work
- Member of Technical Staff, Model Efficiency1 day ago Be among the first 25 applicants Get... ...is a fast-growing group of researchers and engineers focused on building reliable ML systems and pushing the boundaries of LLM inference efficiency. We develop techniques that improve...SeniorFull timeWork at officeRemote workFlexible hours
- ...We’re hiring a Staff Backend Engineer to build and operate the infrastructure those models depend on. You’ll design and operate... ...reliability, and scalability of inference systems. Join us and help influence... ...infrastructure Partner with ML engineers to ensure online...Work at officeWorldwide
- ...applications and next steps. Our partner is looking for an Applied ML Engineer – Model R&D based in Canada. We are looking for a hands-on Applied... ...data ingestion, feature engineering, model integration, inference, serving, monitoring, and reliability. Work closely with...Remote workHome officeFlexible hours
$250k per year
...build cutting-edge foundation AI models and end-to-end products that are... ...Cohere is a team of researchers, engineers, designers, and more, who are all... ...engineers focused on building reliable ML systems and pushing the boundaries of LLM inference efficiency. We develop techniques...Full timeWork at officeLocal areaRemote workHome office$114.4k - $164.4k per year
Company: Qualcomm Canada ULCJob Area: Engineering Group, Engineering Group Machine Learning EngineeringGeneral... ...team, you will conduct advanced research on model efficiency, model compression techniques, and ML system optimization to push the boundaries of efficient...Work from home$100k - $145k per year
Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams to enhance capacity forecasting for AI... ..., and Enterprise AI teams to onboard new research models into production. About The Role Within Platform Engineering...SeniorWork at officeLocal areaFlexible hours2 days per week3 days per week$80 per hour
SENIOR MACHINE LEARNING ENGINEER (Azure MLOps; Enterprise AI & Data Centre of Excellence) Requisition #:... ...Service Delivery team within Metrolinx.WORK MODEL: The successful contractor will be... ...Automate, VSCode, Git, Jira, Azure (ML Studio, AI Foundry), Databricks.Deep...SeniorHourly payFor contractorsWork at office- Senior Data Architect / Data Modeller, AI/ML & CloudLocation: Toronto, ON (Hybrid, 3 days onsite per week, near Union Station) Language: Strong written... ...role, you'll collaborate with business leaders, data engineers, architects, and governance teams to design modern,...SeniorContract work3 days per week
- ...group of committed researchers, engineers, policy experts, and business... .... About the roleOur Inference team is responsible for building... ...Claude to life by serving our models via the industry’s largest... ...mandate: maximizing compute efficiency to reliably serve our explosive...SeniorLong term contractWork at officeWorldwideVisa sponsorshipFlexible hours
- ...collaborative team at Katalyst Data Management (KDM)! KDM is seeking a Senior AI/ML Engineer to help design, build, and operate the infrastructure that... ...GPU environments supporting AI workloads, including inference/model serving, OCR and vision models, embeddings, and large‑...SeniorFull timeCasual workWork at officeLocal areaWorldwideMonday to friday
$176.76k - $232k per year
...product innovation, unlocks measurable value, elevates guest and educator experiences, and drives enterprise efficiency. Core responsibilitiesAs a Senior AI/ML Engineer, you will lead the delivery of scalable AI/ML solutions to business problems. You will build, deploy,...SeniorPermanent employmentContract workPart timeWork visa$150.7k - $251.7k per year
...performance for Amazon's custom ML accelerators. Working at the... ...hardware-software boundary, our engineers craft high-performance kernels... ..., enabling unparalleled ML inference and training performance.As part... ...customers to enable their models and ensure optimal performance...SeniorInternship- Senior AI Engineer, AI Inference Systems Join to apply for the Senior AI Engineer, AI Inference Systems role at Brix .Location : Palo Alto... ...engine to ensure performance, scalability, and cost-efficiency.Collaborate with teammates to implement cutting-edge AI inference...Senior
- ...learning performance at Waabi through CPU and GPU profiling, memory analysis, and efficient training frameworks. Support research and production systems.This Senior ML Training Optimization Engineer focuses on identifying performance bottlenecks across model runtime and memory....Senior
$150.7k - $251.7k per year
DescriptionAre you the kind of engineer who obsesses over performance... ...its infrastructure. The Efficiency Red Team has already driven billions... ...generation, and every new AI model Amazon deploys. You would be... ...management in generative AI inference pipelines to DRAM allocation...SeniorImmediate start- ...experienced Machine Learning Engineer to contribute to development of... ...and deploying large language modeling systems at significant scale.... ...community.Create and improve novel ML methods applicable to LLM... ...relevant and accurate responses by efficiently retrieving and incorporating...
- ...deliver industry-leading training and inference speeds; over 10 times faster than GPU... ...computation. Cerebras works with the leading model labs, global enterprises, and cutting-... .... About The RoleWe’re hiring a Senior Frontend Engineer to own and scale critical parts of the...SeniorLong term contractShift work
- Shape AI inference software at Cerebras Systems with Python, model serving, and production API experience across accelerator backends.This Senior Software Engineer role focuses on making disaggregated inference accessible, reliable, and consistent. You will work across model...Senior
- Enhance AI capabilities as a Senior Inference Engineer with Thomson Reuters, where hybrid work enables flexibility. Collaborate with cross-functional... ...observability of pipelines Requirements: • 5+ years in AI/ML environments • Proficiency in GPU programming and CUDA • Experience...Senior
$145k - $170k per year
A leading analytics firm is seeking a Sr. Software Engineer (ML Researcher) in Vancouver. This hybrid position requires expertise in deep learning and geospatial models. Responsibilities include researching and implementing cutting-edge technologies for Earth observation datasets...Senior- Senior Data Engineer, ML Platform The roleYou sit on the ML team beside Machine Learning Engineers and own the data infrastructure for model training, inference and monitoring. Today strong software engineers do the data work without lineage, pipeline observability or quality...SeniorLong term contract
$165k - $330k per year
...Baseten powers mission-critical inference for the world's most dynamic... ...frontier of AI to bring cutting-edge models into production. We're growing... ...and help build the platform engineers turn to ship AI products.THE... ...due to its relevance in ML projects.Drive customer impact...InternshipFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Ml Inference Engineer — Model Efficiency. Be the first to apply!

