Senior Machine Learning Inference Engineer
raydar
Optimize machine learning inference with GPU performance tuning while working remotely from Canada or the UK in a full-time position. Build dependable serving systems for high request volumes.
Raydar recruits for its software company client, seeking a senior engineer to move trained models from research into production. The work combines server-side software, inference optimization frameworks, systems programming, and distributed serving. You will improve model performance and operate services across GPUs and nodes.
Key Responsibilities:
- Optimize model serving latency and throughput
- Containerize models for stable production deployment
- Profile and tune GPU-based code
- Design distributed serving across GPUs and nodes
- Apply quantization, batching, and caching methods
Requirements:
- Senior-level software or inference engineering experience
- Production experience with server-side or learning-based software
- Machine learning inference optimization framework experience
- C++, CUDA, Rust, or optimized Python proficiency
- Distributed systems and container orchestration familiarity
Use inference optimization, GPU programming, and distributed systems expertise to deliver reliable machine learning production serving.
#J-18808-LjbffrVacancy posted 9 hours ago
Similar jobs that could be interesting for youBased on the Senior Machine Learning Inference Engineer in Toronto, ON vacancy
- ...The Senior Machine Learning Engineer will deploy, integrate, monitor, and operationalize AI and machine-learning solutions using modern MLOps practices. The role will establish reusable deployment patterns, tooling, monitoring, and automation that enable AI solutions to move...Senior
- ...It all started when engineer Fred Luddy wrote code that automated a tedious task for... ...people. Job Description The Machine Learning Developer designs, builds, ships, and operates... ...authored. The Developer builds the engine behind ServiceNow's optimization products...SeniorFull timeWork at officeLocal areaImmediate startRemote workFlexible hours
$150k - $200k per year
...Senior Machine Learning Engineer – AI Innovation Teams As one of the world’s top three credit ratings agencies, Fitch Ratings plays a critical role in global capital markets by providing credit analysis, ratings, research, and commentary to financial market participants...SeniorLong term contractInternshipManual laborImmediate start$72.06k - $138.94k per year
...At Capgemini Engineering, the world leader in engineering services, we bring together a global... ...considering We are seeking a hands-on machine learning systems engineer to optimize production-grade large language model inference across current and next-generation AWS Trainium...SeniorPermanent employmentFull timeLocal areaRemote work$100k - $145k per year
...Job Description As a Machine Learning Engineer, you will build and deploy production machine learning and large language model (LLM) systems that... ...Customers, Compete to Win, Challenge (Y)our Thinking, Act Fast / Learn Fast, and Stronger Together. Social Impact: Make an...SeniorFull timeWork at officeLocal areaRemote workFlexible hours- ...to democratize AI. Leveraging proprietary AI Studio and AI Engines, the company helps drive the clients’ AI Enterprise Transformation... ...Type: Remote, Full-time Role Overview We’re hiring a Senior Machine Learning Engineer to architect, build, and deploy high-performance...SeniorFull timeContract workLocal areaRemote workWorldwide
$170k per year
...dedicated group of recommendations, search, applied research and ML engineers working full time on discovery for Everand and Fable. The... ...and Everand. Role Overview We're looking for a Senior Machine Learning Engineer to own recommendations for Fable and grow into the...SeniorLong term contractFull timeFor contractorsLocal areaHome officeFlexible hours- ...We are looking for a Machine Learning Engineer to join our Toronto team and help us take our products to the next level in terms of visual intelligence... ..., and knowledge distillation Familiarity with edge inference tools such as ONNX Runtime, TensorRT Familiarity with...Full timeInternshipManual laborWork at office3 days per week
$200k - $275k per year
...at scale. We are a diverse team of engineers, product managers, and designers who are... ...team under Okta Secures AI as a Principal Machine Learning (ML) Engineer to advance Okta's... ...in real time. Integrate low-latency inference or semantic evaluation engines directly...Local areaWorldwideFlexible hoursShift work$186.1k - $265.8k per year
...About the Role: The Machine Learning team at Tubi drives the innovation behind personalized user experiences. With the largest... ...of streaming. We are seeking a highly skilled Senior Machine Learning Engineer to contribute to transformative projects in video personalization...SeniorRemplacementLong term contractFull timeTemporary workWork at officeLocal areaRemote workFlexible hours$156.5k - $190k per year
...data, with a strong focus on AI. Job Requirements: As a Senior Applied Machine Learning Scientist, you will lead a high-performing team of AI/ML professionals... ...with cross-functional teams including Machine Learning Engineers and research scientist, data scientists, and business...SeniorWork from home- ...Risk, and Payments organizations are excited to offer Master's machine learning engineering internships for the summer of 2027. This is an exceptional... ...and proactively seek solutions to challenges. Rapidly learn new technologies and approaches, demonstrating a strong ability...Summer workInternshipSummer internship
- ...prominent VC and angel investors. Your Role As an AI / Machine Learning Engineer at Thri5, you'll help build the agent layer that powers... ...feature engineering, training, evaluation, and production inference. MLOps / LLMOps & Reliability Implement robust MLOps...Full time
- ...from data. Our consultants bring deep expertise in Data Science, Machine Learning, and AI. Our business value and leadership have been... ...We are looking for a motivated and passionate Machine Learning Engineers for our team. As part of this job, you will be responsible...Full timeRemote work
- ...create, apply and work with algorithms that learn and analyze data, just like the human brain. By leveraging AI and machine learning technologies, you'll help us deliver... ...highly skilled and experienced Machine Learning Engineering Developer II to join our team. This role...Full timeWork at office3 days per week
$181.36k - $272.04k per year
...justice . Summary: We are currently seeking a Manager, Machine Learning Engineering to join our rapidly growing engineering organization. This... ..., and full stack developers across a variety of projects Learn new things, challenge yourself, and hone your craft as an ML...Work at officeLocal areaRemote workFlexible hours$45 - $70 per hour
...environment where you’ll collaborate with top researchers and engineers in the field. We provide opportunities for interns to make significant... ...Master's degree in Computer Science, Artificial Intelligence, Machine Learning, or a related technical field. Proficiency in Python and...Hourly payInternshipWork at officeLocal area$100k - $145k per year
...Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams to enhance capacity forecasting for... ..., inference runtimes (TensorRT, ONNX ~ Runtime), and deep learning frameworks (PyTorch/TensorFlow) ~ Proficiency in Python and...SeniorFull timeWork at officeLocal areaFlexible hours- ...customers. Cohere is a team of researchers, engineers, designers, and more, who are... ...high-performance, scalable and reliable machine learning systems? Do you want to help define and... ...they influence latency and throughput of inference. ~ Strong understanding or working experience...Full timeWork at officeRemote workFlexible hours
$220k - $260k per year
...Machine Learning Engineer, Associate Director – AI Innovation Teams Fitch Ratings is seeking a Machine Learning Engineer to join our new AI Innovation... ...who wants to remain deeply hands-on while operating at a senior level. You will contribute technical expertise, influence...SeniorLong term contractImmediate start$14.13k per year
...Course number and title : CSC2515HS - Introduction to Machine Learning Please note, this position is a 0.5 FCE appointment.... ...Machine learning (ML) is a set of techniques that allow computers to learn from data and experience, rather than requiring humans to specify...Long term contractWork at office$85 per hour
...and Jack Dorsey . Position: ML Engineer (Coding Agent Experience) Type:... ...agents to complete and evaluate complex machine learning and AI engineering tasks.... ...implementations involving model training , inference systems , MLOps , and LLM applications...Remote jobContract workSummer work- ...who’s excited by the opportunity of being at the forefront of machine learning technology and working on extremely challenging problems in the... .... Collaborate with team members including other researchers, engineers, and interns to grow and develop their skills in AI research and...Full timeLocal areaFlexible hours
$85.5k - $185k per year
...strategic talent professional who is passionate about building capabilities and experiences across Capital Markets. As a Senior Manager of Strategic Learning, you will partner closely with business leaders, HR, Communications and other key stakeholders to develop innovative...SeniorPermanent employmentFull timeContract workPart timeShift work$130k - $168k per year
...just contribute. You’ll make things happen fast. As a Senior Software Engineer, you will design, build, and operate software that solves... ...abstractions, and reusable code. Apply AI and machine learning to practical problems. Partner with data scientists and other...SeniorRemote work$105k - $234k per year
...benefits that foster a culture of well-being and connectedness. Learn from deep subject matter experts through mentoring and on the job... ...business strategy and people performance, you will partner with senior leaders to deliver leadership development, learning, and culture...SeniorPermanent employmentFlexible hours$130k - $140k per year
...We are seeking a Senior MLOps Engineer based in Canada to join our data and machine learning team. This role will co-own MLOps practices at Fluent Media and establish standards for model deployment, serving, scaling and infrastructure efficiency. Working with ML scientists...SeniorFull timeWork at office$113.14k - $148.49k per year
...Does this sound like the right fit for you? Learn more about the role ! Your main responsibilities... ...investigations and analysis for engineering studies for deep and shallow foundations (static, seismic and dynamic machine loadings); Design parameters for various...SeniorRemplacementPermanent employmentFull timeFlexible hours$175k - $210k per year
...quality research experiences. We are looking for a hands-on Senior AI Engineer to take working prototypes into production and shape the... ...fit. Experience with Databricks, including its data, machine learning, or deployment workflows. Real-time or streaming systems...SeniorFull timeInternshipWork at office- ...Canada, the Netherlands and Australia. We're looking for a Senior Solutions Engineer to join our Partner Solutions team. This is an exciting... ...Customer Experience teams. Passion for innovation, continuous learning and creating customer value through technology. Benefits...SeniorFull timeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Machine Learning Inference Engineer. Be the first to apply!
Related searches
- machine learning engineer Toronto, ON
- junior machine learning developer Toronto, ON
- senior web designer Toronto, ON
- senior project engineer Toronto, ON
- senior ruby developer Toronto, ON
- senior crm manager Toronto, ON
- cpa senior accountant Toronto, ON
- senior part time Toronto, ON
- senior accountant Toronto, ON
- senior hr manager Toronto, ON