Principal Ml Engineer

Our client builds a high throughput system powering hundreds of billions of daily transactions, each completed within milliseconds, across globally distributed infrastructure designed for reliability and efficiency. They have been quietly bootstrapping and growing in line with revenue for over 2 decades. They maintain independence from external stakeholders, enabling them to chart their course, maintain a long-term perspective and build an enduring, sustainable business that currently employs ~600 team members globally.Data is central to nearly every part of their platform. High-volume event and transactional data powers customer reporting, billing, marketplace analytics, experimentation, machine-learning workflows, and product experiences. The organization is evolving from centralized, batch-oriented reporting toward a platform-driven architecture combining batch, streaming, and asynchronous processing, with APIs becoming a primary interface to data.Our client has been stubbornly racking and stacking infrastructure around the world for the duration of their existence, a habit that allows for them to price themselves at the cost of electricity while their competitors are mired in rising cloud infrastructure costs. This long-term, somewhat contrarian, thinking puts them in a position to offer stability and career longevity evidenced by robust benefits that include RRSP matching.Machine learning is already in production and they have successfully shipped their first generation of ML-powered systems. They’re now moving into the next generation, at a point where growing transaction and data volumes leave considerable room for ML to influence the economics, efficiency and intelligence of the platform.This is an opportunity to help define what that next generation looks like. You’ll operate across the entire path from raw data through feature generation, modelling, delivery, deployment, inference and production monitoring, helping establish architectures that allow sophisticated ML systems to operate reliably at extraordinary scale.Because the client’s production ML capability is still maturing, you’ll have considerable influence over the architectures, patterns and technical approaches that underpin its next generation of ML systems. Rather than inheriting a completely settled way of doing things, you’ll help determine what those systems should look like as the organization continues to expand its use of machine learning.Key responsibilities
ML architecture:
Design and evolve end-to-end architectures for large-scale machine learning systems spanning data preparation, feature generation, model delivery, deployment, serving and production monitoringData-centric systems:
Design solutions for validating, transforming and generating features from extremely large datasets while ensuring consistently high-quality inputs for downstream model developmentModel delivery:
Architect systems and patterns that allow models to move reliably from development into production environmentsDeployment & hosting:
Develop effective approaches for deploying, hosting and operating ML models at scale, balancing performance, reliability, maintainability and infrastructure constraintsProduction ML:
Establish robust approaches for managing and monitoring deployed models and the systems that support themPerformance:
Identify and pursue opportunities to optimize the performance of ML systems across data processing, model execution and serving infrastructureTechnical design:
Lead functional and process design across ML initiatives (including scenario design, flow mapping, prototyping, testing and defining appropriate support procedures)Engineering standards:
Bring strong software engineering principles into the design of ML systems so that experimentation can translate into maintainable, production-grade softwareCross-functional collaboration:
Work across data science, machine learning, software engineering and other stakeholders to source the right data, establish technical requirements and define what success actually looks likeTechnical leadership:
Provide architectural direction across complex ML initiatives and influence how the broader organization approaches machine learning as its use of the technology continues to matureYour know-how
You have a Masters or PhD in a STEM field or equivalent depth of experience gained as a Data Scientist, Machine Learning Engineer, ML Architect or in a closely related roleYou understand what it takes to move ML beyond experimentation and operate it reliably in productionYou have extensive knowledge of the infrastructure and pipelines that support production ML systems (aka MLOps)You have meaningful experience across several modelling approaches such as classification, regression, pattern recognition, recommendation systems, targeting systems or ranking systemsYou bring deep knowledge of mathematics, probability, statistics and algorithms and can apply that knowledge to practical engineering and product challengesYou understand how to design the systems surrounding a model, including data preparation, feature generation, delivery, deployment, monitoring and operational supportYou have an interest in performance optimization and can reason about the trade-offs involved in operating ML systems at significant scaleYou understand software engineering best practices and can work effectively alongside advanced engineering teams building production systemsYou have strong business acumen and can work cross-functionally to source data, establish requirements, identify meaningful constraints and define measures of successYou’re comfortable operating at “principal level” (aka defining architecture, navigating ambiguity, influencing technical direction and making decisions whose consequences extend beyond an individual project or team)It’s a bonus if
You have a software engineering background in addition to your machine learning expertiseYou have experience deploying ML models for rapid/real-time inferenceYou’ve published articles, research or papers related to machine learning, statistics, optimization or adjacent fieldsYou’ve worked in another environment where enormous data volumes, high transaction throughput and tight latency constraints materially change how ML systems need to be designed
#J-18808-Ljbffr