Senior Software Engineer, Machine Learning Infrastructure
$176k - $220k per yearHandshake
About Handshake
Handshake was founded on a simple belief that everyone deserves a path to a great career, regardless of where they went to school or who they know. Today, we power 25 million job seekers, 1 million+ employers, and 1,600 educational institutions.
In 2025, we started Handshake AI and built the fastest-growing AI data business in history. We work directly with frontier AI lab researchers to create evaluations, publish benchmarks, and push the boundary of data. We’ve grown from $0 to ~$1B run rate and pay ~$60M to over 30K individuals every month.
Why join Handshake now:
Shape how every career evolves in the AI economy, at global scale, with impact your friends, family and peers can see and feel
Partner hand-in-hand with world-class AI labs, Fortune 500 partners and the world’s top educational institutions
Work together with engineers, scientists, operators, and more from Palantir, Meta, Scale AI, and former YC founders
Build a massive, fast-growing business with billions in revenue
About Handshake AI
Human data is the core infrastructure to AI advancement. Frontier AI labs currently improve model capabilities with various data-intensive post-training techniques. We believe that data spend for AI training will increase by 3-5x in the next few years and continue for much longer as models take on new domains. Handshake AI supports all of the frontier AI labs, working on their most complex data at the largest scale.
About the RoleWe’re looking for a Senior Software Engineer to join our ML Infrastructure & Platform team. This team powers both Handshake’s core career marketplace and Handshake AI by building the shared infrastructure behind our production ML and AI systems.
This is an infrastructure-heavy role for an engineer who enjoys building scalable platforms at the intersection of software engineering, machine learning, and generative AI. You’ll help teams move quickly from prototype to production while building the reliable, high-performance systems that power training, evaluation, and inference across Handshake.
What You’ll Do
Build and operate the shared infrastructure behind production ML and AI, including data pipelines, feature stores, training, and model serving.
Develop and scale our LLM platform, including provider integrations, orchestration, observability, and controls for cost, latency, and reliability.
Build evaluation infrastructure, including LLM eval harnesses, benchmarks, and quality measurement pipelines.
Support post-training workflows, including fine-tuning, reinforcement learning pipelines, and supporting data infrastructure.
Optimize inference infrastructure for open and fine-tuned models, including GPU serving, batching, and autoscaling.
Partner with AI, Data Science, and Product teams to productionize new models and establish best practices for ML infrastructure across Handshake.
Improve the reliability, scalability, and developer experience of our ML platform.
Desired Capabilities
5+ years of production software engineering experience using Python, Go, TypeScript, or similar languages.
Experience building and operating cloud infrastructure on AWS, GCP, or similar platforms.
Strong experience with Kubernetes, Docker, Terraform, CI/CD, and operating production services.
Hands-on experience building ML infrastructure, including model serving, training pipelines, feature stores, embeddings, or ML observability.
Experience with modern data platforms such as BigQuery, Airflow, Spark, Beam/Dataflow, or streaming pipelines.
Practical experience building production systems with LLMs or generative AI, including orchestration, provider APIs, observability, and performance optimization.
Strong systems design skills, sound engineering judgment, and the ability to thrive in ambiguous, fast-moving environments.
Extra Credit
Experience with Ray, Anyscale, KubeRay, Ray Serve, vLLM, Triton, PyTorch, or GPU-backed inference and training.
Experience designing LLM evaluation frameworks, benchmarking systems, or quality regression testing.
Experience with Vertex AI, Bigtable, Redis, or feature platform infrastructure.
Experience with post-training techniques such as fine-tuning, RLHF, reinforcement learning, or reward modeling.
Experience building agentic systems, MCP integrations, tool use, memory systems, or voice AI applications.
Perks
Handshake delivers benefits that help you feel supported—and thrive at work and in life.
_
The below benefits are for full-time US employees.
_
Ownership:
Equity in a fast-growing company
Financial Wellness:
401(k) match, competitive compensation, financial coaching
Family Support:
Paid parental leave, fertility benefits, parental coaching
Wellbeing:
Medical, dental, and vision, mental health support, $500 wellness stipend
Growth:
$2,000 learning stipend, ongoing development
Remote & Office:
Internet, commuting, and free lunch/gym in our SF office
Time Off:
Flexible PTO, 15 holidays + 2 flex days
Connection:
Team outings & referral bonuses
Explore our mission, values, and comprehensive US benefits at joinhandshake.Com/careers.
Compensation$176K – $220K
For cash compensation, we set standard ranges for all U.S.-based roles based on function, level, and geographic location, benchmarked against similar stage growth companies. In order to be compliant with local legislation, as well as to provide greater transparency to candidates, we share salary ranges on all job postings regardless of desired hiring location. Final offer amounts are determined by multiple factors, including geographic location as well as candidate experience and expertise, and may vary from the amounts listed above.
#J-18808-Ljbffr
Handshake was founded on a simple belief that everyone deserves a path to a great career, regardless of where they went to school or who they know. Today, we power 25 million job seekers, 1 million+ employers, and 1,600 educational institutions.
In 2025, we started Handshake AI and built the fastest-growing AI data business in history. We work directly with frontier AI lab researchers to create evaluations, publish benchmarks, and push the boundary of data. We’ve grown from $0 to ~$1B run rate and pay ~$60M to over 30K individuals every month.
Why join Handshake now:
Shape how every career evolves in the AI economy, at global scale, with impact your friends, family and peers can see and feel
Partner hand-in-hand with world-class AI labs, Fortune 500 partners and the world’s top educational institutions
Work together with engineers, scientists, operators, and more from Palantir, Meta, Scale AI, and former YC founders
Build a massive, fast-growing business with billions in revenue
About Handshake AI
Human data is the core infrastructure to AI advancement. Frontier AI labs currently improve model capabilities with various data-intensive post-training techniques. We believe that data spend for AI training will increase by 3-5x in the next few years and continue for much longer as models take on new domains. Handshake AI supports all of the frontier AI labs, working on their most complex data at the largest scale.
About the RoleWe’re looking for a Senior Software Engineer to join our ML Infrastructure & Platform team. This team powers both Handshake’s core career marketplace and Handshake AI by building the shared infrastructure behind our production ML and AI systems.
This is an infrastructure-heavy role for an engineer who enjoys building scalable platforms at the intersection of software engineering, machine learning, and generative AI. You’ll help teams move quickly from prototype to production while building the reliable, high-performance systems that power training, evaluation, and inference across Handshake.
What You’ll Do
Build and operate the shared infrastructure behind production ML and AI, including data pipelines, feature stores, training, and model serving.
Develop and scale our LLM platform, including provider integrations, orchestration, observability, and controls for cost, latency, and reliability.
Build evaluation infrastructure, including LLM eval harnesses, benchmarks, and quality measurement pipelines.
Support post-training workflows, including fine-tuning, reinforcement learning pipelines, and supporting data infrastructure.
Optimize inference infrastructure for open and fine-tuned models, including GPU serving, batching, and autoscaling.
Partner with AI, Data Science, and Product teams to productionize new models and establish best practices for ML infrastructure across Handshake.
Improve the reliability, scalability, and developer experience of our ML platform.
Desired Capabilities
5+ years of production software engineering experience using Python, Go, TypeScript, or similar languages.
Experience building and operating cloud infrastructure on AWS, GCP, or similar platforms.
Strong experience with Kubernetes, Docker, Terraform, CI/CD, and operating production services.
Hands-on experience building ML infrastructure, including model serving, training pipelines, feature stores, embeddings, or ML observability.
Experience with modern data platforms such as BigQuery, Airflow, Spark, Beam/Dataflow, or streaming pipelines.
Practical experience building production systems with LLMs or generative AI, including orchestration, provider APIs, observability, and performance optimization.
Strong systems design skills, sound engineering judgment, and the ability to thrive in ambiguous, fast-moving environments.
Extra Credit
Experience with Ray, Anyscale, KubeRay, Ray Serve, vLLM, Triton, PyTorch, or GPU-backed inference and training.
Experience designing LLM evaluation frameworks, benchmarking systems, or quality regression testing.
Experience with Vertex AI, Bigtable, Redis, or feature platform infrastructure.
Experience with post-training techniques such as fine-tuning, RLHF, reinforcement learning, or reward modeling.
Experience building agentic systems, MCP integrations, tool use, memory systems, or voice AI applications.
Perks
Handshake delivers benefits that help you feel supported—and thrive at work and in life.
_
The below benefits are for full-time US employees.
_
Ownership:
Equity in a fast-growing company
Financial Wellness:
401(k) match, competitive compensation, financial coaching
Family Support:
Paid parental leave, fertility benefits, parental coaching
Wellbeing:
Medical, dental, and vision, mental health support, $500 wellness stipend
Growth:
$2,000 learning stipend, ongoing development
Remote & Office:
Internet, commuting, and free lunch/gym in our SF office
Time Off:
Flexible PTO, 15 holidays + 2 flex days
Connection:
Team outings & referral bonuses
Explore our mission, values, and comprehensive US benefits at joinhandshake.Com/careers.
Compensation$176K – $220K
For cash compensation, we set standard ranges for all U.S.-based roles based on function, level, and geographic location, benchmarked against similar stage growth companies. In order to be compliant with local legislation, as well as to provide greater transparency to candidates, we share salary ranges on all job postings regardless of desired hiring location. Final offer amounts are determined by multiple factors, including geographic location as well as candidate experience and expertise, and may vary from the amounts listed above.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Machine Learning Infrastructure in Winnipeg, MB vacancy
- ...Build scalable machine learning platforms at PointClickCare using Python, Java, and MLOps expertise. This role supports AI products across healthcare. As a Senior Machine Learning Systems Engineer, you will design, build, and operate platform capabilities for model development...Senior
- ...About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies... ...Stripe one of the best places to do machine learning. The ML Infra team builds services and... ...work closely with machine learning engineers, data scientists, and product...Suggested
$129.2k - $174.8k per year
...faster, and more securely. We are currently seeking a Machine Learning Engineer to join our rapidly growing engineering team. This role is... ..., such as ChatGPT or Gemini; A proven ability to quickly learn new technologies and adapt to a dynamic, fast-paced...SuggestedWork at officeLocal areaFlexible hours1 day per week- ...accessible, reliable, and performant. As a Senior Data Engineer, you’ll play a vital role in evolving... ...pipelines — you're building the infrastructure that determines the quality of every... ...with Python ML tooling (pandas, scikit-learn; familiarity with PyTorch or TensorFlow...SeniorSummer workRemote workFlexible hours
- Develop AWS Neuron software for machine learning acceleration in Toronto, combining backend systems, web interfaces, CLI workflows, and performance analysis.As a Senior Software Development Engineer, you will work on Neuron Explorer, which profiles, debugs, and analyzes workloads...Senior
- ...training run optimizes for themData engines and evaluation. Mine... ...information with user- and tenant-level learnings. Separate failures of... ...re hiring from junior through senior levels, with project scope matched... ...environments/harnesses for software engineering, web or tool use;...Senior
- Build machine learning software for automotive manufacturing with Python and production model deployment. Work hybrid in Woodstock, Ontario, with weekly Cambridge travel.As an ML software engineer consultant, you will develop applications through full software development cycles...Work at office
$150k - $200k per year
Senior Machine Learning Engineer – AI Innovation TeamsAs one of the world’s top three credit ratings agencies, Fitch Ratings plays a critical role in global capital markets by providing credit analysis, ratings, research, and commentary to financial market participants. For...SeniorLong term contractInternshipManual laborImmediate start$196k - $265k per year
...collaborative individuals who seek to have a lasting impact. Learn more at Senior Machine Learning EngineerAt EvenUp, we leverage cutting-edge AI to... .... We're looking for a Senior Machine Learning Engineer to help build the models and systems powering Piai™, our proprietary...SeniorLong term contractFull timeTemporary workWork at officeLocal areaHome officeFlexible hours- Develop machine learning tools at Digital Domain using C++ and Python for animation, character effects, and grooming systems. Work fully remotely from British Columbia or in Vancouver.As a Software Engineer, you will create innovative tooling for visual effects production. You...Remote work
$187.5k - $261k per year
...improve the Product Development Lifecycle (PDLC). Enable software engineers, quality engineers, architects, product owners, business... ...Provide expertise in multiple ML engineering and/or infrastructure areas, senior technical leadership in support of the Banks objectives...SeniorLong term contractTemporary workWork from home- Build critical machine learning infrastructure in Montreal with a hybrid fintech startup, spanning data ingestion, deployment, monitoring, and production systems.As a Distributed Systems / ML Engineer, you will own infrastructure supporting machine learning and large-scale...
- ...About the Role Our client is seeking a highly innovative and experienced Senior Machine Learning Engineer to join their pioneering, fully remote team. This role is central to developing, implementing, and deploying advanced machine learning models that drive key business decisions...SeniorRemote workFlexible hours
$165.8k - $292.4k per year
...personal digital experience where customers can shop, buy and learn everything Apple, wherever they are. Each customer should... ...for a passionate, highly motivated, and hands‑on applied Senior Machine Learning Engineer. This role will assist our Online Retail Decision Automation...SeniorRelocation- ...for seamlessly embedding cutting-edge machine learning, Generative AI, and autonomous agents directly... ...of deep applied research and scalable engineering. Whether we are developing... ...Partner closely with Data Scientists, Software Engineers, Product Managers, and UX Designers...Senior
- Build software for custom ML accelerator silicon at Amazon, using C++, Python, Rust, or C... ...software disciplines.This Software Development Engineer role focuses on accelerator-stack... ...simulation frameworks, or chip validation infrastructure. The work supports verification, silicon...
- ...For more information, visit Reddit, machine learning sits at the heart of how millions of people... ...and marketplace dynamics, our ML engineers tackle some of the most interesting and... ...machine learning pipelines, model serving infrastructure, and real-time decision systemsApplied...SeniorRemplacementLong term contractFor contractors
- Autodesk makes software for people who make things. If you've ever driven a high-performance car, admired a towering skyscraper... ...Emerging Media and Entertainment Technology team is hiring Machine Learning Engineers to work on innovative projects that help our customers imagine...Senior
- Build machine learning software in Markham, Ontario, using C++ and Python to optimize GPU kernels, workloads, and next-generation computing platforms... ...Stream Technology seeks a Machine Learning Software Engineer focused on GPU and AI optimization. You will develop software...
- Advance machine learning infrastructure at Capital One Canada in Toronto, combining AI engineering, optimization, and production system expertise.This Principal Associate AI Engineer role supports responsible, reliable AI systems through the Intelligent Foundations and Experiences...
$136.1k - $204.1k per year
...the Unity AI agentic system. The AI models perform various tasks for building Unity games. Integrate Machine Learning models seamlessly within real-time game engine constraints, optimizing for latency, compute, and determinism. Lead high-impact initiatives, including...SeniorLong term contractWork at officeWorldwide- We’re looking for a Senior Machine Learning Engineer with strong computer vision expertise to join our Biometrics team. You’ll ramp up on the biometrics domain while contributing to the design, training, and scaling of our ML systems end‑to‑end on AWS. The final job level for...Senior
- ...automation remotely from Canada with scalable distributed systems, production AI/ML, and secure multi-agent workflow engineering.As a Senior Machine Learning Automation Engineer, you will turn emerging AI capabilities into reliable business applications. The work spans autonomous...SeniorRemote work
$160k - $200k per year
Job Description Wiser Solutions is hiring a Senior ML Engineer to help build our customer-facing AI platform and get the first features into customers... ..., CI/CD, and code review A habit of building quickly to learn: you'd rather test an idea in two days than debate it for two...SeniorWork at officeLocal areaWorldwide- We’re hiring on behalf of an enterprise client based in downtown Toronto, seeking a visionary Senior AI/ML Engineer to spearhead the development and deployment of advanced Large Language Model (LLM) solutions. This is a high-impact leadership role focused on building...SeniorLong term contract
- Build production machine learning systems at Apple using Python, Java, or C++ in a senior engineering role focused on online retail.As a Senior Machine Learning Engineer, you will support Apple’s Online Retail Decision Automation team. You will develop algorithms for search,...Senior
- ...that read a plant's records and connect them, so scientists and engineers get answers they can check against the sources.Katalyze reads... ...on the AI teamWhat we look for Five or more years building machine learning systems in productionExperience with document understanding,...SeniorWork at office
- ...AITiger Analytics is looking for a skilled and innovative Machine Learning Engineer with hands-on experience in Google Cloud Platform (GCP... ...in ML/DL libraries: TensorFlow, PyTorch, scikit-learn, pandas, NumPy, PySparkExperience with production-grade code...Senior
$110k - $160k per year
...support of people on the front lines of climate change. Learn more at wawanesa.Com. We are currently looking for dedicated... ...and advancement on a growing team. Job OverviewThe Machine Learning Operations Engineer/Senior is responsible for the design, development, deployment,...SeniorLong term contractPermanent employmentFull timePart timeInternshipWork at officeLocal areaRemote work2 days per week- Build production machine learning systems at Reddit using Python, ranking, recommendations, and large-scale model deployment for millions of users.As a Senior Machine Learning Engineer, you will design systems across Reddit’s Consumer and Ads organizations. Apply deep learning...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, Machine Learning Infrastructure. Be the first to apply!
Related searches
- software engineer part time Winnipeg, MB
- software engineer Winnipeg, MB
- software design engineer Winnipeg, MB
- software engineer - computer Winnipeg, MB
- software developer internship no experience Winnipeg, MB
- ingénieur logiciel Winnipeg, MB
- software engineer co-op Winnipeg, MB
- software development engineer Winnipeg, MB
- software developer Winnipeg, MB
- software engineer - ai machine learning Winnipeg, MB

