Senior Software Engineer, Machine Learning Infrastructure
$176k - $220k per yearHandshake
About Handshake
Handshake was founded on a simple belief that everyone deserves a path to a great career, regardless of where they went to school or who they know. Today, we power 25 million job seekers, 1 million+ employers, and 1,600 educational institutions.
In 2025, we started Handshake AI and built the fastest-growing AI data business in history. We work directly with frontier AI lab researchers to create evaluations, publish benchmarks, and push the boundary of data. We’ve grown from $0 to ~$1B run rate and pay ~$60M to over 30K individuals every month.
Why join Handshake now:
Shape how every career evolves in the AI economy, at global scale, with impact your friends, family and peers can see and feel
Partner hand-in-hand with world-class AI labs, Fortune 500 partners and the world’s top educational institutions
Work together with engineers, scientists, operators, and more from Palantir, Meta, Scale AI, and former YC founders
Build a massive, fast-growing business with billions in revenue
About Handshake AI
Human data is the core infrastructure to AI advancement. Frontier AI labs currently improve model capabilities with various data-intensive post-training techniques. We believe that data spend for AI training will increase by 3-5x in the next few years and continue for much longer as models take on new domains. Handshake AI supports all of the frontier AI labs, working on their most complex data at the largest scale.
About the RoleWe’re looking for a Senior Software Engineer to join our ML Infrastructure & Platform team. This team powers both Handshake’s core career marketplace and Handshake AI by building the shared infrastructure behind our production ML and AI systems.
This is an infrastructure-heavy role for an engineer who enjoys building scalable platforms at the intersection of software engineering, machine learning, and generative AI. You’ll help teams move quickly from prototype to production while building the reliable, high-performance systems that power training, evaluation, and inference across Handshake.
What You’ll Do
Build and operate the shared infrastructure behind production ML and AI, including data pipelines, feature stores, training, and model serving.
Develop and scale our LLM platform, including provider integrations, orchestration, observability, and controls for cost, latency, and reliability.
Build evaluation infrastructure, including LLM eval harnesses, benchmarks, and quality measurement pipelines.
Support post-training workflows, including fine-tuning, reinforcement learning pipelines, and supporting data infrastructure.
Optimize inference infrastructure for open and fine-tuned models, including GPU serving, batching, and autoscaling.
Partner with AI, Data Science, and Product teams to productionize new models and establish best practices for ML infrastructure across Handshake.
Improve the reliability, scalability, and developer experience of our ML platform.
Desired Capabilities
5+ years of production software engineering experience using Python, Go, TypeScript, or similar languages.
Experience building and operating cloud infrastructure on AWS, GCP, or similar platforms.
Strong experience with Kubernetes, Docker, Terraform, CI/CD, and operating production services.
Hands-on experience building ML infrastructure, including model serving, training pipelines, feature stores, embeddings, or ML observability.
Experience with modern data platforms such as BigQuery, Airflow, Spark, Beam/Dataflow, or streaming pipelines.
Practical experience building production systems with LLMs or generative AI, including orchestration, provider APIs, observability, and performance optimization.
Strong systems design skills, sound engineering judgment, and the ability to thrive in ambiguous, fast-moving environments.
Extra Credit
Experience with Ray, Anyscale, KubeRay, Ray Serve, vLLM, Triton, PyTorch, or GPU-backed inference and training.
Experience designing LLM evaluation frameworks, benchmarking systems, or quality regression testing.
Experience with Vertex AI, Bigtable, Redis, or feature platform infrastructure.
Experience with post-training techniques such as fine-tuning, RLHF, reinforcement learning, or reward modeling.
Experience building agentic systems, MCP integrations, tool use, memory systems, or voice AI applications.
Perks
Handshake delivers benefits that help you feel supported—and thrive at work and in life.
_
The below benefits are for full-time US employees.
_
Ownership:
Equity in a fast-growing company
Financial Wellness:
401(k) match, competitive compensation, financial coaching
Family Support:
Paid parental leave, fertility benefits, parental coaching
Wellbeing:
Medical, dental, and vision, mental health support, $500 wellness stipend
Growth:
$2,000 learning stipend, ongoing development
Remote & Office:
Internet, commuting, and free lunch/gym in our SF office
Time Off:
Flexible PTO, 15 holidays + 2 flex days
Connection:
Team outings & referral bonuses
Explore our mission, values, and comprehensive US benefits at joinhandshake.Com/careers.
Compensation$176K – $220K
For cash compensation, we set standard ranges for all U.S.-based roles based on function, level, and geographic location, benchmarked against similar stage growth companies. In order to be compliant with local legislation, as well as to provide greater transparency to candidates, we share salary ranges on all job postings regardless of desired hiring location. Final offer amounts are determined by multiple factors, including geographic location as well as candidate experience and expertise, and may vary from the amounts listed above.
#J-18808-Ljbffr
Handshake was founded on a simple belief that everyone deserves a path to a great career, regardless of where they went to school or who they know. Today, we power 25 million job seekers, 1 million+ employers, and 1,600 educational institutions.
In 2025, we started Handshake AI and built the fastest-growing AI data business in history. We work directly with frontier AI lab researchers to create evaluations, publish benchmarks, and push the boundary of data. We’ve grown from $0 to ~$1B run rate and pay ~$60M to over 30K individuals every month.
Why join Handshake now:
Shape how every career evolves in the AI economy, at global scale, with impact your friends, family and peers can see and feel
Partner hand-in-hand with world-class AI labs, Fortune 500 partners and the world’s top educational institutions
Work together with engineers, scientists, operators, and more from Palantir, Meta, Scale AI, and former YC founders
Build a massive, fast-growing business with billions in revenue
About Handshake AI
Human data is the core infrastructure to AI advancement. Frontier AI labs currently improve model capabilities with various data-intensive post-training techniques. We believe that data spend for AI training will increase by 3-5x in the next few years and continue for much longer as models take on new domains. Handshake AI supports all of the frontier AI labs, working on their most complex data at the largest scale.
About the RoleWe’re looking for a Senior Software Engineer to join our ML Infrastructure & Platform team. This team powers both Handshake’s core career marketplace and Handshake AI by building the shared infrastructure behind our production ML and AI systems.
This is an infrastructure-heavy role for an engineer who enjoys building scalable platforms at the intersection of software engineering, machine learning, and generative AI. You’ll help teams move quickly from prototype to production while building the reliable, high-performance systems that power training, evaluation, and inference across Handshake.
What You’ll Do
Build and operate the shared infrastructure behind production ML and AI, including data pipelines, feature stores, training, and model serving.
Develop and scale our LLM platform, including provider integrations, orchestration, observability, and controls for cost, latency, and reliability.
Build evaluation infrastructure, including LLM eval harnesses, benchmarks, and quality measurement pipelines.
Support post-training workflows, including fine-tuning, reinforcement learning pipelines, and supporting data infrastructure.
Optimize inference infrastructure for open and fine-tuned models, including GPU serving, batching, and autoscaling.
Partner with AI, Data Science, and Product teams to productionize new models and establish best practices for ML infrastructure across Handshake.
Improve the reliability, scalability, and developer experience of our ML platform.
Desired Capabilities
5+ years of production software engineering experience using Python, Go, TypeScript, or similar languages.
Experience building and operating cloud infrastructure on AWS, GCP, or similar platforms.
Strong experience with Kubernetes, Docker, Terraform, CI/CD, and operating production services.
Hands-on experience building ML infrastructure, including model serving, training pipelines, feature stores, embeddings, or ML observability.
Experience with modern data platforms such as BigQuery, Airflow, Spark, Beam/Dataflow, or streaming pipelines.
Practical experience building production systems with LLMs or generative AI, including orchestration, provider APIs, observability, and performance optimization.
Strong systems design skills, sound engineering judgment, and the ability to thrive in ambiguous, fast-moving environments.
Extra Credit
Experience with Ray, Anyscale, KubeRay, Ray Serve, vLLM, Triton, PyTorch, or GPU-backed inference and training.
Experience designing LLM evaluation frameworks, benchmarking systems, or quality regression testing.
Experience with Vertex AI, Bigtable, Redis, or feature platform infrastructure.
Experience with post-training techniques such as fine-tuning, RLHF, reinforcement learning, or reward modeling.
Experience building agentic systems, MCP integrations, tool use, memory systems, or voice AI applications.
Perks
Handshake delivers benefits that help you feel supported—and thrive at work and in life.
_
The below benefits are for full-time US employees.
_
Ownership:
Equity in a fast-growing company
Financial Wellness:
401(k) match, competitive compensation, financial coaching
Family Support:
Paid parental leave, fertility benefits, parental coaching
Wellbeing:
Medical, dental, and vision, mental health support, $500 wellness stipend
Growth:
$2,000 learning stipend, ongoing development
Remote & Office:
Internet, commuting, and free lunch/gym in our SF office
Time Off:
Flexible PTO, 15 holidays + 2 flex days
Connection:
Team outings & referral bonuses
Explore our mission, values, and comprehensive US benefits at joinhandshake.Com/careers.
Compensation$176K – $220K
For cash compensation, we set standard ranges for all U.S.-based roles based on function, level, and geographic location, benchmarked against similar stage growth companies. In order to be compliant with local legislation, as well as to provide greater transparency to candidates, we share salary ranges on all job postings regardless of desired hiring location. Final offer amounts are determined by multiple factors, including geographic location as well as candidate experience and expertise, and may vary from the amounts listed above.
#J-18808-Ljbffr
Vacancy posted 47 minutes ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Machine Learning Infrastructure in Winnipeg, MB vacancy
- ...Build scalable machine learning platforms at PointClickCare using Python, Java, and MLOps expertise. This role supports AI products across healthcare. As a Senior Machine Learning Systems Engineer, you will design, build, and operate platform capabilities for model development...Senior
$400k per year
...Job Description: Position: Machine Learning Engineer Location: Remote / Hybrid Employment Type: Full-time Responsibilities Design, train... ...in Python and ML frameworks (TensorFlow, PyTorch, Scikit-learn). Experience with cloud platforms (AWS, GCP, Azure) and containerization...SuggestedFull timeRemote workRelocation$129.2k - $174.8k per year
...faster, and more securely. We are currently seeking a Machine Learning Engineer to join our rapidly growing engineering team. This role is... ..., such as ChatGPT or Gemini; A proven ability to quickly learn new technologies and adapt to a dynamic, fast-paced...SuggestedWork at officeLocal areaFlexible hours1 day per week- ...Own cloud infrastructure and CI/CD automation as a Senior DevOps Engineer with Bounteous, supporting secure, scalable, reliable platforms remotely across Canada or Mexico. This contract position requires six-plus years in DevOps, Cloud Engineering, SRE, or Infrastructure...SeniorContract workInternshipRemote work
- ...Senior Back End Software Engineer Canada, United Kingdom, United States 1 gün 9 saat 9 dakika önce yayınlandı. Full Time Himalayas - Our software... ..., high-resolution population data and the modeling infrastructure to run scenario planning at scale. Together, these capabilities...SeniorFull time
- ...Build AI Inference Networking software at Equinix using SDN, proxying, and open-source engineering expertise. Work within a globally... ...development team. As a Senior SDN Network Software Engineer,... ...portfolio. The work combines network infrastructure, cloud security, APIs, and...Senior
- ...with experience in fitting, machining, pumps, and industrial maintenance... ..., pump systems, dewatering infrastructure, hydraulics, pneumatics, and... ...workplace conditions. From machine shop operations and pump... ...qualification) in Mechanical Engineering, Manufacturing Engineering,...Permanent employmentApprenticeshipTraineeshipLocal areaFree visa
$180k - $200k per year
...Job Title: Staff Data Scientist (AI & Machine Learning) Location: Vancouver, BC – 3 days a week... ...leader within our AI organization. While a Senior Data Scientist excels at building and... ...& Scalability: Partner with Engineering and DevOps to design robust ML platforms...Senior3 days per week- ...offers free Tea and Coffee Job Title: Software Developer Location: Winnipeg... ...: Price Industries is building a new Engineering Technology team, and we are looking for... ...ideal candidate enjoys solving problems, learning new tools, and working across the full development...
- ...Lead IT infrastructure projects at CBC/Radio-Canada using detailed engineering design, cloud technologies, and hands-on deployment expertise in a hybrid work model. This full-time permanent Engineering Project Lead position is based in Toronto, with projects focused on technology...Permanent employmentFull time
$100.81k per year
...tool, it's your playground. Our engineers work on scalable systems,... ...This is an environment where you learn by building. Whether you're creating... ...-native solutions, optimizing machine learning models, or building... ...systems Knowledge of software development lifecycle, including...Full timeSummer workInternshipSeasonal workSummer internshipWork at officeWorldwideMonday to friday$105k - $160k per year
...prospérer. Nous sommes le cabinet de conseil en infrastructure de confiance dans le monde, collaborant... ...d’un(e) Ingénieur(e) mécanique senior pour se joindre à son équipe en pleine... ...Unit: Canada Career Area: Engineering Work Location Model: Hybrid Compensation...Senior$114.8k - $157.85k per year
...Job Description Senior Mechanical Engineer Are you looking for a company that works on major engineering... ...of buildings and related base infrastructure across Canada. Subject matter expertise... ...office locations. A wide array of learning and development opportunities. Competitive...SeniorFull timeWork at officeWorldwideFlexible hours- ...of an assignment. • Lead electrical engineering work on all electrical systems for a project... ...• Experience with specialty modeling software, such as AGI 32, Visual Lighting, SKM,... ..., and future-proofing our cities and infrastructure. We innovate at the intersection of community...SeniorFor contractorsFor subcontractorInternshipWork at office
$114.8k - $157.85k per year
...Job Description Senior Electrical Engineer Are you looking for a company that works on major engineering... ...of buildings and related base infrastructure across Canada. Subject matter expertise... ...office locations. A wide array of learning and development opportunities. Competitive...SeniorFull timeWork at officeWorldwideFlexible hours- ...Café offers free Tea and Coffee. Senior Manufacturing Engineering Specialist - Critical Environments... ...layouts, production line configurations, machine capacity data, and labor cost standards... ...with computer aided design software such as AutoCAD and Solid Edge/SolidWorks...Senior
$110k per year
...provider of Interconnected Commerce software solutions for telecom retail.... ...on cloud-native lakehouse infrastructure to create trusted, reusable,... ...standards, and creating engineering patterns that let analytics,... ...confidence. About the Role: The Senior Data Engineer will design,...SeniorFull timeWork at officeRemote workFlexible hours- ...Senior Automation Engineer (Project Manager) Saguenay-Lac-Saint-Jean, QC, Canada Type of position: Regular To pursue project and client... ...and technical surveys Help program PLCs, DCSs and human‑machine interfaces Help prepare technical and commercial proposals...SeniorLong term contractTemporary workWork at officeLocal area
- ...has large-scale international engineering projects to offer. If you... ...Structural Engineer (Intermediate to Senior) to support the continued... ...with structural design software (ETABS, SAP2000, SAFE, etc.).... ...technology to transform the world's infrastructure and energy systems. Together,...SeniorFull timeInternshipWork at officeFlexible hours
- ...teams work together across manufacturing, engineering, customer care, service, supply chain,... ...forward. POSITION SUMMARY: As the Learning & Development Specialist, reporting to the... ...a rewarding career with opportunities to learn and grow across our family of companies....Permanent employmentFull timeWork at officeImmediate startRemote workMonday to friday
- ...Canada to recruit experienced mid-senior to senior-level engineering professionals . These opportunities... ...Engineering , across sectors such as infrastructure, construction, energy, mining,... ...Proficiency with relevant engineering software, tools, and systems Benefits Extended...SeniorFull timeFor contractors
- ...Prime. It compiles hot Java bytecode into highly optimized machine code and delivers Java performance that standard JVMs do... ...reach. Falcon is built on LLVM. We are looking for a Senior Compiler Performance Engineer to own major performance areas of Falcon. This is not a compiler...SeniorRemote workWorldwideFlexible hours
- ...potential in an environment that’s engineered for people. At CIMA+, we care... ...career by joining us as a Senior Overhead Transmission Lines... ...of the largest most complex infrastructure projects in Canada. This... ...-CADD suite design /analysis software and CAD systems, along with familiarity...SeniorPermanent employmentFull timeInternshipWork at officeFlexible hours2 days per week
- ...About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies... ...Stripe one of the best places to do machine learning. The ML Infra team builds services and... ...work closely with machine learning engineers, data scientists, and product...
- ...exciting opportunity for a motivated senior Water Resources Engineer / Environmental Engineer with... ...environmental management, transportation, infrastructure and other disciplines on a variety of... ..., QUAL2K, etc., and statistical software such as R is an asset Mining experience...SeniorWork at officeWorldwide
$130k - $165k per year
...Quanta Services, we provide engineering and design services across transmission... ...and high-voltage electrical infrastructure. Be part of a team that... ...looking for an experienced Senior Transmission Line Design... ...~ Proficiency with the PLS software suite, including PLS-CADD, PLS...SeniorLong term contractFull timeFor contractorsInternship- ...accessible, reliable, and performant. As a Senior Data Engineer, you’ll play a vital role in evolving... ...pipelines — you're building the infrastructure that determines the quality of every... ...with Python ML tooling (pandas, scikit-learn; familiarity with PyTorch or TensorFlow...SeniorSummer workRemote workFlexible hours
- ...multidisciplinary execution from Mississauga, Ontario. This senior engineering role covers HVAC and mechanical systems for Nuclear Power... ...leadership, cooling-system expertise, and professional engineering judgment across complex infrastructure projects from Mississauga....Senior
- ...excellent benefits. With manufacturing, engineering, R&D, and corporate functions across... ...accountable for the operation of a variety of machines to assist with meeting daily production... ...both management and peers. Ability to learn and operate new equipment. Education and...Full timeFlexible hoursShift workWeekend workDay shift
- Develop AWS Neuron software for machine learning acceleration in Toronto, combining backend systems, web interfaces, CLI workflows, and performance analysis.As a Senior Software Development Engineer, you will work on Neuron Explorer, which profiles, debugs, and analyzes workloads...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, Machine Learning Infrastructure. Be the first to apply!
Related searches
- software developer internship no experience Winnipeg, MB
- software engineer intern Winnipeg, MB
- software developer Winnipeg, MB
- software developer remote Winnipeg, MB
- software engineer - ai machine learning Winnipeg, MB
- part time software developer Winnipeg, MB
- junior software engineer Winnipeg, MB
- software engineer part time Winnipeg, MB
- software developer intern Winnipeg, MB
- senior software developer Winnipeg, MB

