Lead Product Manager, Agent Runtime & Evals
Juniper Square
About Juniper Square
Private markets are one of the largest, most complex, and most underserved corners of global finance. Our mission at Juniper Square is to unlock their full potential. We’re the Operations Partner trusted by 2,300+ GPs, unifying technology, data, and fund administration services into a single platform that helps GPs move faster, make better decisions, and scale with precision. With $300B+ under administration and 700,000+ LPs on platform, we’ve built the scale to match our ambition. And with JunieAI, our purpose-built AI platform, we’re reimagining how private markets operate, embedding intelligence across every workflow. Founder-led since 2014, backed by $350M+ in funding, and now 1,000+ employees strong, we’re building a company designed to shape the future of private markets for decades to come.About Juniper Square
Private markets are one of the largest, most complex, and most underserved corners of global finance. Our mission at Juniper Square is to unlock their full potential. We’re the Operations Partner trusted by 2,300+ GPs, unifying technology, data, and fund administration services into a single platform that helps GPs move faster, make better decisions, and scale with precision. With $300B+ under administration and 700,000+ LPs on platform, we’ve built the scale to match our ambition. And with JunieAI, our purpose-built AI platform, we’re reimagining how private markets operate, embedding intelligence across every workflow. Founder-led since 2014, backed by $350M+ in funding, and now 1,000+ employees strong, we’re building a company designed to shape the future of private markets for decades to come.Our culture is built for people who want to do ambitious, meaningful work alongside exceptionally talented teammates. We think like owners, move with urgency, and take pride in solving hard problems that truly matter to our customers and the future of private markets. We believe the best ideas come from open debate, deep collaboration, and diverse perspectives, which is why we believe transparency is the default and feedback makes us stronger. If you’re energized by high standards, rapid growth, and the opportunity to help define a category at a pivotal moment, come join us!Juniper Square offers employees a variety of ways to work, ranging from a fully remote experience to working full-time in one of our physical offices. We invest heavily in digital-first operations, allowing our teams to collaborate effectively across 27 U.S. states, 2 Canadian Provinces, India, Luxembourg, and England. We also have physical offices in San Francisco, New York City, Mumbai and Bangalore for employees who prefer to work in an office some or all of the time.About Your Role
We are looking for a Lead Product Manager to own the agent runtime and evaluation layer of Foundry, the platform where Juniper Square builds, deploys, and operates AI agents, apps, and code. It is built for non-engineers: a fund administration specialist or business SME should be able to describe what they need and end up with a governed, deployable automation that has its own identity, access grants, and audit trail. You will report to the Group Product Manager for Foundry and work closely with a dedicated engineering team on the details that make that promise real.About 75% of your time goes to the agent runtime itself: versions and deployments, evaluations and testing, and what happens when a new model ships and teams want it for some automations but not others. The other 25% goes to partnering with the workflow orchestration PM on the contracts that let hosted agents plug into governed workflows and get real work done. Think of orchestration as the shape of the container, and this role as how that container gets filled with automations in a deterministic, predictable way.The platform is early and the problems are hard. We are rebuilding how fund administration gets done to be agentic first, with humans and agents building, configuring, and deploying automations together. You will help shape the foundations, and engineering will look to you to make the call on ambiguous platform tradeoffs.AI fluency is a baseline expectation. PMs at this level should be comfortable using the full range of modern tools (e.G. LLMs, agent orchestration frameworks, Claude) to move faster and make sharper decisions. That might mean building and deploying your own agents on the platform you own, prototyping before writing requirements, or using coding agents to submit pull requests for engineering. The expectation is sound judgment about what will get to the best outcome for the customer and the team.This role would benefit from in-person collaboration in San Francisco, where many of our product management, design, and engineering personnel are based, although we also welcome exceptional candidates from elsewhere in the United States and Canada.What You’ll Do
Build the agent runtime for non-engineers: Own the vision, strategy, and roadmap for a platform where business users take an agent, app, or script from idea to governed production without an engineering cycle. Define the full lifecycle: draft, test, publish, version, deploy, run, observe, improve, and retire.Own evaluations and model governance: Define how every automation is tested before it ships. Work with engineering and our shared eval platform team on golden datasets, data labeling, and regression gates that block promotion. Decide when an automated judge is enough and when a human has to stay in the loop. Shape how evals decide which models are eligible for which agents, so a new model release becomes a product decision rather than a scramble.Solve the "who evaluates the evaluator" problem: Agents that grade other agents need their own checks. Partner with engineering on patterns that keep quality measurable at the scale of thousands of agents, and turn them into experiences builders can understand and trust.Shape memory, learning, and self‑improvement: Define how agents keep long‑lived memory, compact it, and improve from experience, with an eye on adoption and user‑facing impact rather than algorithms alone.Run a model‑agnostic platform: Own model routing, cost attribution, and pricing so teams can choose the right model for each job and see what it costs.Integrate with broader systems: Define how hosted agents reach data and take action across our product suite, our fund administration systems of record, and third‑party tools. Own the connector, credential, and access‑grant model so integrations are reusable rather than rebuilt per agent. Define agent identity and run modes, including when an agent acts with the invoking user’s access and when it acts under its own service identity.Give people oversight at scale: Design the tools that let fund administration teams supervise large fleets of agents: dashboards, run history, observability through traces, metrics, and logs, kill switches, and auditability. Make it clear what is an exception and what is an issue.Define how automations bind to workflows: Partner with the workflow orchestration PM on the agent registry and typed contracts that describe what an agent needs and produces, and how workflows bind to it. Protect the safety boundary that agent‑driven steps stage changes and people release them.Deliver configuration to business SMEs: Partner with design and engineering to build the tools SMEs use to configure, test, and tune automations themselves. Hold the line on convention over configuration so every setting earns its place.Stay ahead of the market: Track managed agent runtimes, agent frameworks, and automation platforms. Turn that view into clear build, buy, and partner calls.Be a leader: Set direction across the platform and adjacent teams, raise the bar for product craft, and be the person engineering trusts on ambiguous platform tradeoffs.Qualifications
7+ years of product management experience in B2B or Enterprise SaaS, including 3+ years operating in an AI‑oriented role.Proven experience owning a complex product area end‑to‑end, from strategy and roadmap through execution and iteration, ideally in a zero‑to‑one context.Hands‑on understanding of how agent evaluation works: golden datasets, data labeling, automated judges, regression testing, and knowing when a human has to step in.Background building agents and replacing human‑driven processes with product and automation, with real evaluation and monitoring discipline in production.A strong engineering partner with a product mindset. You can go deep with engineers on topics like typed contracts between agents and workflows, structured and deterministic outputs, and agent memory, and you know the right questions to ask even when you don’t have the answers. This is not a TPM role: your focus is how people actually use these tools.User empathy for non‑engineering builders and operators, including how people oversee large numbers of automated agents.Fluency with LLMs and common AI tools (e.G. Claude, Cursor). You should be able to run your own prototypes and use AI to get work done faster than a traditional PM workflow would allow. Bonus points for deep experience with managed agent platforms such as Claude Managed Agents or Workato Genies, including evals, tool and connector access, versions, and deployments.Strong communication skills, written and verbal, with the ability to articulate product decisions clearly to engineers, designers, executives, and customers alike.Track record of leading through influence, ideally mentoring or managing other product managers, and setting strategy that multiple teams execute against.What Success Looks Like
By the end of Q1: The platform runs real fund administration workflows with real automations, such as capital calls and distributions, built and deployed on Foundry.Following the Q1 milestone: Those workflows roll out to the entire fund administration team, fundamentally changing how they work.Long term: An "AI factory" where AI watches how work gets done and proposes new workflows and agents, and people move from building to oversight and course correction. A new client could be up and running in a day and fully automated within the week.Compensation
Compensation for this position includes a base salary, equity, and a variety of benefits. The U.S. salary range for this role is $200,000 - $230,000 USD. Actual base salaries will be based on candidate‑specific factors, including experience, skillset, and location, and local minimum pay requirements as applicable.Benefits Include
Health, dental, and vision care for you and your familyLife insuranceMental wellness coverageFertility and growing family supportFlex Time Off in addition to company‑paid holidaysPaid family leave, medical leave, and bereavement leave policiesRetirement saving plansAllowance to customize your work and technology setup at homeAnnual professional development stipendYour recruiter can provide additional details about compensation and benefits.#experiencedprofessional #Juniper-US #Juniper-Canada
#J-18808-Ljbffr
Private markets are one of the largest, most complex, and most underserved corners of global finance. Our mission at Juniper Square is to unlock their full potential. We’re the Operations Partner trusted by 2,300+ GPs, unifying technology, data, and fund administration services into a single platform that helps GPs move faster, make better decisions, and scale with precision. With $300B+ under administration and 700,000+ LPs on platform, we’ve built the scale to match our ambition. And with JunieAI, our purpose-built AI platform, we’re reimagining how private markets operate, embedding intelligence across every workflow. Founder-led since 2014, backed by $350M+ in funding, and now 1,000+ employees strong, we’re building a company designed to shape the future of private markets for decades to come.About Juniper Square
Private markets are one of the largest, most complex, and most underserved corners of global finance. Our mission at Juniper Square is to unlock their full potential. We’re the Operations Partner trusted by 2,300+ GPs, unifying technology, data, and fund administration services into a single platform that helps GPs move faster, make better decisions, and scale with precision. With $300B+ under administration and 700,000+ LPs on platform, we’ve built the scale to match our ambition. And with JunieAI, our purpose-built AI platform, we’re reimagining how private markets operate, embedding intelligence across every workflow. Founder-led since 2014, backed by $350M+ in funding, and now 1,000+ employees strong, we’re building a company designed to shape the future of private markets for decades to come.Our culture is built for people who want to do ambitious, meaningful work alongside exceptionally talented teammates. We think like owners, move with urgency, and take pride in solving hard problems that truly matter to our customers and the future of private markets. We believe the best ideas come from open debate, deep collaboration, and diverse perspectives, which is why we believe transparency is the default and feedback makes us stronger. If you’re energized by high standards, rapid growth, and the opportunity to help define a category at a pivotal moment, come join us!Juniper Square offers employees a variety of ways to work, ranging from a fully remote experience to working full-time in one of our physical offices. We invest heavily in digital-first operations, allowing our teams to collaborate effectively across 27 U.S. states, 2 Canadian Provinces, India, Luxembourg, and England. We also have physical offices in San Francisco, New York City, Mumbai and Bangalore for employees who prefer to work in an office some or all of the time.About Your Role
We are looking for a Lead Product Manager to own the agent runtime and evaluation layer of Foundry, the platform where Juniper Square builds, deploys, and operates AI agents, apps, and code. It is built for non-engineers: a fund administration specialist or business SME should be able to describe what they need and end up with a governed, deployable automation that has its own identity, access grants, and audit trail. You will report to the Group Product Manager for Foundry and work closely with a dedicated engineering team on the details that make that promise real.About 75% of your time goes to the agent runtime itself: versions and deployments, evaluations and testing, and what happens when a new model ships and teams want it for some automations but not others. The other 25% goes to partnering with the workflow orchestration PM on the contracts that let hosted agents plug into governed workflows and get real work done. Think of orchestration as the shape of the container, and this role as how that container gets filled with automations in a deterministic, predictable way.The platform is early and the problems are hard. We are rebuilding how fund administration gets done to be agentic first, with humans and agents building, configuring, and deploying automations together. You will help shape the foundations, and engineering will look to you to make the call on ambiguous platform tradeoffs.AI fluency is a baseline expectation. PMs at this level should be comfortable using the full range of modern tools (e.G. LLMs, agent orchestration frameworks, Claude) to move faster and make sharper decisions. That might mean building and deploying your own agents on the platform you own, prototyping before writing requirements, or using coding agents to submit pull requests for engineering. The expectation is sound judgment about what will get to the best outcome for the customer and the team.This role would benefit from in-person collaboration in San Francisco, where many of our product management, design, and engineering personnel are based, although we also welcome exceptional candidates from elsewhere in the United States and Canada.What You’ll Do
Build the agent runtime for non-engineers: Own the vision, strategy, and roadmap for a platform where business users take an agent, app, or script from idea to governed production without an engineering cycle. Define the full lifecycle: draft, test, publish, version, deploy, run, observe, improve, and retire.Own evaluations and model governance: Define how every automation is tested before it ships. Work with engineering and our shared eval platform team on golden datasets, data labeling, and regression gates that block promotion. Decide when an automated judge is enough and when a human has to stay in the loop. Shape how evals decide which models are eligible for which agents, so a new model release becomes a product decision rather than a scramble.Solve the "who evaluates the evaluator" problem: Agents that grade other agents need their own checks. Partner with engineering on patterns that keep quality measurable at the scale of thousands of agents, and turn them into experiences builders can understand and trust.Shape memory, learning, and self‑improvement: Define how agents keep long‑lived memory, compact it, and improve from experience, with an eye on adoption and user‑facing impact rather than algorithms alone.Run a model‑agnostic platform: Own model routing, cost attribution, and pricing so teams can choose the right model for each job and see what it costs.Integrate with broader systems: Define how hosted agents reach data and take action across our product suite, our fund administration systems of record, and third‑party tools. Own the connector, credential, and access‑grant model so integrations are reusable rather than rebuilt per agent. Define agent identity and run modes, including when an agent acts with the invoking user’s access and when it acts under its own service identity.Give people oversight at scale: Design the tools that let fund administration teams supervise large fleets of agents: dashboards, run history, observability through traces, metrics, and logs, kill switches, and auditability. Make it clear what is an exception and what is an issue.Define how automations bind to workflows: Partner with the workflow orchestration PM on the agent registry and typed contracts that describe what an agent needs and produces, and how workflows bind to it. Protect the safety boundary that agent‑driven steps stage changes and people release them.Deliver configuration to business SMEs: Partner with design and engineering to build the tools SMEs use to configure, test, and tune automations themselves. Hold the line on convention over configuration so every setting earns its place.Stay ahead of the market: Track managed agent runtimes, agent frameworks, and automation platforms. Turn that view into clear build, buy, and partner calls.Be a leader: Set direction across the platform and adjacent teams, raise the bar for product craft, and be the person engineering trusts on ambiguous platform tradeoffs.Qualifications
7+ years of product management experience in B2B or Enterprise SaaS, including 3+ years operating in an AI‑oriented role.Proven experience owning a complex product area end‑to‑end, from strategy and roadmap through execution and iteration, ideally in a zero‑to‑one context.Hands‑on understanding of how agent evaluation works: golden datasets, data labeling, automated judges, regression testing, and knowing when a human has to step in.Background building agents and replacing human‑driven processes with product and automation, with real evaluation and monitoring discipline in production.A strong engineering partner with a product mindset. You can go deep with engineers on topics like typed contracts between agents and workflows, structured and deterministic outputs, and agent memory, and you know the right questions to ask even when you don’t have the answers. This is not a TPM role: your focus is how people actually use these tools.User empathy for non‑engineering builders and operators, including how people oversee large numbers of automated agents.Fluency with LLMs and common AI tools (e.G. Claude, Cursor). You should be able to run your own prototypes and use AI to get work done faster than a traditional PM workflow would allow. Bonus points for deep experience with managed agent platforms such as Claude Managed Agents or Workato Genies, including evals, tool and connector access, versions, and deployments.Strong communication skills, written and verbal, with the ability to articulate product decisions clearly to engineers, designers, executives, and customers alike.Track record of leading through influence, ideally mentoring or managing other product managers, and setting strategy that multiple teams execute against.What Success Looks Like
By the end of Q1: The platform runs real fund administration workflows with real automations, such as capital calls and distributions, built and deployed on Foundry.Following the Q1 milestone: Those workflows roll out to the entire fund administration team, fundamentally changing how they work.Long term: An "AI factory" where AI watches how work gets done and proposes new workflows and agents, and people move from building to oversight and course correction. A new client could be up and running in a day and fully automated within the week.Compensation
Compensation for this position includes a base salary, equity, and a variety of benefits. The U.S. salary range for this role is $200,000 - $230,000 USD. Actual base salaries will be based on candidate‑specific factors, including experience, skillset, and location, and local minimum pay requirements as applicable.Benefits Include
Health, dental, and vision care for you and your familyLife insuranceMental wellness coverageFertility and growing family supportFlex Time Off in addition to company‑paid holidaysPaid family leave, medical leave, and bereavement leave policiesRetirement saving plansAllowance to customize your work and technology setup at homeAnnual professional development stipendYour recruiter can provide additional details about compensation and benefits.#experiencedprofessional #Juniper-US #Juniper-Canada
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Lead Product Manager, Agent Runtime & Evals in Winnipeg, MB vacancy
- ...This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Lead Product Manager, Agent Runtime & Evals based in Canada. We are looking for an experienced product leader to shape the foundations of an innovative...Suggested
- Lead AI agent runtime strategy at Juniper Square, using product judgment and evaluation expertise to shape Foundry from San Francisco or remotely.As Lead Product Manager, you will own Foundry’s agent runtime and evaluation layer for non-engineering builders. You will guide...Suggested
- ...generation, semantic search, RAG, and agents. We believe that our work is... ...for building great products. Join us on our mission and shape... ...seeking an Agent Harness Product Manager to own the execution layer... ...Execution: Own the core agent runtime: tool orchestration, parallel...Suggested
$135k - $180k per year
What You Will DoWe are looking for a Lead Product Manager to own the future of the Lattice MCP (Model Context Protocol) server and the integrations... ..., like authentication, agentic execution frameworks, and evals that make future integrations faster, more scalable, and easier...Suggested- Lead AI evaluation strategy from Canada, applying automated testing and model governance to improve agent reliability across enterprise automations.As Lead Product Manager, Agent Runtime and Evals, you will shape evaluation infrastructure for an AI platform. Your scope includes...Suggested
$122.1k - $162.8k per year
...healthcare. We are known for delivering insights, products, and services that make quality care more... ...Summary (Purpose of job):TheService Manager – Level 5directs end‑to‑end ownership for... ...expectations. Owning service financials, the Lead Service Manager manages the budget and...usd158k - usd238k per year
...your best work. Job SummaryWe’re looking for a Principal Product Manager to own Agent Intelligence: the evaluation, observability and feedback systems... ...requirements and acceptance criteria into measurable evals, each with a clear threshold and owner Set scoring standards...- Lead AI agent security product strategy at Tigera in hybrid Vancouver, using Kubernetes and cloud-native networking expertise. Shape capabilities for production enterprise workloads.This senior product management role spans strategy through execution across Tigera Lynx and Calico...
- ...platform combines conversational AI agents, real-time human agent... ...across every channel. The world’s leading companies, including United... ...operate the stateful, low-latency runtime that powers voice and chat AI... ...and conversation state management to graceful recovery and multi...
- ...design and operate real-time AI agent infrastructure, delivering low-latency runtimes for voice and chat agents and a serverless... ...platform. You will own session management and multi-channel support in a... ...local dev environments, improve production observability, on-call readiness,...
$133.5k - $186.4k per year
...play happen. About Design HomeDesign Home is the world’s leading interior design mobile game, empowering millions of players to... ...enter the next evolution of the franchise, we’re looking for a Lead Product Manager to help shape the future of design entertainment. The...$118k - $168k per year
Opentext - The Information CompanyOpenText is a global leader in information management, where innovation, creativity, and collaboration are the key... ...digital knowledge workers—and we’re looking for a Lead Product Manager to help us get there. Your ImpactThis is more...$100k per year
Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing... .... As a Technical Program Manager within our Platform Gen... ...initiatives spanning runtime systems, device drivers, deployment... ...systems come together to deliver production-ready AI platforms. How to...- ...partner to alternative asset managers, supporting more than $1 trillion... ..., HSFT is recognized as a leading provider of alternative asset... ...to move solutions into production. We integrate AI into existing... ...As a Senior AI Platform and Runtime Engineer, you will build and...
- Lead Asana’s API and MCP product strategy from Vancouver, combining technical product management with an office-centric hybrid schedule. Shape secure developer experiences.Asana seeks... ...Protocol server, helping developers and agents use the Work Graph. The work connects customer...
$211k - $240k per year
The Product Management team drives Asana’s product strategy and execution, translating customer needs... ...larger purpose behind their work. As AI agents become part of how work gets done, we’re... ...’s Work Graph. We’re looking for a Lead Product Manager to lead product strategy...$118.3k - $168.3k per year
...be part of the play!Position Overview We're looking for a Lead Product Manager to run execution on Zynga's internal AI operating platform - the... ....Stay current on the technical AI landscape (models, agent frameworks, emerging tools) as it relates to features already...$126k - $224k per year
...opportunity for professional growth. Find your future with us. Boeing Vancouver is seeking an experienced and strategic Lead OR Principal Product Manager to drive the vision, strategy, and execution of our predictive maintenance solutions. The position will be based from...- ...technologies et domaines. Conditions Déplacements occasionnels (environ 10 %), principalement pour rencontrer des clients. Lead Technology Product Manager – CCH iFirm Taxprep and Taxprep About the role As Lead Technology Product Manager, you will own the vision and...
$171k per year
...Inc. is on a mission to advance human understanding. Our four products — Scribd®, Slideshare®, Everand™, and Fable — help billions... ...to build the best place to read and listen. We’re hiring a Lead Product Manager to own the Everand app. You’ll set its long‑term vision, own...- Lead Asana’s API and MCP product strategy from Vancouver, applying systems thinking and technical product management in an office-centric hybrid schedule.As Lead Product Manager, you will shape... ...for external developers and AI agents. You will connect APIs, authentication...
$135k - $180k per year
Lead Product Manager, Engagement Canada 1 gün 6 saat 11 dakika önce yayınlandı. Full Time Himalayas 135.000 - 180.000 CAD What You Will DoWe are looking for a Lead Product Manager to own the future of Lattice Engagement and help define what great employee listening looks...- Shape enterprise solutions as a Lead Product Manager with MaintainX, focusing on the Templating Service for multi-site operations. You'll lead strategy and execution while promoting workflow efficiency. In this pivotal role within the Enterprise Knowledge team, your 10+ years...
- ...Waabi, founded by AI visionary Raquel Urtasun, is the leader in Physical AI. With a world-class team, we’re unlocking the next era... ...in a positive way. To learn more visit: We are seeking a Lead Product Manager to lead the strategy and execution of the core autonomy stack...
- Elevate e-commerce solutions for AutoSync as a Lead Product Manager. Drive strategy and performance to create a unified digital shopping experience for consumers and dealers. Become the driving force behind AutoSync's Website and Digital Retail portfolio. In this senior role...
- ...#LI-AD1 Job Description The Opportunity: The Production Manager will be accountable for ensuring lines are always running effectively... ...their area with a trained team in place. This role will lead by example and inspire their team to deliver top results, is passionate...Full timeNight shift
- ...to join an innovative, market-leading company where you can truly elevate... ...and supporting the people who manage them. Our powerful, AI infused... ...the roleThe Principal Product Manager, Platform will help shape... ..., customers, partners, and AI agents to build safely and quickly.Drive...
- ...class investors and trusted by industry-leading teams like Gusto, Experian, Canva, and Brex... ...researchAbout This Role: You’ll be a Product Manager owning a strategic area of Great... ...and reliable enough that a builder, or an agent working for them, can run it end to end...
- Acquia is seeking a Senior Product Manager for Acquia Agent Experience. You will shape the product vision and drive the roadmap to empower an AI agent to perform tasks on our platform, within governed permissions and audit trails. This builder role requires prototyping with...
- Asana is seeking a Lead Product Manager to own the APIs and Model Context Protocol (MCP) server strategy from Vancouver. You will connect developer... ...with security and enterprise teams to ensure trusted agent access. This is a hybrid in-office role with a Vancouver base....
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Product Manager, Agent Runtime & Evals. Be the first to apply!
Related searches
- salesforce product manager Winnipeg, MB
- assistant product manager Winnipeg, MB
- director product management Winnipeg, MB
- senior product manager Winnipeg, MB
- junior product manager Winnipeg, MB
- responsable de produit Winnipeg, MB
- associate product manager Winnipeg, MB
- digital product manager Winnipeg, MB
- technical product manager Winnipeg, MB
- product safety manager Winnipeg, MB

