Production Ai Infrastructure Engineer
Jobgether
Build production AI infrastructure in Canada using agent orchestration, retrieval-augmented generation, and evaluation frameworks. Focus on reliable, secure, scalable systems.As an Applied AI Engineer, you will build and operate AI runtime infrastructure for production agent workflows. You will implement tool calling, RAG, grounding, and context retrieval systems. You will also develop evaluation harnesses, golden datasets, quality benchmarks, and safety controls. The work supports practical AI features for mission-critical customer workflows.Key Responsibilities:
Build and operate AI runtime and orchestration infrastructureImplement RAG, grounding, and context-retrieval systemsDevelop evaluation harnesses, datasets, and quality benchmarksIntegrate testing, quality gates, and regression checksOwn production reliability, latency, cost, and failure managementRequirements:
Production experience shipping LLM- or ML-powered softwareStrong understanding of systematic AI evaluation methodsAbility to manage cost and latency as constraintsClear communication with engineers, products, and customersPragmatic judgment focused on measurable customer valueApply applied AI engineering expertise across runtime architecture, RAG, evaluation, safety, and dependable production delivery.
#J-18808-Ljbffr
Build and operate AI runtime and orchestration infrastructureImplement RAG, grounding, and context-retrieval systemsDevelop evaluation harnesses, datasets, and quality benchmarksIntegrate testing, quality gates, and regression checksOwn production reliability, latency, cost, and failure managementRequirements:
Production experience shipping LLM- or ML-powered softwareStrong understanding of systematic AI evaluation methodsAbility to manage cost and latency as constraintsClear communication with engineers, products, and customersPragmatic judgment focused on measurable customer valueApply applied AI engineering expertise across runtime architecture, RAG, evaluation, safety, and dependable production delivery.
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Production Ai Infrastructure Engineer in Winnipeg, MB vacancy
- ...escouade d’administration de systèmes exploite des plateformes d’infrastructure essentielles au secteur Affaires, notamment Linux, AWS, Proxmox... ..... Show more Adecco est actuellement à la recherche d'un(e).Product Owner numérique bilingue.Ce rôle est idéal pour un(e)...Suggested
- Lead AI infrastructure product strategy at Equinix, shaping scalable offerings through customer insight, cross-functional leadership, and product... ...opportunities into viable services. The role partners with engineering, operations, marketing, user experience, and solution...Suggested
- Shape Spark product strategy with AI infrastructure expertise in Canada, working remotely across a globally distributed environment. Guide backend resources... ...and scalable product journeys. The work spans Product, Engineering, Growth, and Finance while supporting platform...SuggestedRemote work
- Shape AI infrastructure products remotely from Canada, using bare-metal systems and high-performance networking expertise. Influence platforms serving... ...infrastructure requirements into specifications and engineering priorities. The work connects physical resources with programmable...SuggestedRemote work
usd218k per year
Who are we?Equinix is the world’s digital infrastructure company®, shortening the path to... ...develops and manages the lifecycle of a product or group of products from concept to launch... ...cross functionally with user experience, engineering, operations, solution architects, marketing...SuggestedFull timeWork at office- We are looking for an AI Product Engineer to design, build, and deliver production-ready AI-powered products from end to end - from databases... ...evaluations, and prompt-injection safeguards. Manage CI/CD, infrastructure, monitoring, security, and production reliability....
usd276k per year
...are we?Equinix is the world’s digital infrastructure company®, shortening the path to... ...SummaryEquinix is building a new generation of AI infrastructure products, and we are looking for senior... ...help shape them. As a Distinguished Engineer on the AI Infrastructure Products team...Full timeWork at officeShift work- Secure and operate AI infrastructure at Terawatt Infrastructure, combining DevOps leadership with... ...agentic systems expertise.As a Staff DevOps Engineer, you will own infrastructure supporting... ...platform. You will partner with the AI Product Manager and engineers to deploy, secure,...
- Optimize distributed AI workloads in Montreal through C++, Python, Linux, and rigorous performance benchmarking on multi-node clusters.As a System Software Engineer, you will help redefine the infrastructure layer of AI. Your focus includes communication primitives, execution...
$180k - $210k per year
...and next steps. Our partner is looking for a Staff Network Engineer (AI Infrastructure) based in Canada. The Staff Network Engineer will design... ...across the platform. You will also test solutions in real production environments, turning operational insights into scalable product...Local areaRemote workFlexible hours- Network automation specialists can design AI cloud infrastructure from Canada as Staff Network Engineers focused on InfiniBand and Ethernet fabrics.This highly technical... .... The work includes NVIDIA networking, production testing, and scalable platform improvements within...
$123.3k - $159.5k per year
# Software Engineer, AI/ML InfrastructureThumbtack123k-160k CADFull-timeremote· seniorCanadagopythonpostgresListed... ...together.About the Machine Learning Infrastructure TeamAt Thumbtack, our challenges span a... ...enables these experiences. We empower product engineering teams by providing scalable...Seasonal workLocal area- Build agentic AI infrastructure at Cohere using distributed systems expertise and machine learning... ...worldwide.As a Senior Staff Software Engineer, you will create the platform powering... ...will connect ML research with reliable production infrastructure.Key Responsibilities:...Remote workWorldwide
usd218k per year
Who are we?Equinix is the world’s digital infrastructure company®, shortening the path to... ...understand business requirementsInteracts with product management teams to understand product... ...experienceBachelor’s in Computer Science or Computer Engineering The targeted pay range for this...Full timeWork at office- ...client, a highly innovative company operating at the forefront of AI & Emerging Technologies, is seeking an exceptional Principal AI Engineer to spearhead the development and optimization of their cloud infrastructure. This senior role is critical for designing, building, and...Remote workWork from homeHome officeFlexible hours
- ...applications and next steps. Our partner is looking for a Software Engineer – AI Tooling Infrastructure based in Canada. We are looking for an experienced... ...tools. In this role, you will take ownership of production services, including infrastructure supporting AI agents,...Long term contractWork at officeRemote workFlexible hours
- ...Stripe is seeking a Staff Product Manager for the Risk team to lead cross-Risk and cross-Stripe initiatives. You will shape infrastructure and product direction, connecting work across Risk and Stripe teams, while staying hands-on in technical and product decisions. You...
$154k - $199.5k per year
...details for this role. Job DescriptionWe are looking for an AI Platform Product Engineer who can lead AI initiatives from idea to production, and... ...cost of running AI in production (model usage, tokens, infrastructure and support). A critical thinker with strong research...Manual laborWork at officeWork from home- AI Product Engineer - MONTREAL, Quebec BasedSentinel | Angel HostAbout usAngel Host is a Montreal-based revenue management and listing optimization... ...Angel Host is our AI-native revenue intelligence and decision engine designed for medium and large short-term rental portfolios....Full timeTemporary workInternshipWork from homeTrial period
- Build AI-native revenue products at Syndio using agentic tools, with remote-first work available within commuting distance of Calgary.As a GTM AI Product Engineer, you will solve real problems for Marketing, Sales, and Customer Success. You will translate business needs into...Remote work
- Thomson Reuters is looking for aStaff Software Engineer, AI Product Engineeringto help shape and build the next generation of AI-powered software... ...preferred. Experience with Docker, Kubernetes, CI/CD, infrastructure as code, observability, and modern cloud-native engineering...Work at officeLocal areaFlexible hours
- Build agentic AI workflows as a Product Security Engineer at Spotify in Toronto, transforming vulnerabilities into tested code improvements. Flexible home... ...in software, security, developer experience, or infrastructure engineeringAbility to write Java, Python, Scala, C++,...Work from homeFlexible hours
- Lead AI product engineering at Spellbook as an Engineering Manager, combining system design and hands-on implementation. Work with product and design on legal technology.This technical leadership role guides a small team building AI products for legal professionals. You will...
- COFOMO is seeking an Infrastructure Engineering Consultant in Montreal with a hybrid work model. You will drive modernization of infrastructure through IaC, CI/CD, DevOps, and AI-assisted engineering across cloud and on‑prem environments. You will mentor teams, design reusable...
- ...what powers the next generation of AI? We’re looking for a Staff LLMOps Engineer to lead the design, deployment... ...large language model (LLM) infrastructure on the cloud.You’ll be the driving... ...taking trained models from lab to production—scaling efficiently across multi-...Work at office
- ...Jobgether is seeking a Software Engineer – AI Tooling Infrastructure to build, operate, and scale backend services powering AI-driven developer tools. You will own production systems, including MCP server integrations, and collaborate across Platform, SRE, Authentication, Billing...Remote work
$140k - $175k per year
Summary: Product Analytics is building self‑service tools and operating AI agents that influence product development; agents that monitor... ...solutions and own the shared infrastructure underneath it. We are seeking an AI Engineering Lead to own that layer across a team...RemplacementWork at officeLocal areaFlexible hours2 days per week3 days per week$155k - $185k per year
...respecting communication and productivity tools that help people manage... ...desktop, mobile, paid services, AI offerings, and enterprise-... ...more control over their data, infrastructure, and model choices.We’re... ...for a Staff Full-Stack Product Engineer: a full-stack engineer who ships...Long term contractPermanent employmentFull timeFor contractorsInternshipLocal areaRemote work- Elevate your career with Huawei Canada as a Senior Engineer focusing on cloud AI infrastructure. This permanent role blends systems engineering, research, and product innovation in a dynamic environment. As part of the Distributed Scheduling and Data Engine Lab, you will...Permanent employment
- Direct AI coding agents to build full-stack applications at Remitly... ....As a Senior AI Native Software Engineer, you solve customer problems by... ...of writing code directly. Build products end-to-end across frontend, backend, data, and infrastructure. Your work spans automation, product...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Production Ai Infrastructure Engineer. Be the first to apply!

