Production Ai Infrastructure Engineer
Jobgether
Build production AI infrastructure in Canada using agent orchestration, retrieval-augmented generation, and evaluation frameworks. Focus on reliable, secure, scalable systems.As an Applied AI Engineer, you will build and operate AI runtime infrastructure for production agent workflows. You will implement tool calling, RAG, grounding, and context retrieval systems. You will also develop evaluation harnesses, golden datasets, quality benchmarks, and safety controls. The work supports practical AI features for mission-critical customer workflows.Key Responsibilities:
Build and operate AI runtime and orchestration infrastructureImplement RAG, grounding, and context-retrieval systemsDevelop evaluation harnesses, datasets, and quality benchmarksIntegrate testing, quality gates, and regression checksOwn production reliability, latency, cost, and failure managementRequirements:
Production experience shipping LLM- or ML-powered softwareStrong understanding of systematic AI evaluation methodsAbility to manage cost and latency as constraintsClear communication with engineers, products, and customersPragmatic judgment focused on measurable customer valueApply applied AI engineering expertise across runtime architecture, RAG, evaluation, safety, and dependable production delivery.
#J-18808-Ljbffr
Build and operate AI runtime and orchestration infrastructureImplement RAG, grounding, and context-retrieval systemsDevelop evaluation harnesses, datasets, and quality benchmarksIntegrate testing, quality gates, and regression checksOwn production reliability, latency, cost, and failure managementRequirements:
Production experience shipping LLM- or ML-powered softwareStrong understanding of systematic AI evaluation methodsAbility to manage cost and latency as constraintsClear communication with engineers, products, and customersPragmatic judgment focused on measurable customer valueApply applied AI engineering expertise across runtime architecture, RAG, evaluation, safety, and dependable production delivery.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Production Ai Infrastructure Engineer in Winnipeg, MB vacancy
- ...escouade d’administration de systèmes exploite des plateformes d’infrastructure essentielles au secteur Affaires, notamment Linux, AWS, Proxmox... ..... Show more Adecco est actuellement à la recherche d'un(e).Product Owner numérique bilingue.Ce rôle est idéal pour un(e)...Suggested
- Shape Spark product strategy with AI infrastructure expertise in Canada, working remotely across a globally distributed environment. Guide backend resources... ...and scalable product journeys. The work spans Product, Engineering, Growth, and Finance while supporting platform...SuggestedRemote work
usd218k per year
Who are we?Equinix is the world’s digital infrastructure company®, shortening the path to... ...develops and manages the lifecycle of a product or group of products from concept to launch... ...cross functionally with user experience, engineering, operations, solution architects, marketing...SuggestedFull timeWork at office- Secure and operate AI infrastructure at Terawatt Infrastructure, combining DevOps leadership with... ...agentic systems expertise.As a Staff DevOps Engineer, you will own infrastructure supporting... ...platform. You will partner with the AI Product Manager and engineers to deploy, secure,...Suggested
- Lead AI infrastructure product strategy at Equinix, shaping scalable offerings through customer insight, cross-functional leadership, and product... ...opportunities into viable services. The role partners with engineering, operations, marketing, user experience, and solution...Suggested
- Shape AI infrastructure products remotely from Canada, using bare-metal systems and high-performance networking expertise. Influence platforms serving... ...infrastructure requirements into specifications and engineering priorities. The work connects physical resources with programmable...Remote work
usd276k per year
...are we?Equinix is the world’s digital infrastructure company®, shortening the path to... ...SummaryEquinix is building a new generation of AI infrastructure products, and we are looking for senior... ...help shape them. As a Distinguished Engineer on the AI Infrastructure Products team...Full timeWork at officeShift work- We are looking for an AI Product Engineer to design, build, and deliver production-ready AI-powered products from end to end - from databases... ...evaluations, and prompt-injection safeguards. Manage CI/CD, infrastructure, monitoring, security, and production reliability....
- Optimize distributed AI workloads in Montreal through C++, Python, Linux, and rigorous performance benchmarking on multi-node clusters.As a System Software Engineer, you will help redefine the infrastructure layer of AI. Your focus includes communication primitives, execution...
- ...applications and next steps. Our partner is looking for a Software Engineer – AI Tooling Infrastructure based in Canada. We are looking for an experienced... ...tools. In this role, you will take ownership of production services, including infrastructure supporting AI agents,...Long term contractWork at officeRemote workFlexible hours
- Build agentic AI infrastructure at Cohere using distributed systems expertise and machine learning... ...worldwide.As a Senior Staff Software Engineer, you will create the platform powering... ...will connect ML research with reliable production infrastructure.Key Responsibilities:...Remote workWorldwide
$123.3k - $159.5k per year
...your home — from personalized guidance to AI tools and a best-in-class hiring... ...build together. About the Machine Learning Infrastructure Team At Thumbtack, our challenges span... ...enables these experiences. We empower product engineering teams by providing scalable, high-performance...Seasonal workLocal area- Network automation specialists can design AI cloud infrastructure from Canada as Staff Network Engineers focused on InfiniBand and Ethernet fabrics.This highly technical... .... The work includes NVIDIA networking, production testing, and scalable platform improvements within...
- AI Product Engineer - MONTREAL, Quebec BasedSentinel | Angel HostAbout usAngel Host is a Montreal-based revenue management and listing optimization... ...Angel Host is our AI-native revenue intelligence and decision engine designed for medium and large short-term rental portfolios....Full timeTemporary workInternshipWork from homeTrial period
$180k - $210k per year
...and next steps. Our partner is looking for a Staff Network Engineer (AI Infrastructure) based in Canada. The Staff Network Engineer will design... ...across the platform. You will also test solutions in real production environments, turning operational insights into scalable product...Local areaRemote workFlexible hoursusd218k per year
Who are we?Equinix is the world’s digital infrastructure company®, shortening the path to... ...understand business requirementsInteracts with product management teams to understand product... ...experienceBachelor’s in Computer Science or Computer Engineering The targeted pay range for this...Full timeWork at office- ...Own cloud infrastructure and CI/CD automation as a Senior DevOps Engineer with Bounteous, supporting secure, scalable, reliable platforms remotely across Canada or... ...administration. The work spans development, QA, staging, and production environments. Key Responsibilities:...Contract workInternshipRemote work
- ...Stripe is seeking a Staff Product Manager for the Risk team to lead cross-Risk and cross-Stripe initiatives. You will shape infrastructure and product direction, connecting work across Risk and Stripe teams, while staying hands-on in technical and product decisions. You...
$154k - $199.5k per year
...details for this role. Job DescriptionWe are looking for an AI Platform Product Engineer who can lead AI initiatives from idea to production, and... ...cost of running AI in production (model usage, tokens, infrastructure and support). A critical thinker with strong research...Manual laborWork at officeWork from home- ...client, a highly innovative company operating at the forefront of AI & Emerging Technologies, is seeking an exceptional Principal AI Engineer to spearhead the development and optimization of their cloud infrastructure. This senior role is critical for designing, building, and...Remote workWork from homeHome officeFlexible hours
- ...leading manufacturer and distributor of air distribution products ( The founding principles of Price have never changed –... ...offers free Tea and Coffee. Position Summary Join our AI team as an Intermediate AI Engineer, where you'll build and deploy AI applications, agents,...
- Relay is hiring a Senior Software Engineer (Voyager) in Toronto to help build AI-enabled infrastructure and accelerate product experiences for small businesses. You will shape AI foundations, prototype emerging technologies, and partner with product teams to deliver impactful...
- Build AI-native revenue products at Syndio using agentic tools, with remote-first work available within commuting distance of Calgary.As a GTM AI Product Engineer, you will solve real problems for Marketing, Sales, and Customer Success. You will translate business needs into...Remote work
- ...Jobgether is seeking a Software Engineer – AI Tooling Infrastructure to build, operate, and scale backend services powering AI-driven developer tools. You will own production systems, including MCP server integrations, and collaborate across Platform, SRE, Authentication, Billing...Remote work
- Elevate your career with Huawei Canada as a Senior Engineer focusing on cloud AI infrastructure. This permanent role blends systems engineering, research, and product innovation in a dynamic environment. As part of the Distributed Scheduling and Data Engine Lab, you will...Permanent employment
- Lead production AI initiatives in Canada using Python, Django, and generative AI expertise to... ...through reliable systems.As a Staff AI Engineer, you will shape AI architecture and... ...deployment while strengthening shared infrastructure. The work combines hands-on backend engineering...
$140k - $175k per year
Summary: Product Analytics is building self‑service tools and operating AI agents that influence product development; agents that monitor... ...solutions and own the shared infrastructure underneath it. We are seeking an AI Engineering Lead to own that layer across a team...RemplacementWork at officeLocal areaFlexible hours2 days per week3 days per week- ...what powers the next generation of AI? We’re looking for a Staff LLMOps Engineer to lead the design, deployment... ...large language model (LLM) infrastructure on the cloud.You’ll be the driving... ...taking trained models from lab to production—scaling efficiently across multi-...Work at office
$165k - $330k per year
...for the world's most dynamic AI companies, like Cursor, Notion... ...AI research, flexible infrastructure, and seamless developer tooling... ...bring cutting-edge models into production. We're growing quickly and recently... ...and help build the platform engineers turn to to ship AI products....Flexible hours- ...Montreal-based tech company seeking a Senior AI Developer to design, build, and operate AI... ...and scale agentic workflows across product and internal platforms. You will join the... ...Tech - Data team, collaborating with Data Engineers, Data Scientists, and Software Engineers to...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Production Ai Infrastructure Engineer. Be the first to apply!

