Production Ai Infrastructure Engineer
Jobgether
Build production AI infrastructure in Canada using agent orchestration, retrieval-augmented generation, and evaluation frameworks. Focus on reliable, secure, scalable systems.As an Applied AI Engineer, you will build and operate AI runtime infrastructure for production agent workflows. You will implement tool calling, RAG, grounding, and context retrieval systems. You will also develop evaluation harnesses, golden datasets, quality benchmarks, and safety controls. The work supports practical AI features for mission-critical customer workflows.Key Responsibilities:
Build and operate AI runtime and orchestration infrastructureImplement RAG, grounding, and context-retrieval systemsDevelop evaluation harnesses, datasets, and quality benchmarksIntegrate testing, quality gates, and regression checksOwn production reliability, latency, cost, and failure managementRequirements:
Production experience shipping LLM- or ML-powered softwareStrong understanding of systematic AI evaluation methodsAbility to manage cost and latency as constraintsClear communication with engineers, products, and customersPragmatic judgment focused on measurable customer valueApply applied AI engineering expertise across runtime architecture, RAG, evaluation, safety, and dependable production delivery.
#J-18808-Ljbffr
Build and operate AI runtime and orchestration infrastructureImplement RAG, grounding, and context-retrieval systemsDevelop evaluation harnesses, datasets, and quality benchmarksIntegrate testing, quality gates, and regression checksOwn production reliability, latency, cost, and failure managementRequirements:
Production experience shipping LLM- or ML-powered softwareStrong understanding of systematic AI evaluation methodsAbility to manage cost and latency as constraintsClear communication with engineers, products, and customersPragmatic judgment focused on measurable customer valueApply applied AI engineering expertise across runtime architecture, RAG, evaluation, safety, and dependable production delivery.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Production Ai Infrastructure Engineer in Winnipeg, MB vacancy
- ...escouade d’administration de systèmes exploite des plateformes d’infrastructure essentielles au secteur Affaires, notamment Linux, AWS, Proxmox... ..... Show more Adecco est actuellement à la recherche d'un(e).Product Owner numérique bilingue.Ce rôle est idéal pour un(e)...Suggested
usd218k per year
Who are we?Equinix is the world’s digital infrastructure company®, shortening the path to... ...develops and manages the lifecycle of a product or group of products from concept to launch... ...cross functionally with user experience, engineering, operations, solution architects, marketing...SuggestedFull timeWork at office$80.9k - $129.73k per year
Product Engineering (Infrastructure as Code)This website uses cookies and similar technology to better understand how visitors use our site and offer you... ...or related infrastructure automation technologies.* Apply AI-assisted engineering and Specification-Driven Design practices...SuggestedFull timeInternshipWork at officeRemote workHome officeFlexible hours- Shape AI infrastructure products remotely from Canada, using bare-metal systems and high-performance networking expertise. Influence platforms serving... ...infrastructure requirements into specifications and engineering priorities. The work connects physical resources with programmable...SuggestedRemote work
- Shape Spark product strategy with AI infrastructure expertise in Canada, working remotely across a globally distributed environment. Guide backend resources... ...and scalable product journeys. The work spans Product, Engineering, Growth, and Finance while supporting platform...SuggestedRemote work
- Build production-grade AI infrastructure with Python and FastAPI at EPAM Systems, supporting enterprise knowledge systems and reliable retrieval. Work... ...across backend services and observability.As a Python AI Engineer, you will evolve a Confluence-focused RAG chatbot into a...
usd276k per year
...are we?Equinix is the world’s digital infrastructure company®, shortening the path to... ...SummaryEquinix is building a new generation of AI infrastructure products, and we are looking for senior... ...help shape them. As a Distinguished Engineer on the AI Infrastructure Products team...Full timeWork at officeShift work- Engineer resilient AI infrastructure with AWS or GCP, Docker, and Kubernetes at Pelmorex’s flexible hybrid Oakville workplace. This is a 12-month contract... ...will harden experimental systems into highly available production platforms supporting The Weather Network, MétéoMédia,...Contract workFlexible hours
- Secure and operate AI infrastructure at Terawatt Infrastructure, combining DevOps leadership with... ...agentic systems expertise.As a Staff DevOps Engineer, you will own infrastructure supporting... ...platform. You will partner with the AI Product Manager and engineers to deploy, secure,...
- Build enterprise Infrastructure as Code capabilities remotely at Allstate, using Terraform, Ansible, and scalable automation engineering practices. Help transform infrastructure delivery through code.As a Product Engineering practitioner, you will design, build, and productize...Remote work
- We are looking for an AI Product Engineer to design, build, and deliver production-ready AI-powered products from end to end - from databases... ...evaluations, and prompt-injection safeguards. Manage CI/CD, infrastructure, monitoring, security, and production reliability....
- Optimize distributed AI workloads in Montreal through C++, Python, Linux, and rigorous performance benchmarking on multi-node clusters.As a System Software Engineer, you will help redefine the infrastructure layer of AI. Your focus includes communication primitives, execution...
- Build agentic AI infrastructure at Cohere using distributed systems expertise and machine learning... ...worldwide.As a Senior Staff Software Engineer, you will create the platform powering... ...will connect ML research with reliable production infrastructure.Key Responsibilities:...Remote workWorldwide
$123.3k - $159.5k per year
TThumbtackvia Jobicy# Software Engineer, AI/ML InfrastructureRemoteCanadaFull-timePosted2mo... ...build together.About the Machine Learning Infrastructure TeamAt Thumbtack, our challenges span a... ...enables these experiences. We empower product engineering teams by providing scalable...Seasonal workLocal area- Network automation specialists can design AI cloud infrastructure from Canada as Staff Network Engineers focused on InfiniBand and Ethernet fabrics.This highly technical... .... The work includes NVIDIA networking, production testing, and scalable platform improvements within...
- ...applications and next steps. Our partner is looking for a Software Engineer – AI Tooling Infrastructure based in Canada. We are looking for an experienced... ...tools. In this role, you will take ownership of production services, including infrastructure supporting AI agents,...Long term contractWork at officeRemote workFlexible hours
- ...optimize the server-side systems and APIs powering AI products, from data pipelines to scalable microservices... .... You will collaborate asynchronously with engineers and researchers across time zones to deliver robust infrastructure for AI training and inference. #J-18808-...Hourly payContract workRemote workFlexible hours
- Work remotely from eligible Canadian provinces on AI infrastructure using LLM gateways, agent runtimes, and highly... ...’s AI Platform team is hiring a Senior Software Engineer to help move AI workloads from pilots into production. You will build governed interfaces for models,...Remote work
- About the RoleWe’re seeking a skilled Platform Engineer to deploy and manage AI/ML infrastructure and applications on Kubernetes. You’ll be responsible for building... ...Monitor application performance and troubleshoot production issues. Document procedures, runbooks, and...
- AI Product Engineer - MONTREAL, Quebec BasedSentinel | Angel HostAbout usAngel Host is a Montreal-based revenue management and listing optimization... ...Angel Host is our AI-native revenue intelligence and decision engine designed for medium and large short-term rental portfolios....Full timeTemporary workInternshipWork from homeTrial period
- ...Own cloud infrastructure and CI/CD automation as a Senior DevOps Engineer with Bounteous, supporting secure, scalable, reliable platforms remotely across Canada or... ...administration. The work spans development, QA, staging, and production environments. Key Responsibilities:...Contract workInternshipRemote work
- ...client, a highly innovative company operating at the forefront of AI & Emerging Technologies, is seeking an exceptional Principal AI Engineer to spearhead the development and optimization of their cloud infrastructure. This senior role is critical for designing, building, and...Remote workWork from homeHome officeFlexible hours
- Cohere is seeking a Software Engineer to build and maintain high-performance data infrastructure essential for AI training workloads. The role involves working on petabyte-scale storage and addressing complex performance challenges. Candidates should have over 4 years of experience...Remote workFlexible hours
$154k - $199.5k per year
...details for this role. Job DescriptionWe are looking for an AI Platform Product Engineer who can lead AI initiatives from idea to production, and... ...cost of running AI in production (model usage, tokens, infrastructure and support). A critical thinker with strong research...Manual laborWork at officeWork from home- Relay is hiring a Senior Software Engineer (Voyager) in Toronto to help build AI-enabled infrastructure and accelerate product experiences for small businesses. You will shape AI foundations, prototype emerging technologies, and partner with product teams to deliver impactful...
- ...Lead IT infrastructure projects at CBC/Radio-Canada using detailed engineering design, cloud technologies, and hands-on deployment expertise in a hybrid work model. This full-time permanent Engineering Project Lead position is based in Toronto, with projects focused on technology...Permanent employmentFull time
- ...leading manufacturer and distributor of air distribution products ( The founding principles of Price have never changed –... ...offers free Tea and Coffee. Position Summary Join our AI team as an Intermediate AI Engineer, where you'll build and deploy AI applications, agents,...
- ...Montreal-based tech company seeking a Senior AI Developer to design, build, and operate AI... ...and scale agentic workflows across product and internal platforms. You will join the... ...Tech - Data team, collaborating with Data Engineers, Data Scientists, and Software Engineers to...
- Engineer production AI applications, intelligent workflows, and scalable APIs for a dental-industry SaaS platform in Calgary or remotely across Canada. Python experience is valuable.This AI/ML Platform Software Developer opportunity suits an experienced builder with eight-plus...Remote work
- Lead AI product engineering at Spellbook as an Engineering Manager, combining system design and hands-on implementation. Work with product and design on legal technology.This technical leadership role guides a small team building AI products for legal professionals. You will...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Production Ai Infrastructure Engineer. Be the first to apply!

