Ai Infrastructure Engineer
Palona AI
Palona's AI agents operate continuously in production, handle real-time guest interactions, integrate with restaurant systems, and face sharp traffic peaks. Infrastructure is therefore part of the product: latency, reliability, deployment safety, observability, security, and cost directly shape the guest and operator experience.
We are looking for an Infrastructure Engineer who combines cloud and reliability depth with strong software engineering judgment. You will build and operate the platform beneath Palona's AI products, improve how engineers ship, and turn production signals into durable system improvements. This is not a ticket-driven IT or operations role. You will write production code, design systems, automate repetitive work, and own outcomes across the full service lifecycle.
Our current environment includes Python services, Docker, AWS and selected Azure services, ECS and Lambda workloads, API Gateway, load balancers, relational data systems, OpenTofu/Terraform, Datadog, and CI/CD automation. We value the ability to learn and make sound tradeoffs more than exact tool-for-tool matching.
What you will own:
Design, build, and evolve secure, scalable cloud infrastructure for real-time AI services and customer-facing applications
Improve service reliability through clear SLOs, actionable observability, capacity planning, failure testing, and pragmatic incident prevention
Build deployment and release systems that make production changes fast, repeatable, auditable, and safe
Own infrastructure as code, environment consistency, and reusable platform patterns across development, staging, and production
Partner with product and AI engineers on architecture, performance, data flows, and operational readiness for new capabilities
Diagnose complex distributed-system failures across application, network, database, model-provider, and third-party integration boundaries
Reduce infrastructure and model-serving cost without compromising customer experience or engineering velocity
Strengthen secrets management, access controls, backup and recovery, vulnerability management, and other practical security foundations
Build internal tooling and paved paths that let engineers ship and operate services with less manual work
Participate in incident response and turn incidents into better systems, automation, documentation, and engineering judgment
Requirements
3+ years industrial experience in relevant technical domain
Strong software engineering fundamentals and experience building or operating production distributed systems
Hands-on experience with a major cloud platform;
AWS experience is especially relevant
Experience with containers, infrastructure as code, CI/CD, monitoring, alerting, and production debugging
Ability to write reliable automation and services in Python or another modern programming language
Sound judgment around availability, latency, scalability, security, and cost tradeoffs
A track record of taking ambiguous operational problems from diagnosis through durable resolution
Clear communication during architecture reviews, launches, and incidents
AI-native working habits and curiosity about the operational behavior of LLM- and agent-powered systems
Benefits
Competitive Salary and Stock Option Plan
Medical, dental, vision, retirement, leave, and disability benefits as applicable
Family Leave
Short Term & Long Term Disability
Paid time off and company holidays
Learning and development support
#J-18808-Ljbffr
We are looking for an Infrastructure Engineer who combines cloud and reliability depth with strong software engineering judgment. You will build and operate the platform beneath Palona's AI products, improve how engineers ship, and turn production signals into durable system improvements. This is not a ticket-driven IT or operations role. You will write production code, design systems, automate repetitive work, and own outcomes across the full service lifecycle.
Our current environment includes Python services, Docker, AWS and selected Azure services, ECS and Lambda workloads, API Gateway, load balancers, relational data systems, OpenTofu/Terraform, Datadog, and CI/CD automation. We value the ability to learn and make sound tradeoffs more than exact tool-for-tool matching.
What you will own:
Design, build, and evolve secure, scalable cloud infrastructure for real-time AI services and customer-facing applications
Improve service reliability through clear SLOs, actionable observability, capacity planning, failure testing, and pragmatic incident prevention
Build deployment and release systems that make production changes fast, repeatable, auditable, and safe
Own infrastructure as code, environment consistency, and reusable platform patterns across development, staging, and production
Partner with product and AI engineers on architecture, performance, data flows, and operational readiness for new capabilities
Diagnose complex distributed-system failures across application, network, database, model-provider, and third-party integration boundaries
Reduce infrastructure and model-serving cost without compromising customer experience or engineering velocity
Strengthen secrets management, access controls, backup and recovery, vulnerability management, and other practical security foundations
Build internal tooling and paved paths that let engineers ship and operate services with less manual work
Participate in incident response and turn incidents into better systems, automation, documentation, and engineering judgment
Requirements
3+ years industrial experience in relevant technical domain
Strong software engineering fundamentals and experience building or operating production distributed systems
Hands-on experience with a major cloud platform;
AWS experience is especially relevant
Experience with containers, infrastructure as code, CI/CD, monitoring, alerting, and production debugging
Ability to write reliable automation and services in Python or another modern programming language
Sound judgment around availability, latency, scalability, security, and cost tradeoffs
A track record of taking ambiguous operational problems from diagnosis through durable resolution
Clear communication during architecture reviews, launches, and incidents
AI-native working habits and curiosity about the operational behavior of LLM- and agent-powered systems
Benefits
Competitive Salary and Stock Option Plan
Medical, dental, vision, retirement, leave, and disability benefits as applicable
Family Leave
Short Term & Long Term Disability
Paid time off and company holidays
Learning and development support
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Ai Infrastructure Engineer in Winnipeg, MB vacancy
- Secure and operate AI infrastructure at Terawatt Infrastructure, combining DevOps leadership with cloud reliability, observability, and agentic systems expertise.As a Staff DevOps Engineer, you will own infrastructure supporting Terawatt’s internal tools and AI platform. You...Suggested
usd276k per year
Who are we?Equinix is the world’s digital infrastructure company®, shortening the path to... ...SummaryEquinix is building a new generation of AI infrastructure products, and we are looking... ...leaders to help shape them. As a Distinguished Engineer on the AI Infrastructure Products team,...SuggestedFull timeWork at officeShift work- Engineer resilient AI infrastructure with AWS or GCP, Docker, and Kubernetes at Pelmorex’s flexible hybrid Oakville workplace. This is a 12-month contract.The Software Engineer, AI will harden experimental systems into highly available production platforms supporting The Weather...SuggestedContract workFlexible hours
$123.3k - $159.5k per year
# Software Engineer, AI/ML InfrastructureThumbtack123k-160k CADFull-timeremote· seniorCanadagopythonpostgresListed via Jobicy · posted... ...Imagine what we’ll build together.About the Machine Learning Infrastructure TeamAt Thumbtack, our challenges span a wide range of areas,...SuggestedSeasonal workLocal area- Build robotics data infrastructure at Mecka AI using Python, SQL, and object storage for global embodied AI systems. Own production data and fleet workflows end to end.As a Data Infrastructure Engineer, you will turn synchronized video, robot state, and actions into searchable...SuggestedRemote work
- Network automation specialists can design AI cloud infrastructure from Canada as Staff Network Engineers focused on InfiniBand and Ethernet fabrics.This highly technical Staff Network Engineer role develops software-driven networking for large-scale AI workloads. You will automate...
- ...optimize the server-side systems and APIs powering AI products, from data pipelines to scalable... ...hours. You will collaborate asynchronously with engineers and researchers across time zones to deliver robust infrastructure for AI training and inference. #J-18808-LjbffrHourly payContract workRemote workFlexible hours
- Cohere is seeking a Software Engineer to build and maintain high-performance data infrastructure essential for AI training workloads. The role involves working on petabyte-scale storage and addressing complex performance challenges. Candidates should have over 4 years of experience...Remote workFlexible hours
- Work remotely from eligible Canadian provinces on AI infrastructure using LLM gateways, agent runtimes, and highly available backend systems.Affirm’s AI Platform team is hiring a Senior Software Engineer to help move AI workloads from pilots into production. You will build...Remote work
- About the RoleWe’re seeking a skilled Platform Engineer to deploy and manage AI/ML infrastructure and applications on Kubernetes. You’ll be responsible for building reliable, scalable, and secure deployment pipelines using modern GitOps practices. What You’ll Do Deploy...
$180k - $210k per year
...listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Staff Network Engineer (AI Infrastructure) based in Canada. The Staff Network Engineer will design and build the networking automation that powers next-generation...Local areaRemote workFlexible hours- ...listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Software Engineer – AI Tooling Infrastructure based in Canada. We are looking for an experienced Software Engineer to build, operate, and scale the backend...Long term contractWork at officeRemote workFlexible hours
- ...client, a highly innovative company operating at the forefront of AI & Emerging Technologies, is seeking an exceptional Principal AI Engineer to spearhead the development and optimization of their cloud infrastructure. This senior role is critical for designing, building, and...Remote workWork from homeHome officeFlexible hours
- ...) en représentant les besoins des clients ... Show more Notre escouade d’administration de systèmes exploite des plateformes d’infrastructure essentielles au secteur Affaires, notamment Linux, AWS, Proxmox VE, Ansible, les services DNS, la gestion des i... Show more Adecco...
- ...Lead IT infrastructure projects at CBC/Radio-Canada using detailed engineering design, cloud technologies, and hands-on deployment expertise in a hybrid work model. This full-time permanent Engineering Project Lead position is based in Toronto, with projects focused on technology...Permanent employmentFull time
- ...Own cloud infrastructure and CI/CD automation as a Senior DevOps Engineer with Bounteous, supporting secure, scalable, reliable platforms remotely across Canada or Mexico. This contract position requires six-plus years in DevOps, Cloud Engineering, SRE, or Infrastructure...Contract workInternshipRemote work
- ...invited to be a part of that. • Our convenient Price Café offers free Tea and Coffee. Position Summary Join our AI team as an Intermediate AI Engineer, where you'll build and deploy AI applications, agents, and automation solutions that solve real business problems....
- ...office Ready to build what powers the next generation of AI? We’re looking for a Staff LLMOps Engineer to lead the design, deployment, and optimization of large language model (LLM) infrastructure on the cloud.You’ll be the driving force behind taking trained...Work at office
- Thumbtack is seeking a Software Engineer for AI/ML Infrastructure in Canada. You will work on core AI platform capabilities enabling GenAI-powered applications, collaborating with product and platform teams to design, develop, and deploy scalable tools and infrastructure. Ideal...Full timeRemote work
- ...Jobgether is seeking a Software Engineer – AI Tooling Infrastructure to build, operate, and scale backend services powering AI-driven developer tools. You will own production systems, including MCP server integrations, and collaborate across Platform, SRE, Authentication, Billing...Remote work
- Relay is hiring a Senior Software Engineer (Voyager) in Toronto to help build AI-enabled infrastructure and accelerate product experiences for small businesses. You will shape AI foundations, prototype emerging technologies, and partner with product teams to deliver impactful...
- Elevate your career with Huawei Canada as a Senior Engineer focusing on cloud AI infrastructure. This permanent role blends systems engineering, research,... ...environment. As part of the Distributed Scheduling and Data Engine Lab, you will contribute to cutting-edge AI...Permanent employment
- COFOMO is seeking an Infrastructure Engineering Consultant in Montreal with a hybrid work model. You will drive modernization of infrastructure through IaC, CI/CD, DevOps, and AI-assisted engineering across cloud and on‑prem environments. You will mentor teams, design reusable...
- About the Role Our client, a leading research institution, is seeking an experienced AI Infrastructure Engineer to manage and optimize their High-Performance Computing (HPC) environment dedicated to AI workloads. This hybrid role involves regular collaboration at our Kimberley...Remote work
- Take a leading role in AI at Cerebras Systems as a Senior Software Development Engineer in Test, specializing in advanced testing for AI infrastructure. Your work will directly influence the reliability of unprecedented AI technologies. At Cerebras Systems, the architect...
$130k - $165k per year
...behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Principal DevOps Engineer (AI/ML Infrastructure) based in CanadaWe are looking for an experienced Principal DevOps Engineer to design, build, and manage the infrastructure...Long term contractFull timeRemote work- ...Cohere is hiring for a role in a security-first enterprise AI setting, focusing on scalable ML infrastructure and agentic systems. You will help build the platform that powers autonomous AI at scale, with focus on secure code execution, state management, and model routing....Remote work
- ...full-time professionals, and our annual growth rate exceeds 25%. Job Description Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US healthcare client. You will play a key role in developing and enhancing an...Full timeInternshipRemote workRelocation
- ...Drive AI innovation as a Senior AI Engineer in Mississauga, Canada. Craft Python-based AI applications using FastAPI or Flask while optimizing performance and scalability for enterprise solutions. We are seeking an experienced Senior AI Engineer with over 8 years in software...
- Build the governed data foundation behind Cohere’s frontier AI systems, leading infrastructure engineering from Toronto or another global office. Remote-friendly work is available.As a senior data infrastructure leader, you will make Cohere’s data trustworthy, available, and...Work at officeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Ai Infrastructure Engineer. Be the first to apply!

