Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Ai Infrastructure Engineer

Mission

Employment type:
Full-time position, 40 hours per week, with direct employment by the client.Hybrid:
Candidates must be able to work at the client’s Montreal office.Our company description
Mission.Dev is the next-gen staffing platform for software talent.We help you find, evaluate, and manage top software talent (contractors or direct hires) faster, smarter, and more efficiently.Powered by AI. Backed by real humans .About the client
An AI infrastructure company specializing in inference optimization for large-scale models.The platform enhances token throughput and reduces latency by optimizing hardware utilization and decoding processes within a customer's cloud environment.The technology focuses on improving the efficiency of model serving without requiring changes to existing infrastructure or code, ensuring data privacy while reducing operational costs for organizations deploying open-source models.About the Role
As a founding Senior AI Infrastructure Engineer, you will report to the Chief Technology Officer to design and operate large-scale infrastructure for AI workloads on public cloud and on-premises environments. You will be an individual contributor with significant influence, combining software engineering with deep systems expertise to build secure and reliable platforms. Your work will focus on enabling efficient model serving at scale, ensuring the infrastructure can support a massive number of concurrent users while maintaining high service quality and performance.What You’ll Do
Design and manage multi-cloud and on-premises infrastructure for internal and external workloads.Orchestrate large-scale deployments using infrastructure-as-code and container orchestration to support high user concurrency.Benchmark AI inference workloads to identify performance bottlenecks and optimize hardware utilization.Develop and maintain comprehensive monitoring systems to ensure high service quality and reliability.Collaborate with customers to deploy and integrate optimization solutions within their existing infrastructure.Build and maintain an internal laboratory for infrastructure testing and experimentation.What You Bring
5+ years of experience in AI infrastructure or systems engineering.Proficiency in Python and experience building and operating scalable APIs.Extensive experience with Kubernetes, Helm, Ansible, and Terraform.Proven track record of shipping large language model (LLM) serving systems in production environments.Experience with distributed computing frameworks such as Ray, RayClusters, or KubeRay.Demonstrated experience with agentic workflows.Bachelor’s degree in Computer Science or a related technical field.Founding‑engineer equity and direct ownership.Access to extensive compute resources and specialized hardware for experimentation.
#J-18808-Ljbffr
Vacancy posted 53 minutes ago
Similar jobs that could be interesting for youBased on the Ai Infrastructure Engineer in Winnipeg, MB vacancy
  •  ...and resiliency challenges in large-scale AI data center clusters. We are backed by top...  ...looking for a talented Forward Deployed Engineer to be embedded with one of our strategic...  ...for a "builder" who has built and run AI infrastructure at scale, ideally at a neocloud or frontier... 
    Suggested
    Internship
    Manual labor
    Work at office
    Remote work

    Delos Data

    Winnipeg, MB
    49 minutes ago
  • $160k - $180k per year

     ...-effective enterprise-grade cloud infrastructure. Central to this mission is our AI first strategy, as we fully embrace...  ...create. The AI Infrastructure Engineer role is a high-impact, implementation...  ...(EKS) as the orchestration engine. Key ResponsibilitiesYou will bridge... 
    Suggested

    BlueCat

    Winnipeg, MB
    1 hour ago
  •  ...Palona's AI agents operate continuously in production, handle real-time guest interactions...  ...systems, and face sharp traffic peaks. Infrastructure is therefore part of the product: latency...  ...We are looking for an Infrastructure Engineer who combines cloud and reliability depth... 
    Suggested
    Long term contract
    Temporary work
    Internship

    Palona AI

    Winnipeg, MB
    49 minutes ago
  •  ...LLM systems at Relay as a Senior Software Engineer on Voyager, working across exploration,...  ...Voyager creates technology foundations for AI and insights across Relay’s digital...  ...Software Engineer, you will develop reusable infrastructure, evaluate emerging technologies, and support... 
    Suggested

    relayfi

    Winnipeg, MB
    53 minutes ago
  •  ...Required Production experience in SRE / Infrastructure / ops for large-scale systems Strong...  ..., etc.) Familiarity with GPU / AI compute clusters, high-performance data...  ..., Datadog, etc.) Networking & systems engineering knowledge (TCP/IP, DNS, routing, load balancing... 
    Suggested
    Full time

    BULL-IT SOLUTIONS LTD

    Winnipeg, MB
    55 minutes ago
  • Build Azure AI infrastructure with CDKTF and TypeScript or Python for cloud automation, data platforms, and database workloads.This engineer develops and maintains Infrastructure as Code for Azure AI and data services. The work includes reusable CDKTF constructs, automated CI... 

    Astra-North Infoteck Inc.

    Winnipeg, MB
    49 minutes ago
  • Secure and operate AI infrastructure at Terawatt Infrastructure, combining DevOps leadership with cloud reliability, observability, and agentic systems expertise.As a Staff DevOps Engineer, you will own infrastructure supporting Terawatt’s internal tools and AI platform. You... 

    TeraWatt

    Winnipeg, MB
    58 minutes ago
  • Lead on AI initiatives as a Founding AI Engineer at Simple Ventures, focusing on optimizing the design of new businesses and enhancing product quality...  ...CEOs to advance AI applications • Establish reusable infrastructure for AI projects Requirements: • Background in building... 

    Simple Ventures Inc

    Winnipeg, MB
    51 minutes ago
  • Shape Motion’s AI-native product in Montreal using strong programming fundamentals and production systems experience. This...  ...office attendance three or four days weekly.You will engineer the core infrastructure behind Runneth, Motion’s persistent creative strategy agent... 
    Work at office

    Motionapp

    Winnipeg, MB
    50 minutes ago
  • Build robotics data infrastructure at Mecka AI using Python, SQL, and object storage for global embodied AI systems. Own production data and fleet workflows end to end.As a Data Infrastructure Engineer, you will turn synchronized video, robot state, and actions into searchable... 
    Remote work

    Mecka

    Winnipeg, MB
    1 hour ago
  • Build Python and SQL systems for robotics data at Mecka AI, connecting synchronized video, robot state, and actions with searchable datasets.As a Data and Infrastructure Engineer, you will own production systems from robot sites through research and customer delivery. You will... 
    Remote work

    Mecka

    Winnipeg, MB
    1 hour ago
  • usd218k per year

    Who are we?Equinix is the world’s digital infrastructure company®, shortening the path to connectivity to enable the innovations that enrich...  ...years experienceBachelor’s in Computer Science or Computer Engineering The targeted pay range for this position in the following location... 
    Full time
    Work at office

    Equinix

    Winnipeg, MB
    51 minutes ago
  • Network automation specialists can design AI cloud infrastructure from Canada as Staff Network Engineers focused on InfiniBand and Ethernet fabrics.This highly technical Staff Network Engineer role develops software-driven networking for large-scale AI workloads. You will automate... 

    Jobgether

    Winnipeg, MB
    51 minutes ago
  • Shape innovative AI technologies at BlueCat as an AI Infrastructure Engineer. Drive production-quality outcomes for scalable agentic platforms with advanced tools. This essential position on the BlueCat Horizon team prioritizes building a state-of-the-art cloud infrastructure... 

    BlueCat

    Winnipeg, MB
    54 minutes ago
  • $180k - $210k per year

     ...listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Staff Network Engineer (AI Infrastructure) based in Canada. The Staff Network Engineer will design and build the networking automation that powers next-generation... 
    Local area
    Remote work
    Flexible hours

    Jobgether

    Winnipeg, MB
    56 minutes ago
  • $123.3k - $159.5k per year

    # Software Engineer, AI/ML InfrastructureThumbtack123k-160k CADFull-timeremote· seniorCanadagopythonpostgresListed via Jobicy · posted...  ...Imagine what we’ll build together.About the Machine Learning Infrastructure TeamAt Thumbtack, our challenges span a wide range of areas,... 
    Seasonal work
    Local area

    Devconnectplatform

    Winnipeg, MB
    58 minutes ago
  • Cohere is seeking a Software Engineer to build and maintain high-performance data infrastructure essential for AI training workloads. The role involves working on petabyte-scale storage and addressing complex performance challenges. Candidates should have over 4 years of experience... 
    Remote work
    Flexible hours

    Cohere

    Winnipeg, MB
    53 minutes ago
  • Build secure LLM infrastructure at Relay as a Senior Software Engineer, focusing on reusable systems, evaluation, and applied AI engineering.Voyager explores what comes next for Relay while strengthening foundations other teams depend on. You will build AI systems, evaluate... 
    Long term contract

    NorthOne

    Winnipeg, MB
    49 minutes ago
  • Advance high-speed AI inference infrastructure at Cerebras Systems through latency optimization, reliability engineering, and production software.As a Staff Engineer, you will help build the next-generation architecture of a globally distributed inference platform. The Inference... 

    Cerebras

    Winnipeg, MB
    53 minutes ago
  • About the Role We’re seeking a skilled Platform Engineer to deploy and manage AI/ML infrastructure and applications on Kubernetes. You’ll be responsible for building reliable, scalable, and secure deployment pipelines using modern GitOps practices. What You’ll Do Deploy... 

    Astra-North Infoteck Inc.

    Winnipeg, MB
    55 minutes ago
  • MaintainX, a cloud-native infrastructure platform, is seeking a DevOps engineer to join the Infrastructure team within Platform Engineering. You will design and evolve AWS-based infrastructure as code using Terraform and scale multi-region Kubernetes with secure, observable... 

    MaintainX

    Winnipeg, MB
    59 minutes ago
  • Astera Labs is redefining AI infrastructure with Scorpio smart fabric switches, guiding hyperscalers and system builders from evaluation to production deployment. You will lead customer engagements, bring-up, and debug of Scorpio platforms, translating requirements to actions... 

    Astera Labs

    Winnipeg, MB
    59 minutes ago
  • $127k - $225k per year

     ...immediate permanent opening for a Senior Engineer.About the team:Established in 2014, the Distributed Scheduling and Data Engine Lab is Huawei Cloud's technical...  ...native databases, intelligent SQL engine, AI/Agent infrastructure and LLM/Agent Evaluation Technology. The... 
    Permanent employment
    Internship
    Immediate start

    Huawei Canada

    Winnipeg, MB
    51 minutes ago
  •  ...build, and optimize server-side systems and data pipelines powering AI products, with flexible, asynchronous collaboration across global teams. You will work on data pipelines, model-serving infrastructure, and microservices to handle real-world traffic, with emphasis on RESTful... 
    Hourly pay
    Contract work
    Remote work
    Flexible hours

    Alignerr Corp.

    Winnipeg, MB
    51 minutes ago
  • Design AI cloud infrastructure at BMO using Azure, Kubernetes, and secure platform engineering practices for enterprise-scale solutions. Work from 100 King Street West.As a Principal AI & Cloud Engineer, you will build and scale cloud-native AI products across BMO. The work... 

    Bank N.A.

    Winnipeg, MB
    57 minutes ago
  • Engineer resilient cloud-native AI infrastructure in Toronto with Kubernetes, Docker, and infrastructure-as-code practices. Support secure, highly available enterprise services.This Senior Cloud AI Infrastructure Engineer designs and operates platforms enabling teams to build... 

    Scotiabank

    Winnipeg, MB
    56 minutes ago
  • Astra-North Infoteck Inc. in Toronto seeks an experienced Azure Cloud Infrastructure Engineer with AI to design and implement scalable Azure architectures, Landing Zones, and secure environments. 8–10 years of experience required. You will own IaC with Terraform, Pulumi, Bicep... 

    Astra-North Infoteck Inc.

    Winnipeg, MB
    1 hour ago
  • $130k - $165k per year

     ...behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Principal DevOps Engineer (AI/ML Infrastructure) based in CanadaWe are looking for an experienced Principal DevOps Engineer to design, build, and manage the infrastructure... 
    Long term contract
    Full time
    Remote work

    Jobgether

    Winnipeg, MB
    57 minutes ago
  •  ...office Ready to build what powers the next generation of AI? We’re looking for a Staff LLMOps Engineer to lead the design, deployment, and optimization of large language model (LLM) infrastructure on the cloud.You’ll be the driving force behind taking trained... 
    Work at office

    Talent To Hire Inc.

    Winnipeg, MB
    57 minutes ago
  •  ...Cohere is hiring for a role in a security-first enterprise AI setting, focusing on scalable ML infrastructure and agentic systems. You will help build the platform that powers autonomous AI at scale, with focus on secure code execution, state management, and model routing.... 
    Remote work

    Candidate

    Winnipeg, MB
    50 minutes ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Ai Infrastructure Engineer. Be the first to apply!