Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal DevOps Engineer (AI/ML Infrastructure)

Full-time

Jobgether

This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Principal DevOps Engineer (AI/ML Infrastructure) based in Canada We are looking for an experienced Principal DevOps Engineer to design, build, and manage the infrastructure powering advanced AI and machine learning capabilities within a modern SaaS platform. In this senior technical role, you will drive the development of scalable, secure, and reliable AI/ML environments, supporting the entire lifecycle from experimentation and data ingestion to model deployment and production monitoring. You will work closely with AI researchers, software engineers, and cross-functional R&D teams to bridge the gap between research and production-ready solutions. Your expertise will help optimize infrastructure performance, automate complex workflows, and accelerate AI innovation. You will also serve as a technical leader and mentor, promoting engineering best practices and driving continuous improvement. This is an opportunity to contribute to impactful scientific software solutions within an international, innovation-driven environment. Accountabilities - Architect, design, and lead the implementation of scalable, secure, resilient, and high-performance infrastructure to support demanding AI and machine learning workloads. - Build, maintain, and optimize specialized CI/CD pipelines for AI/ML applications, covering the complete lifecycle from data ingestion and model development to deployment, serving, and monitoring. - Design and manage cloud-based AI/ML infrastructure, leveraging containerization, orchestration, and platform engineering technologies to ensure scalability and operational efficiency. - Drive automation across infrastructure provisioning, model deployment, testing, and operational workflows to improve reliability, consistency, and development speed. - Collaborate closely with AI researchers, data scientists, and software engineers to streamline experimentation processes and translate machine learning models into reliable production applications.

- Ensure the security, availability, reliability, and performance of AI/ML systems through effective infrastructure management, monitoring, and continuous optimization. - Act as a technical subject matter expert, mentoring junior engineers and promoting best practices in AI/ML platform development, source control, automation, and deployment. - Identify emerging technologies, tools, and industry trends, evaluating innovative solutions that can strengthen infrastructure capabilities and accelerate AI/ML development. Requirements: - At least 5 years of professional experience in DevOps, machine learning infrastructure, or platform engineering, including several years in a senior technical or leadership capacity. - At least 5 years of advanced experience with one or more major cloud platforms, such as AWS, Microsoft Azure, or Google Cloud Platform (GCP), including their AI/ML and containerization services. - Minimum 5 years of hands-on experience with machine learning orchestration and platform technologies such as Kubeflow, MLflow, or Amazon SageMaker. - Approximately 5–8+ years of strong expertise in Docker and Kubernetes, particularly for deploying, managing, and scaling AI/ML workloads. - Approximately 5–8+ years of programming experience with languages such as Python, Go, or Bash, with a strong focus on scripting and infrastructure automation. - Experience with infrastructure-as-code and configuration management tools such as Terraform or Ansible. - Demonstrated ability to design and implement reliable automated CI/CD pipelines using tools such as GitHub Actions, GitLab CI/CD, or Jenkins. - Strong understanding of DevOps principles, cloud infrastructure, container orchestration, automation, scalability, and security best practices.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Principal DevOps Engineer (AI/ML Infrastructure) in Remote vacancy
  •  ...position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Principal AI/ML Engineer based in British Columbia, Canada. The Principal AI/ML Engineer will provide senior technical leadership in the design and development... 
    Suggested
    Full time
    Remote work

    Jobgether

    Remote
    2 days ago
  • usd123.3k - usd159.5k per year

     ...from personalized guidance to AI tools and a best-in-class hiring...  ...About the Machine Learning Infrastructure Team At Thumbtack, our challenges...  ...detection, and more. The ML Infrastructure team is responsible...  .... We empower product engineering teams by providing scalable, high... 
    Suggested
    Full time
    Seasonal work
    Local area

    Thumbtack

    Remote
    1 day ago
  • $200k - $250k per year

     ...portfolio companies, focused on developing AI/ML systems and data platforms that unlock new value from data. The AI/ML Engineer will lead and contribute directly to projects...  ...product capabilities, and scalable data infrastructure. This person will work closely with operating... 
    Suggested

    ASG Technologies

    Remote
    12 days ago
  •  ...Design and build AI systems for advanced mathematical reasoning workflows. About Turing...  ...opportunity to blend practical software engineering with AI research. About the Role:...  ...Domain Experience: Background building AI/ML applications within STEM domains (Mathematics... 
    Suggested
    Contract work
    Part time
    For contractors
    Freelance
    Remote work

    Turing

    Remote
    4 days ago
  •  ...mission, and we pursue it with the help of our most strategic asset: our people. To support our customer, we are looking for a: AI/ML ENGINEER - Senior TASKS: Develop and deploy AI/ML solutions, including machine learning models, Generative AI, LLMs, NLP systems,... 
    Suggested
    Full time
    Work at office
    Worldwide

    Fincons Group

    Remote
    6 days ago
  •  ...Prior paid experience training, evaluating, benchmarking, or improving AI systems. Strong practical proficiency with Python. Hands-on...  ..., JAX, TensorFlow, scikit-learn, XGBoost, LightGBM, or comparable ML tools. Public Proof of Skill Strong applicants should provide... 
    Part time
    Immediate start

    micro1

    Remote
    6 days ago
  • $180k - $200k per year

     ...transforms the way government uses data and technology. To support this mission, we are seeking an Artificial Intelligence (AI)/Machine Learning (ML) Engineer to support Condition-Based Maintenance Plus (CBM+) initiatives that improve aircraft sustainment and optimize... 
    Full time
    Contract work
    Work at office

    Redhorse Corporation

    Remote
    13 days ago
  • usd250k per year

     ...how our team works: we embrace AI as a core productivity multiplier...  ...are looking for a Distinguished Engineer to lead technical direction across GitLab's Core DevOps services, the systems the majority...  ...in each. Partner with Infrastructure, Security, and SRE so Core DevOps... 
    Full time
    Remote work
    Shift work

    GitLab

    Remote
    5 days ago
  •  ...Search. All services are deeply integrated and designed for growth. About the Role We’re looking for a Software Engineer, AI Tooling Infrastructure to join our AI Tooling team and help build and run the backend services behind Supabase’s AI products. The Supabase MCP... 
    Remote work
    Flexible hours

    Supabase

    Remote
    9 days ago
  •  ...listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Software Engineer – AI Tooling Infrastructure based in Canada. We are looking for an experienced Software Engineer to build, operate, and scale the backend... 
    Long term contract
    Full time

    Jobgether

    Remote
    13 days ago
  •  ...Build and operate production backend services for Supabase’s AI products, including deployment, scaling, configuration, and releases...  ...with Platform and SRE teams on shared code, releases, infrastructure, alerting, and incident practices. Contribute to AI Tooling code... 
    Full time
    Remote work
    Flexible hours

    Supabase

    Remote
    13 days ago
  •  ...listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Staff Network Engineer (AI Infrastructure) based in Canada. The Staff Network Engineer will design and build the networking automation that powers next-generation AI... 
    Full time

    Jobgether

    Remote
    11 days ago
  •  ...and let us get to know you. G2i works with top AI labs and fast-growing companies. Our community of engineers works on real projects, from evals and RL...  ...Who we’re looking for Software, data, AI/ML, infrastructure, security, design, QA and product. Experienced or... 
    Full time
    Immediate start

    G2i

    Remote
    20 days ago
  • $96k - $192k per year

     ...Our partner is looking for a Software Engineer – DevOps based in Canada . Join a globally distributed...  ...team building and operating critical infrastructure for a regulated digital asset...  ...financial transactions. - Ability to use AI-assisted development tools thoughtfully... 
    Full time
    Rotating shift

    Jobgether

    Remote
    3 days ago
  •  ...end Trainium training pipelines. Tune distributed training runs for throughput and cost on SageMaker infrastructure. Work directly with client and internal engineering teams to deliver production training workloads. Requirements Strong hands-on PyTorch experience,... 
    Full time

    Robots and Pencils

    Remote
    11 days ago
  •  ...and optimize cloud costs - Build tooling to accelerate perception engineers' workflows - fast data access, reproducible experiments,...  ...working knowledge of ROS2 - Working knowledge of docker and other DevOps tools - Familiarity with cloud storage and compute (AWS - S3, EC2... 
    Full time

    AeroVect

    Remote
    3 days ago
  • $150 per hour

     ...professional experience Demonstrated expertise in Software Engineering How long hiring takes Across the AI training platforms we refer candidates to, the median...  ...~80% Why this role At $150/hr, this Senior AI/ML Engineer Expert position compensates Software... 
    Hourly pay
    Remote work

    Ethos

    Remote
    a month ago
  •  ...modern and globally accessible financial infrastructure platforms in the industry, built to...  ...similar) ~3+ years of professional software engineering experience with a functional or strongly...  ...that moves money ~ Good judgment with AI tools. You use them to work faster, and... 
    Full time
    Local area
    Worldwide
    Shift work

    Kraken

    Remote
    2 days ago
  • $180k - $220k per year

     ...Xello is looking for a Principal Engineer Please note that this is a remote role open to candidates...  ...leaders to lead the evolution of AI in the development lifecycle, establishing...  ...CI/CD) processes in partnership with our DevOps team, ensuring our software solutions are... 
    Long term contract
    Full time
    Remote work
    Flexible hours

    Xello

    Remote
    2 days ago
  •  ...partner is looking for a Senior Azure Infrastructure Engineer based in Canada. The Senior Azure Infrastructure...  .... Working under the direction of a Principal Azure Architect, you will lead complex...  ..., Kubernetes, Infrastructure as Code, DevOps automation, data services, and emerging... 
    Full time

    Jobgether

    Remote
    13 days ago
  •  ...deliver next-generation products for clients in emerging technology markets. Position Overview We are seeking a Solutions Architect, AI/ML that will have a critical role in understanding technical project requirements, for existing and potential clients, to assess whether... 
    Full time

    Fidus Systems

    Remote
    19 days ago
  •  ...advantage. Cresta’s unified AI platform combines conversational...  ...role: As a member of the infrastructure team you are responsible for...  ...infrastructure that allows the engineering team to execute quickly,...  ...for: ~5+ years experience in DevOps, Site Reliability Engineering... 
    Work at office
    Local area
    Remote work
    Work from home
    Home office

    Cresta

    Remote
    5 days ago
  •  ...the world’s fastest-growing AI companies accelerating the advancement...  ...to blend practical software engineering with AI research. About...  ...seeking a highly skilled AWS DevOps Engineer to join our team....  ...with AWS technologies, infrastructure automation, and continuous delivery... 
    Contract work
    Part time
    For contractors
    Freelance
    Remote work

    Turing

    Remote
    4 days ago
  •  ...currently looking for a dedicated Lead AI Aplication Engineer to join one of our clients' teams ....  ...tenant AI Platform that supports the full ML lifecycle across cloud and on-premises...  ...vendor lock-in. 3. Manage AI Data Infrastructure Own the deployment and scaling of Vector... 

    TechBiz Global GmbH

    Remote
    a month ago
  •  ...committed to embracing diversity of thought and experience within our team. We are looking for a DevOps Engineer to join our team and help build, scale, and maintain the infrastructure that powers our mission-critical public safety platform. In this role, you will focus on... 
    Long term contract
    Full time
    Work visa

    Mark43

    Remote
    25 days ago
  •  ...number one worldwide. Why this role matters Adapty runs on infrastructure we own and operate ourselves: a Proxmox and Ceph platform...  ...subscription volume a year, and today too much of it depends on a single engineer. You are joining to take that platform over: fully owned,... 
    Full time
    Remote work
    Worldwide
    Flexible hours

    Adapty.io

    Remote
    11 days ago
  •  ...leading security-first enterprise AI company. We build cutting-edge...  ...is a team of researchers, engineers, designers, and more, who are...  ...Join us! Why this team? Internal Infrastructure builds the infrastructure and...  ...work with AI researchers and ML engineers on stability, scalability... 
    Full time
    Work at office
    Local area
    Remote work

    Cohere

    Remote
    6 days ago
  •  ...next steps. Our partner is looking for an Applied ML Engineer – Model R&D based in Canada. We are looking for a...  ...also support the evolution toward Rust-based infrastructure and work on technology at the intersection of AI, machine learning, and financial markets. This is... 
    Remote work

    Jobgether

    Remote
    3 days ago
  •  ...und Webanwendungen Konfiguration von DevOps-Pipelines mit Fokus auf Continuous...  ...Integration und produktiver Einsatz von AI-assisted Engineering zur Unterstützung von Entwicklungs- und...  ...Berufserfahrung im Bereich DevOps, Infrastructure Automation, Configuration Management oder... 
    Permanent employment
    Full time
    Remote work
    Flexible hours

    HyPlus Technology GmbH

    Remote
    11 days ago
  •  ...While most platforms chase volume, JobGet is laying the foundation for a new kind of hiring infrastructure focused on precision, speed, and real outcomes. Our AI-powered engine learns, adapts, and improves continuously. Employers don’t just get candidates, they get hires.... 
    Hourly pay
    Long term contract
    Full time
    Remote work
    Flexible hours

    JobGet

    Remote
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal DevOps Engineer (AI/ML Infrastructure). Be the first to apply!