Cloud Platform DevOps Engineer - Assistant Vice President

We are seeking an experienced (5+ years), motivated, and hands‑on Cloud Platform DevOps Engineer to join our North American AI and DevOps Platform Engineering team. In this critical role, you will be responsible for enhancing the stability, reliability, and performance of our AI and DevOps platforms, which support a diverse ecosystem of AI applications, developer tools, and CI/CD pipeline technologies across the organization. You will actively contribute to infrastructure design, implementation, and maintenance, and facilitate agile development within the team. The ideal candidate is a strong technical leader who champions agile practices, drives continuous improvement, and excels in both coding and coaching, possessing a deep understanding of infrastructure and operational considerations for Artificial Intelligence and Machine Learning initiatives, with proven hands‑on experience in DevOps tools and technologies such as Kubernetes, Docker, HELM, Ansible, and similar CI/CD platforms, and proficiency in scripting and automation (e.g., Python, Bash). We are looking for someone with a track record of implementing scalable, resilient, and high‑performance solutions, coupled with strong communication and collaboration skills, and an ability to mentor and guide junior team members, as you join a dynamic team committed to fostering innovation and collaboration.

Responsibilities

• Design & Implementation: lead the design, implementation, and ongoing management of secure, scalable, and resilient infrastructure components.
• Secret & Certificate Management: administer and maintain secret and certificate management solutions using HashiCorp Vault, including policy definition and integration.
• Database Management: perform hands‑on administration and optimization of database systems (PostgreSQL, Oracle, MongoDB), including performance tuning, backup, and recovery strategies.
• Workflow Orchestration: deploy, monitor, and troubleshoot data orchestration workflows using Apache Airflow, and develop/optimise DAGs.
• Messaging Systems: implement and manage messaging queues such as Kafka and IBM MQ, including cluster setup and configuration.
• API Integrations: develop, maintain, and troubleshoot RESTful API and SOAP integrations critical for system connectivity.
• Build Automation: implement and optimise build and deployment processes using Gradle.
• Container Orchestration: design, implement, and manage container orchestration platforms with Kubernetes and Helm, including integration with CyberArk and HashiCorp for secrets management. Create, debug, and troubleshoot Kubernetes PODs, Jobs, and Deployments using YAML.
• Storage Management: configure and manage persistent storage solutions including PVC, SONiC NAS, and S3, with an awareness of storage requirements for AI/ML workloads.
• Networking & Load Balancing: set up and maintain load balancing solutions (e.g., Nginx, HAProxy, AWS ELB/ALB, Kubernetes Ingress) for high availability and performance.
• Monitoring & Logging: implement, configure, and utilise comprehensive monitoring and logging solutions (Prometheus, Grafana, ELK Stack) to ensure system health and proactively identify issues, including those relevant to AI/ML applications.
• Automation & Scripting: develop robust automation scripts and tools using Python, Bash, Go, or similar languages to streamline operations and enhance efficiency.
• Incident Response: participate actively in on‑call rotations, responding to and resolving critical incidents with hands‑on troubleshooting.
• Documentation: create and maintain technical documentation, architecture diagrams, and runbooks for infrastructure components and processes.

Impediment Resolution

• Impediment Resolution: proactively identify and resolve technical impediments and process bottlenecks within the team and across organisational boundaries, paying special attention to unique challenges posed by AI/ML infrastructure.

Backlog Refinement

• Backlog Refinement: collaborate closely with stakeholders (e.g., product owners, technical leads) to ensure a well‑defined and prioritised backlog for infrastructure work, technical debt, operational improvements, and AI/ML platform needs.

Process Improvement

• Process Improvement: drive continuous improvement in the team’s agile and DevOps practices, helping them adapt and optimise their workflow for maximum efficiency and quality.

Required Qualifications

• Secret & Certificate Management: proven hands‑on experience with HashiCorp Vault (installation, configuration, policy management, integrations).
• Database Administration: strong hands‑on experience with at least two of PostgreSQL, Oracle, or MongoDB (installation, tuning, replication, backup/restore).
• Workflow Orchestration: hands‑on experience deploying, managing, and developing DAGs for Apache Airflow.
• Messaging Systems: solid hands‑on experience with Kafka and/or IBM MQ (cluster setup, topic management, producer/consumer configuration).
• Container Orchestration: in‑depth hands‑on experience with Kubernetes and Helm, including YAML configuration, troubleshooting PODs/Jobs/Deployments, and integrations with secrets management (CyberArk, HashiCorp).
• Storage Management: practical experience with Kubernetes PVCs, Persistent Volumes, S3, and/or enterprise NAS solutions (e.g., SONiC NAS).
• Monitoring & Logging: strong hands‑on experience with Prometheus, Grafana, and the ELK Stack (setup, dashboard creation, query optimisation, alert configuration).
• Scripting & Automation: high proficiency in Python, Bash, or Go for automation, tooling development, and system administration.
• Cloud Platforms: extensive hands‑on experience with at least one major cloud provider (AWS, Azure, GCP).
• Infrastructure as Code (IaC): proficiency with IaC tools such as Terraform or Ansible.
• CI/CD: experience designing, implementing, and maintaining CI/CD pipelines (e.g., Jenkins, GitLab CI, GitHub Actions).
• API Integration: experience with RESTful API and SOAP web services.
• Build Tools: proficiency with Gradle for build automation.

AI/ML Awareness & Support

• AI/ML Infrastructure Concepts: understanding of the specific infrastructure requirements for deploying, managing, and scaling Artificial Intelligence and Machine Learning workloads (e.g., GPU resources, specialised storage, MLOps pipelines).
• Data for AI/ML: awareness of data management strategies and data governance principles relevant to AI/ML models and training datasets.
• Monitoring AI/ML Systems: familiarity with metrics and monitoring approaches for the performance and health of AI/ML applications and their underlying infrastructure.

Agile & Leadership Skills

• Working Scrum Master Experience: proven experience acting as a Scrum Master within a technical team where you also performed significant hands‑on engineering.
• Agile & Scrum Mastery: in‑depth knowledge and practical application of Agile principles and the Scrum framework.
• Facilitation & Coaching: excellent facilitation, coaching, and mentoring skills within a technical context.
• Communication: strong verbal and written communication skills, able to bridge technical and process discussions.
• Technical Leadership: ability to guide technical discussions, influence architectural decisions, and drive best practices.

Preferred Qualifications

• Certified ScrumMaster (CSM) or Professional Scrum Master (PSM) certification.
• Relevant cloud certifications (e.g., AWS Certified DevOps Engineer, Azure DevOps Engineer Expert, GCP Professional Cloud DevOps Engineer).
• Experience with site reliability engineering (SRE) principles and practices.
• Familiarity with other Agile scaling frameworks (e.g., SAFe, LeSS).
• Exposure to MLOps platforms or tools (e.g., Kubeflow, MLflow).

Education

• Bachelor's or Master's degree in computer science, Engineering, or a related technical field or equivalent experience.

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity, review Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.