Data Platform Engineer
Shift4
Shift4 is seeking a Data Platform Engineer to join our Data Platform team and build, maintain, and optimize the pipelines that move data from our production systems into our analytics warehouse.Today, our infrastructure uses Amazon ECS services and SQS queues to replicate data from Aurora MySQL into Snowflake, with plans to expand to additional data sources and consumers as our platform evolvesThis is a hands‑on infrastructure engineering role focused on pipeline performance, reliability, scalability, resource optimization, cost efficiency, and observability.You will help ensure data is delivered accurately, reliably, and on time as our data platform grows.Data modeling, warehouse cost management, and business transformation logic are managed by partner teams, allowing you to focus on the infrastructure and systems that power our data ecosystem—all while embracing the Shift4 wayOperate, tune, and scale the ECS/SQS‑based ingestion pipelines from Aurora MySQL into Snowflake: task sizing, autoscaling, consumer concurrency, batching, retries, and dead‑letter handlingOwn pipeline reliability: define SLOs for freshness and lag, build alerting and dashboards, lead incident response and root‑cause analysis for pipeline failuresBuild and maintain infrastructure as code, deployment automation, and CI/CD for pipeline servicesContinuously benchmark and tune throughput versus cost across ECS, SQS, and Snowflake ingestion (Snowpipe/COPY, stages)Onboard new sources and consumers to the platform in partnership with application, data, and analytics teamsApply data‑quality and security controls appropriate for PCI‑compliant or payment‑handling environments: encryption, secrets handling, least‑privilege access, audit trailsProactively explore and apply AI tools to improve efficiency across the pipeline lifecycle (development, testing, runbooks, and documentation)Benefits
Wellness programs, including mental health resourcesOpportunities for career growth, skill-building, and advancementHappy hours, office celebrations, and well‑being initiativesPaid time off for relaxation and quality time with loved onesFlexible work schedules empower you to manage your commitments effectivelyVarious paid leave programs, including sick leave, parental leave, and more to support life’s important momentsEmployee‑nominated “Top Gun Program” to recognize exceptional individualsObservability and alerting for pipeline health and lag using Prometheus/Grafana, CloudWatch, Datadog, or the Elastic StackPassion for automation, performance, and clean system designDeep hands‑on AWS experience: ECS/Fargate (task sizing, autoscaling, deployments), SQS (throughput, DLQs, visibility timeouts, batching), S3, IAM, CloudWatch, and Aurora/RDS from the operator side5+ years in platform, infrastructure, or DevOps roles supporting data‑intensive systems in productionExperience operating pipelines into Snowflake from the ingestion side (Snowpipe/COPY, stages, load monitoring)Enough Python to read, debug, and instrument worker codeProven track record tuning message‑driven workloads: consumer concurrency, backpressure, retries, idempotency, throughput versus costInfrastructure as code with Terraform/Ansible, containerization with Docker, and CI/CD pipelinesCDC tooling (Debezium, AWS DMS) and MySQL Binlog replicationElastic Stack or time‑series database (Prometheus, InfluxDB) administrationMessage brokers beyond SQS: Apache Kafka/Confluent, RabbitMQExperience in a PCI or otherwise regulated environmentPayments or fintech domain knowledge
#J-18808-Ljbffr
Wellness programs, including mental health resourcesOpportunities for career growth, skill-building, and advancementHappy hours, office celebrations, and well‑being initiativesPaid time off for relaxation and quality time with loved onesFlexible work schedules empower you to manage your commitments effectivelyVarious paid leave programs, including sick leave, parental leave, and more to support life’s important momentsEmployee‑nominated “Top Gun Program” to recognize exceptional individualsObservability and alerting for pipeline health and lag using Prometheus/Grafana, CloudWatch, Datadog, or the Elastic StackPassion for automation, performance, and clean system designDeep hands‑on AWS experience: ECS/Fargate (task sizing, autoscaling, deployments), SQS (throughput, DLQs, visibility timeouts, batching), S3, IAM, CloudWatch, and Aurora/RDS from the operator side5+ years in platform, infrastructure, or DevOps roles supporting data‑intensive systems in productionExperience operating pipelines into Snowflake from the ingestion side (Snowpipe/COPY, stages, load monitoring)Enough Python to read, debug, and instrument worker codeProven track record tuning message‑driven workloads: consumer concurrency, backpressure, retries, idempotency, throughput versus costInfrastructure as code with Terraform/Ansible, containerization with Docker, and CI/CD pipelinesCDC tooling (Debezium, AWS DMS) and MySQL Binlog replicationElastic Stack or time‑series database (Prometheus, InfluxDB) administrationMessage brokers beyond SQS: Apache Kafka/Confluent, RabbitMQExperience in a PCI or otherwise regulated environmentPayments or fintech domain knowledge
#J-18808-Ljbffr
Vacancy posted 21 minutes ago
Similar jobs that could be interesting for youBased on the Data Platform Engineer in Winnipeg, MB vacancy
- Cloud Data Platform Engineer (AWS and Azure) Role: Cloud Data Platform Engineer (AWS and Azure) Total Experience: 6–10 Years Role Description Involve developing serverless functions (Lambda/Azure Functions), managing API integrations, and containerization. Typical...Suggested
- ...working with billions of events, petabytes of data, and optimizing for the last millisecond... ...read on! We are looking for a Senior Data Engineer who has seen their fair share of messy... ...Responsibilities Work directly with the Platform Engineering Team to create reusable experimental...SuggestedPart timeWork at officeFlexible hours
- Design scalable data warehouses and ETL pipelines for Reflow, a workforce and workflow intelligence platform. Part-time or full-time arrangements are available.As a data platform engineer, you will build systems supporting analytics, workflow insights, and economic modeling...SuggestedFull timePart time
- We are seeking a visionary and highly technical Senior Data Platform Engineer to architect, implement, scale, and maintain the data engine powering our next-generation frontier models. In this high-impact role, you will bridge the gap between cutting-edge AI research and...Suggested
- ...this job. Posted 19 Oct 2026.About this job Overview of the FunctionWe are seeking an experienced and forward-thinking Senior Data Platform Engineer to manage, optimize, and evolve the cloud-native platforms used by the Data Office. The role combines deep data engineering...SuggestedManual laborWork at officeLocal area
- ...and responsibilitiesWe are looking for an experiencedData Engineer to strengthen our Data & AI capabilities within ABB Motion Drive Products and High... ...data solutions, with Snowflake as our primary data platform. You will work across the data engineering lifecycle, from...Work at officeLocal area
$85k - $90k per year
...Description Design and maintain scalable data pipelines that collect, transform and... ...Degree or Diploma in Computer Science, Data Engineering, Information Systems, or related field.... ...Opportunity to work with modern Azure data platforms and cloud-based engineering technologies....Permanent employment
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Platform Engineer. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- junior data engineer Winnipeg, MB
- data centre engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB

