Data Platform Engineer
Eigen Development
Shift4 (NYSE: FOUR) is boldly redefining commerce by simplifying complex payments ecosystems across the world. As the leader in commerce-enabling technology, Shift4 powers billions of transactions annually for hundreds of thousands of businesses in virtually every industry. For more information, visit
Shift4 is seeking a
Data Platform Engineer
to join our Data Platform team and build, maintain, and optimize the pipelines that move data from our production systems into our analytics warehouse. Today, our infrastructure uses Amazon ECS services and SQS queues to replicate data from Aurora MySQL into Snowflake, with plans to expand to additional data sources and consumers as our platform evolves.
This is a hands‑on infrastructure engineering role focused on pipeline performance, reliability, scalability, resource optimization, cost efficiency, and observability. You will help ensure data is delivered accurately, reliably, and on time as our data platform grows. Data modeling, warehouse cost management, and business transformation logic are managed by partner teams, allowing you to focus on the infrastructure and systems that power our data ecosystem—all while embracing the Shift4 way.
Responsibilities
Operate, tune, and scale the ECS/SQS-based ingestion pipelines from Aurora MySQL into Snowflake: task sizing, autoscaling, consumer concurrency, batching, retries, and dead‑letter handling
Own pipeline reliability: define SLOs for freshness and lag, build alerting and dashboards, lead incident response and root‑cause analysis for pipeline failures
Build and maintain infrastructure as code, deployment automation, and CI/CD for pipeline services
Continuously benchmark and tune throughput versus cost across ECS, SQS, and Snowflake ingestion (Snowpipe/COPY, stages)
Onboard new sources and consumers to the platform in partnership with application, data, and analytics teams
Apply data‑quality and security controls appropriate for PCI‑compliant or payment‑handling environments: encryption, secrets handling, least‑privilege access, audit trails
Proactively explore and apply AI tools to improve efficiency across the pipeline lifecycle (development, testing, runbooks, and documentation)
Qualifications
5+ years in platform, infrastructure, or DevOps roles supporting data‑intensive systems in production
Deep hands‑on AWS experience: ECS/Fargate (task sizing, autoscaling, deployments), SQS (throughput, DLQs, visibility timeouts, batching), S3, IAM, CloudWatch, and Aurora/RDS from the operator side
Proven track record tuning message‑driven workloads: consumer concurrency, backpressure, retries, idempotency, throughput versus cost
Experience operating pipelines into Snowflake from the ingestion side (Snowpipe/COPY, stages, load monitoring)
Infrastructure as code with Terraform/Ansible, containerization with Docker, and CI/CD pipelines
Observability and alerting for pipeline health and lag using Prometheus/Grafana, CloudWatch, Datadog, or the Elastic Stack
Enough Python to read, debug, and instrument worker code
Passion for automation, performance, and clean system design
Nice to have
CDC tooling (Debezium, AWS DMS) and MySQL Binlog replication
Message brokers beyond SQS: Apache Kafka/Confluent, RabbitMQ
Elastic Stack or time‑series database (Prometheus, InfluxDB) administration
Experience in a PCI or otherwise regulated environment
Payments or fintech domain knowledge
We are an Equal Opportunity Employer and do not discriminate against any employee or applicant for employment because of race, color, sex, age, national origin, religion, sexual orientation, gender identity and/or expression, status as a veteran, and basis of disability or any other federal, state or local protected class.
#J-18808-Ljbffr
Shift4 is seeking a
Data Platform Engineer
to join our Data Platform team and build, maintain, and optimize the pipelines that move data from our production systems into our analytics warehouse. Today, our infrastructure uses Amazon ECS services and SQS queues to replicate data from Aurora MySQL into Snowflake, with plans to expand to additional data sources and consumers as our platform evolves.
This is a hands‑on infrastructure engineering role focused on pipeline performance, reliability, scalability, resource optimization, cost efficiency, and observability. You will help ensure data is delivered accurately, reliably, and on time as our data platform grows. Data modeling, warehouse cost management, and business transformation logic are managed by partner teams, allowing you to focus on the infrastructure and systems that power our data ecosystem—all while embracing the Shift4 way.
Responsibilities
Operate, tune, and scale the ECS/SQS-based ingestion pipelines from Aurora MySQL into Snowflake: task sizing, autoscaling, consumer concurrency, batching, retries, and dead‑letter handling
Own pipeline reliability: define SLOs for freshness and lag, build alerting and dashboards, lead incident response and root‑cause analysis for pipeline failures
Build and maintain infrastructure as code, deployment automation, and CI/CD for pipeline services
Continuously benchmark and tune throughput versus cost across ECS, SQS, and Snowflake ingestion (Snowpipe/COPY, stages)
Onboard new sources and consumers to the platform in partnership with application, data, and analytics teams
Apply data‑quality and security controls appropriate for PCI‑compliant or payment‑handling environments: encryption, secrets handling, least‑privilege access, audit trails
Proactively explore and apply AI tools to improve efficiency across the pipeline lifecycle (development, testing, runbooks, and documentation)
Qualifications
5+ years in platform, infrastructure, or DevOps roles supporting data‑intensive systems in production
Deep hands‑on AWS experience: ECS/Fargate (task sizing, autoscaling, deployments), SQS (throughput, DLQs, visibility timeouts, batching), S3, IAM, CloudWatch, and Aurora/RDS from the operator side
Proven track record tuning message‑driven workloads: consumer concurrency, backpressure, retries, idempotency, throughput versus cost
Experience operating pipelines into Snowflake from the ingestion side (Snowpipe/COPY, stages, load monitoring)
Infrastructure as code with Terraform/Ansible, containerization with Docker, and CI/CD pipelines
Observability and alerting for pipeline health and lag using Prometheus/Grafana, CloudWatch, Datadog, or the Elastic Stack
Enough Python to read, debug, and instrument worker code
Passion for automation, performance, and clean system design
Nice to have
CDC tooling (Debezium, AWS DMS) and MySQL Binlog replication
Message brokers beyond SQS: Apache Kafka/Confluent, RabbitMQ
Elastic Stack or time‑series database (Prometheus, InfluxDB) administration
Experience in a PCI or otherwise regulated environment
Payments or fintech domain knowledge
We are an Equal Opportunity Employer and do not discriminate against any employee or applicant for employment because of race, color, sex, age, national origin, religion, sexual orientation, gender identity and/or expression, status as a veteran, and basis of disability or any other federal, state or local protected class.
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Data Platform Engineer in Winnipeg, MB vacancy
- Job Title: Data Platform EngineerLocation: Edmonton, Alberta (Hybrid)Type: Permanent Full-Time All applicants must be legally entitled... ...Edmonton-based client is seeking an experienced Data Platform Engineer to build, operate, and support a modern enterprise data...SuggestedPermanent employmentFull time
- ...the ASICS Runkeeper app), and other exciting platforms that will help us better serve the endurance... ...Overview We are building our enterprise data platform from the ground up, and we are looking for a Senior Data Platform Engineer to partner directly with our Data Architect...SuggestedWork at officeLocal areaRemote work
- We are looking for a hands-on engineer who is equally comfortable building client data pipelines and writing production code for our own product.You will split your... ..., you will help build Finaptive's Data Integrations Platform, our cloud-based integration and automation platform...Suggested
- As a Data Platform Engineer working in the Data Solutions group, you will play a key role in extending the capabilities, and improving the efficiency of our data platform. You will collaborate on the design and development of tooling and custom applications, evaluate the suitability...SuggestedSummer workFlexible hours
- Job TitleData Platform Engineer LocationToronto, Canada Job TypeContract Reports ToDirector Data and AI, Embedded Finance Job OverviewThe primary focus of this role will... ...tables to support day‑end processing engines that run natively within the Snowflake compute...SuggestedContract workLocal area
- ...Build and operate the data pipelines, warehouses, and transformation layers that form the analytical and operational data foundations for enterprise clients. Quix is looking for a Data Platform Engineer to design and maintain the data infrastructure that enterprise analytics...Contract work
$93.5k - $108.5k per year
The Data Platform Engineer is a hands‑on, mid‑level role responsible for building, maintaining, and enhancing 360insights' Microsoft Fabric data platform. Reporting to the Head of Data Platform, this position contributes to the delivery of reliable, scalable analytics solutions...Worldwide- Cloud Data Platform Engineer (AWS and Azure) Role: Cloud Data Platform Engineer (AWS and Azure) Total Experience: 6–10 Years Role Description Involve developing serverless functions (Lambda/Azure Functions), managing API integrations, and containerization. Typical...
- ...Permanent Full Time Are you a Senior Data Platform Engineer professional focused on platform administration, operations and support, have strong Leadership and Communication skills who is looking for a challenging and rewarding opportunity? The Canada Data Team is looking...Permanent employmentFull timeImmediate start
- We are seeking a visionary and highly technical Senior Data Platform Engineer to architect, implement, scale, and maintain the data engine powering our next-generation frontier models. In this high-impact role, you will bridge the gap between cutting-edge AI research and...
$85.2k - $135.2k per year
Permanent Full Time Are you a Senior Data Platform Engineer professional focused on platform administration, operations and support, have strong Leadership and Communication skills who is looking for a challenging and rewarding opportunity?The Canada Data Team is looking...Permanent employmentFull timeWork at officeImmediate startFlexible hours3 days per week- Shape Jobber’s data platform through scalable pipelines, AWS expertise, and technical leadership across teams. This is a strategic, hands-on engineering role.As a Staff Data Engineer on Jobber’s Data Platform Team, you will shape data integration architecture and delivery....
- ...working with billions of events, petabytes of data, and optimizing for the last millisecond... ...read on! We are looking for a Senior Data Engineer who has seen their fair share of messy... ...Responsibilities Work directly with the Platform Engineering Team to create reusable experimental...Part timeWork at officeFlexible hours
- Join Bally’s Intralot as a Data Cloud Platform Engineer (DBA) - AWS Infrastructure At Bally’s Intralot, we shape the future of gaming through innovation... ...(MySQL/PostgreSQL), self-managed DBs on EC2. Database Engines: MySQL, PostgreSQL, Oracle, SQL Server (one or more)....Worldwide
- Shape Jobber’s data platform through scalable pipelines, technical leadership, and hands-on engineering across batch and real-time systems.As a Staff Data Engineer on the Data Platform Team, you will shape foundational data components and guide engineering excellence. You will...
- Engineer CARFAX data platforms in London, Ontario, using scalable pipelines, cloud systems, and robust software for automotive trust.As a Software Engineer within Data Technologies, you will build systems handling millions of records across enrichment pipelines, vehicle platforms...
- Design scalable data warehouses and ETL pipelines for Reflow, a workforce and workflow intelligence platform. Part-time or full-time arrangements are available.As a data platform engineer, you will build systems supporting analytics, workflow insights, and economic modeling...Full timePart time
- ...this job. Posted 19 Oct 2026.About this job Overview of the FunctionWe are seeking an experienced and forward-thinking Senior Data Platform Engineer to manage, optimize, and evolve the cloud-native platforms used by the Data Office. The role combines deep data engineering...Manual laborWork at officeLocal area
- ...applications and next steps. Our partner is looking for a Senior Data Platform Engineer based in Canada. The Senior Data Platform Engineer will play... ...data platform infrastructure, including distributed query engines, lakehouse storage, orchestration systems, and streaming pipelines...Remote workHome office
- ...and responsibilitiesWe are looking for an experiencedData Engineer to strengthen our Data & AI capabilities within ABB Motion Drive Products and High... ...data solutions, with Snowflake as our primary data platform. You will work across the data engineering lifecycle, from...Work at officeLocal area
- Senior Data Platform EngineerJoin to apply for the Senior Data Platform Engineer role at Gravity. Get AI-powered advice on this job and more exclusive features. About GravityGravity is the platform public agencies use to manage budgeting, automate financial reporting,...Long term contractFull time
- Build reliable data platforms with Python and SQL at Function Health, working remotely from Canada on infrastructure for AI-powered healthcare.As a Staff Software Engineer, you will shape Function Health’s data platform infrastructure. Your work will support reliable contracts...Local areaRemote work
- Build Clutch’s data platform in hybrid Downtown Toronto, using advanced SQL, Python, Snowflake, dbt, and Airflow to power decisions.As a Senior Data Engineer, you’ll own architecture, pipelines, models, and infrastructure supporting vehicle pricing, customer funnels, delivery...
$125k - $150k per year
...growing network of treatment centres, pharmacies and related healthcare services across Canada. CATC is is seeking a Manager, Data Engineering & Platforms to lead the development, operation and continuous improvement of CATC's enterprise data platform.Reporting to the Director...Long term contractPermanent employmentFull timeInternshipRemote workFlexible hours- Design scalable data platforms with advanced SQL and Python as a Senior Data Engineer supporting analytics, AI-enabled experiences, and decision-making. Own production pipelines end-to-end.This senior role owns significant data platform components, including dbt transformations...
- ...is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Data Engineer – Data Platform based in Canada.As a Senior Data Engineer – Data Platform, you will play a key role in developing and operating a modern,...Contract workFixed term contractImmediate startRemote workWorldwide
- ...is partnered with a high-growth product company building the data platform behind a modern telematics API, supporting real-time ingestion... ...at petabyte scale. The RoleThis is not a traditional data engineering seat; you will own the long-term buildout of the data platform...Long term contract
- Elevate your engineering skills at Finaptive as a Data Platform Engineer. You will create data pipelines and APIs in Python and Flask while working on both client integrations and our proprietary platform. As a hands-on engineer with Finaptive, you'll balance between client...
$200k - $255k per year
...TerminalTerminal builds telematics data infrastructure for the... ...Intact Insurance, depend on our platform to access GPS, speeding, and vehicle... ...the roleWe're looking for an engineer who thrives on building... ...Orchestration and workflow engines (Temporal, Step Functions)....InternshipWork at officeFlexible hours- Own assigned data assets and improve platform reliability at 360insights through cloud data engineering, pipeline operations, and AI-supported development practices. Work from Whitby, Canada.The hands-on, mid-level Data Platform Engineer builds, maintains, and enhances 360insights...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Platform Engineer. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
- junior data engineer Winnipeg, MB

