Data Platform Engineer
Eigen Development
Shift4 (NYSE: FOUR) is boldly redefining commerce by simplifying complex payments ecosystems across the world. As the leader in commerce-enabling technology, Shift4 powers billions of transactions annually for hundreds of thousands of businesses in virtually every industry. For more information, visit
Shift4 is seeking a
Data Platform Engineer
to join our Data Platform team and build, maintain, and optimize the pipelines that move data from our production systems into our analytics warehouse. Today, our infrastructure uses Amazon ECS services and SQS queues to replicate data from Aurora MySQL into Snowflake, with plans to expand to additional data sources and consumers as our platform evolves.
This is a hands‑on infrastructure engineering role focused on pipeline performance, reliability, scalability, resource optimization, cost efficiency, and observability. You will help ensure data is delivered accurately, reliably, and on time as our data platform grows. Data modeling, warehouse cost management, and business transformation logic are managed by partner teams, allowing you to focus on the infrastructure and systems that power our data ecosystem—all while embracing the Shift4 way.
Responsibilities
Operate, tune, and scale the ECS/SQS-based ingestion pipelines from Aurora MySQL into Snowflake: task sizing, autoscaling, consumer concurrency, batching, retries, and dead‑letter handling
Own pipeline reliability: define SLOs for freshness and lag, build alerting and dashboards, lead incident response and root‑cause analysis for pipeline failures
Build and maintain infrastructure as code, deployment automation, and CI/CD for pipeline services
Continuously benchmark and tune throughput versus cost across ECS, SQS, and Snowflake ingestion (Snowpipe/COPY, stages)
Onboard new sources and consumers to the platform in partnership with application, data, and analytics teams
Apply data‑quality and security controls appropriate for PCI‑compliant or payment‑handling environments: encryption, secrets handling, least‑privilege access, audit trails
Proactively explore and apply AI tools to improve efficiency across the pipeline lifecycle (development, testing, runbooks, and documentation)
Qualifications
5+ years in platform, infrastructure, or DevOps roles supporting data‑intensive systems in production
Deep hands‑on AWS experience: ECS/Fargate (task sizing, autoscaling, deployments), SQS (throughput, DLQs, visibility timeouts, batching), S3, IAM, CloudWatch, and Aurora/RDS from the operator side
Proven track record tuning message‑driven workloads: consumer concurrency, backpressure, retries, idempotency, throughput versus cost
Experience operating pipelines into Snowflake from the ingestion side (Snowpipe/COPY, stages, load monitoring)
Infrastructure as code with Terraform/Ansible, containerization with Docker, and CI/CD pipelines
Observability and alerting for pipeline health and lag using Prometheus/Grafana, CloudWatch, Datadog, or the Elastic Stack
Enough Python to read, debug, and instrument worker code
Passion for automation, performance, and clean system design
Nice to have
CDC tooling (Debezium, AWS DMS) and MySQL Binlog replication
Message brokers beyond SQS: Apache Kafka/Confluent, RabbitMQ
Elastic Stack or time‑series database (Prometheus, InfluxDB) administration
Experience in a PCI or otherwise regulated environment
Payments or fintech domain knowledge
We are an Equal Opportunity Employer and do not discriminate against any employee or applicant for employment because of race, color, sex, age, national origin, religion, sexual orientation, gender identity and/or expression, status as a veteran, and basis of disability or any other federal, state or local protected class.
#J-18808-Ljbffr
Shift4 is seeking a
Data Platform Engineer
to join our Data Platform team and build, maintain, and optimize the pipelines that move data from our production systems into our analytics warehouse. Today, our infrastructure uses Amazon ECS services and SQS queues to replicate data from Aurora MySQL into Snowflake, with plans to expand to additional data sources and consumers as our platform evolves.
This is a hands‑on infrastructure engineering role focused on pipeline performance, reliability, scalability, resource optimization, cost efficiency, and observability. You will help ensure data is delivered accurately, reliably, and on time as our data platform grows. Data modeling, warehouse cost management, and business transformation logic are managed by partner teams, allowing you to focus on the infrastructure and systems that power our data ecosystem—all while embracing the Shift4 way.
Responsibilities
Operate, tune, and scale the ECS/SQS-based ingestion pipelines from Aurora MySQL into Snowflake: task sizing, autoscaling, consumer concurrency, batching, retries, and dead‑letter handling
Own pipeline reliability: define SLOs for freshness and lag, build alerting and dashboards, lead incident response and root‑cause analysis for pipeline failures
Build and maintain infrastructure as code, deployment automation, and CI/CD for pipeline services
Continuously benchmark and tune throughput versus cost across ECS, SQS, and Snowflake ingestion (Snowpipe/COPY, stages)
Onboard new sources and consumers to the platform in partnership with application, data, and analytics teams
Apply data‑quality and security controls appropriate for PCI‑compliant or payment‑handling environments: encryption, secrets handling, least‑privilege access, audit trails
Proactively explore and apply AI tools to improve efficiency across the pipeline lifecycle (development, testing, runbooks, and documentation)
Qualifications
5+ years in platform, infrastructure, or DevOps roles supporting data‑intensive systems in production
Deep hands‑on AWS experience: ECS/Fargate (task sizing, autoscaling, deployments), SQS (throughput, DLQs, visibility timeouts, batching), S3, IAM, CloudWatch, and Aurora/RDS from the operator side
Proven track record tuning message‑driven workloads: consumer concurrency, backpressure, retries, idempotency, throughput versus cost
Experience operating pipelines into Snowflake from the ingestion side (Snowpipe/COPY, stages, load monitoring)
Infrastructure as code with Terraform/Ansible, containerization with Docker, and CI/CD pipelines
Observability and alerting for pipeline health and lag using Prometheus/Grafana, CloudWatch, Datadog, or the Elastic Stack
Enough Python to read, debug, and instrument worker code
Passion for automation, performance, and clean system design
Nice to have
CDC tooling (Debezium, AWS DMS) and MySQL Binlog replication
Message brokers beyond SQS: Apache Kafka/Confluent, RabbitMQ
Elastic Stack or time‑series database (Prometheus, InfluxDB) administration
Experience in a PCI or otherwise regulated environment
Payments or fintech domain knowledge
We are an Equal Opportunity Employer and do not discriminate against any employee or applicant for employment because of race, color, sex, age, national origin, religion, sexual orientation, gender identity and/or expression, status as a veteran, and basis of disability or any other federal, state or local protected class.
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Data Platform Engineer in Winnipeg, MB vacancy
- Shift4 is seeking a Data Platform Engineer to join our Data Platform team and build, maintain, and optimize the pipelines that move data from our production systems into our analytics warehouse.Today, our infrastructure uses Amazon ECS services and SQS queues to replicate data...SuggestedInternshipWork at office
- We are looking for a hands-on engineer who is equally comfortable building client data pipelines and writing production code for our own product.You will split your... ..., you will help build Finaptive's Data Integrations Platform, our cloud-based integration and automation platform...Suggested
- As a Data Platform Engineer working in the Data Solutions group, you will play a key role in extending the capabilities, and improving the efficiency of our data platform. You will collaborate on the design and development of tooling and custom applications, evaluate the suitability...SuggestedSummer workFlexible hours
- ...the ASICS Runkeeper app), and other exciting platforms that will help us better serve the endurance... ...Overview: We are building our enterprise data platform from the ground up, and we are looking for a Senior Data Platform Engineer to partner directly with our Data Architect...SuggestedWork at officeLocal areaRemote work
- Job Title: Data Platform EngineerLocation: Edmonton, Alberta (Hybrid)Type: Permanent Full-Time All applicants must be legally entitled... ...Edmonton-based client is seeking an experienced Data Platform Engineer to build, operate, and support a modern enterprise data...SuggestedPermanent employmentFull time
- Job TitleData Platform Engineer LocationToronto, Canada Job TypeContract Reports ToDirector Data and AI, Embedded Finance Job OverviewThe primary focus of this role will... ...tables to support day‑end processing engines that run natively within the Snowflake compute...Contract workLocal area
$93.5k - $108.5k per year
The Data Platform Engineer is a hands‑on, mid‑level role responsible for building, maintaining, and enhancing 360insights' Microsoft Fabric data platform. Reporting to the Head of Data Platform, this position contributes to the delivery of reliable, scalable analytics solutions...Worldwide- Shape Jobber’s data platform through scalable pipelines, AWS expertise, and technical leadership across teams. This is a strategic, hands-on engineering role.As a Staff Data Engineer on Jobber’s Data Platform Team, you will shape data integration architecture and delivery....
- Build reliable data platforms with Python and SQL at Function Health, working remotely from Canada on infrastructure for AI-powered healthcare.As a Staff Software Engineer, you will shape Function Health’s data platform infrastructure. Your work will support reliable contracts...Local areaRemote work
- Design scalable data platforms with advanced SQL and Python as a Senior Data Engineer supporting analytics, AI-enabled experiences, and decision-making. Own production pipelines end-to-end.This senior role owns significant data platform components, including dbt transformations...
- ...is partnered with a high-growth product company building the data platform behind a modern telematics API, supporting real-time ingestion... ...at petabyte scale. The RoleThis is not a traditional data engineering seat; you will own the long-term buildout of the data platform...Long term contract
- Job Title: Senior Databricks Data Platform Engineer Location: Canada, Remote Seniority on the skill/s required on this requirement: Senior Level Estimated Duration: 1 year contract with possible extension Work authorization: Candidate must be authorized to work in...Contract workRemote work
- ...this job. Posted 19 Oct 2026.About this job Overview of the FunctionWe are seeking an experienced and forward-thinking Senior Data Platform Engineer to manage, optimize, and evolve the cloud-native platforms used by the Data Office. The role combines deep data engineering...Manual laborWork at officeLocal area
- Cloud Data Platform Engineer (AWS and Azure) Role: Cloud Data Platform Engineer (AWS and Azure) Total Experience: 6–10 Years Role Description Involve developing serverless functions (Lambda/Azure Functions), managing API integrations, and containerization. Typical...
$125k - $150k per year
...growing network of treatment centres, pharmacies and related healthcare services across Canada. CATC is is seeking a Manager, Data Engineering & Platforms to lead the development, operation and continuous improvement of CATC's enterprise data platform.Reporting to the Director...Long term contractPermanent employmentFull timeInternshipRemote workFlexible hours- ...applications and next steps. Our partner is looking for a Senior Data Platform Engineer based in Canada. The Senior Data Platform Engineer will play... ...data platform infrastructure, including distributed query engines, lakehouse storage, orchestration systems, and streaming pipelines...Remote workHome office
$200k - $255k per year
...TerminalTerminal builds telematics data infrastructure for the... ...Intact Insurance, depend on our platform to access GPS, speeding, and vehicle... ...the roleWe're looking for an engineer who thrives on building... ...Orchestration and workflow engines (Temporal, Step Functions)....InternshipWork at officeFlexible hours- Shape Jobber’s data platform through scalable pipelines, technical leadership, and hands-on engineering across batch and real-time systems.As a Staff Data Engineer on the Data Platform Team, you will shape foundational data components and guide engineering excellence. You will...
- ...and responsibilitiesWe are looking for an experiencedData Engineer to strengthen our Data & AI capabilities within ABB Motion Drive Products and High... ...data solutions, with Snowflake as our primary data platform. You will work across the data engineering lifecycle, from...Work at officeLocal area
- Design scalable data warehouses and ETL pipelines for Reflow, a workforce and workflow intelligence platform. Part-time or full-time arrangements are available.As a data platform engineer, you will build systems supporting analytics, workflow insights, and economic modeling...Full timePart time
- We are seeking a visionary and highly technical Senior Data Platform Engineer to architect, implement, scale, and maintain the data engine powering our next-generation frontier models. In this high-impact role, you will bridge the gap between cutting-edge AI research and...
- Engineer CARFAX data platforms in London, Ontario, using scalable pipelines, cloud systems, and robust software for automotive trust.As a Software Engineer within Data Technologies, you will build systems handling millions of records across enrichment pipelines, vehicle platforms...
$85.2k - $135.2k per year
Select how often (in days) to receive an alert: Are you a Senior Data Platform Engineer professional focused on platform administration, operations and support, have strong Leadership and Communication skills who is looking for a challenging and rewarding opportunity?The...Permanent employmentFull timePart timeInternshipWork at officeImmediate startFlexible hours3 days per week- Build Clutch’s data platform in hybrid Downtown Toronto, using advanced SQL, Python, Snowflake, dbt, and Airflow to power decisions.As a Senior Data Engineer, you’ll own architecture, pipelines, models, and infrastructure supporting vehicle pricing, customer funnels, delivery...
- ...is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Data Engineer – Data Platform based in Canada.As a Senior Data Engineer – Data Platform, you will play a key role in developing and operating a modern,...Contract workFixed term contractImmediate startRemote workWorldwide
- Own assigned data assets and improve platform reliability at 360insights through cloud data engineering, pipeline operations, and AI-supported development practices. Work from Whitby, Canada.The hands-on, mid-level Data Platform Engineer builds, maintains, and enhances 360insights...
- ...Permanent Full Time Are you a Senior Data Platform Engineer professional focused on platform administration, operations and support, have strong Leadership and Communication skills who is looking for a challenging and rewarding opportunity? The Canada Data Team is looking...Permanent employmentFull timeImmediate start
- Elevate your engineering skills at Finaptive as a Data Platform Engineer. You will create data pipelines and APIs in Python and Flask while working on both client integrations and our proprietary platform. As a hands-on engineer with Finaptive, you'll balance between client...
$85k - $90k per year
...Description Design and maintain scalable data pipelines that collect, transform and... ...Degree or Diploma in Computer Science, Data Engineering, Information Systems, or related field.... ...Opportunity to work with modern Azure data platforms and cloud-based engineering technologies....Permanent employment$160k - $220k per year
...this mission. If you are too, let's talk. About the TeamThe Data Platform team is responsible for the foundational data services,... ...flexible. We encourage ownership. We expect great things from our engineers and reward them with stimulating new projects, new technologies...Local areaWorldwideFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Platform Engineer. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
- junior data engineer Winnipeg, MB

