Sr. Data Engineer - Data Platform
Paytm
If working with billions of events, petabytes of data, and optimizing for the last millisecond is something that excites you then read on! We are looking for a Senior Data Engineer who has seen their fair share of messy data sets and has been able to structure them for further fraud detection and prevention;
anomaly detection and other AI products.
You will be working on writing frameworks for real-time and batch pipelines to ingest and transform events from 100’s of applications every day. These events will be consumed by both machines and people. Our ML and Software engineers consume these events to build new and optimize existing models to detect and fight new fraud patterns. You will also help optimize the feature pipelines for fast execution and work with software engineers to build event‑driven microservices.
You will get to put cutting‑edge tech in production and the freedom to experiment with new frameworks, try new ways to optimize, and resources to build the next big thing in fintech using data!
This position will operate on a hybrid model and be based in our Toronto office, mandatory in‑office days are every Tuesday and one Friday every month. These designated days and frequency may change according to the company's discretion.
Responsibilities
Work directly with the Platform Engineering Team to create reusable experimental and production data pipelines and centralize the data store.
Unbox, deep‑dive, understand, tune, and master the frameworks and technologies used day‑to‑day.
Adopt problem‑solving as a way of life – always go to the root cause.
Keep the data whole, safe, and flowing with expertise on high‑volume data ingest and streaming platforms (like Spark Streaming, Kafka, etc).
Make the data available for online and offline consumption by machines and humans.
Maintain and optimize underlying storage systems to perform according to the set SLAs.
Shape the data by developing efficient structures and schema for the data in storage and transit.
Explore new technology options for data processing, storage, and share them with the team.
Develop tools and contribute to open source wherever possible.
Qualifications
Degree in Computer Science, Engineering, or a related field
Proficient in Spark/Scala/Python/Java.
You are passionate about producing clean, maintainable, and testable code as part of a real‑time data pipeline.
You have worked with Spark and Kafka before and have experimented with or heard about Spark Streaming/Kafka Streams/Flink and understand when to use one over the other.
You have experience implementing offline and online data processing flows and understand how to choose and optimize underlying storage technologies. You have worked or experimented with NoSQL databases such as
You can connect different services and processes together even if you have not worked with them before and follow the flow of data through various pipelines to debug data issues.
You have previously worked on building serious data pipelines ingesting and transforming >
10 ^6 events per minuteand terabytes of data per day.
On a bad day, maintaining and bringing up a cluster doesn’t bother you.
You may not be a computer network expert but you understand issues with ingesting data from applications in multiple data centers across geographies, on‑premises and cloud, and will find a way to solve them.
Why join Paytm Labs
For the fifth year in a row, we are proud to announce that we have been certified as a Great Place to Work
We are an open work environment that fosters collaboration, ownership, creativity, and urgency
We ensure flexible hours outside of our core working hours
Enrolment in the group health benefits plan right from day 1, no waiting period
Team building events
We support continued learning and self‑improvement
Fuel for the day: Weekly delivery of groceries, and all types of snacks
Catered desserts every month
#J-18808-Ljbffr
anomaly detection and other AI products.
You will be working on writing frameworks for real-time and batch pipelines to ingest and transform events from 100’s of applications every day. These events will be consumed by both machines and people. Our ML and Software engineers consume these events to build new and optimize existing models to detect and fight new fraud patterns. You will also help optimize the feature pipelines for fast execution and work with software engineers to build event‑driven microservices.
You will get to put cutting‑edge tech in production and the freedom to experiment with new frameworks, try new ways to optimize, and resources to build the next big thing in fintech using data!
This position will operate on a hybrid model and be based in our Toronto office, mandatory in‑office days are every Tuesday and one Friday every month. These designated days and frequency may change according to the company's discretion.
Responsibilities
Work directly with the Platform Engineering Team to create reusable experimental and production data pipelines and centralize the data store.
Unbox, deep‑dive, understand, tune, and master the frameworks and technologies used day‑to‑day.
Adopt problem‑solving as a way of life – always go to the root cause.
Keep the data whole, safe, and flowing with expertise on high‑volume data ingest and streaming platforms (like Spark Streaming, Kafka, etc).
Make the data available for online and offline consumption by machines and humans.
Maintain and optimize underlying storage systems to perform according to the set SLAs.
Shape the data by developing efficient structures and schema for the data in storage and transit.
Explore new technology options for data processing, storage, and share them with the team.
Develop tools and contribute to open source wherever possible.
Qualifications
Degree in Computer Science, Engineering, or a related field
Proficient in Spark/Scala/Python/Java.
You are passionate about producing clean, maintainable, and testable code as part of a real‑time data pipeline.
You have worked with Spark and Kafka before and have experimented with or heard about Spark Streaming/Kafka Streams/Flink and understand when to use one over the other.
You have experience implementing offline and online data processing flows and understand how to choose and optimize underlying storage technologies. You have worked or experimented with NoSQL databases such as
You can connect different services and processes together even if you have not worked with them before and follow the flow of data through various pipelines to debug data issues.
You have previously worked on building serious data pipelines ingesting and transforming >
10 ^6 events per minuteand terabytes of data per day.
On a bad day, maintaining and bringing up a cluster doesn’t bother you.
You may not be a computer network expert but you understand issues with ingesting data from applications in multiple data centers across geographies, on‑premises and cloud, and will find a way to solve them.
Why join Paytm Labs
For the fifth year in a row, we are proud to announce that we have been certified as a Great Place to Work
We are an open work environment that fosters collaboration, ownership, creativity, and urgency
We ensure flexible hours outside of our core working hours
Enrolment in the group health benefits plan right from day 1, no waiting period
Team building events
We support continued learning and self‑improvement
Fuel for the day: Weekly delivery of groceries, and all types of snacks
Catered desserts every month
#J-18808-Ljbffr
Vacancy posted 59 minutes ago
Similar jobs that could be interesting for youBased on the Sr. Data Engineer - Data Platform in Winnipeg, MB vacancy
$108.2k - $135.3k per year
The Data and AI Platform team at Rivian supports developing and deploying Generative AI systems. We operate highly scalable infrastructure for... ...orchestrating LLMs, Vector Stores, and agents. As a senior full-stack engineer, we want you to join our diverse, talented, and collaborative...SeniorHourly payLocal area$85k - $110k per year
...behaviors. About the OpportunityWe are looking for an experienced Sr. Platform Engineer to help build the next generation of our cloud-native... ...architecture, helping to identify performance bottlenecks, improve data and caching flows, and simplify architectural complexity....SeniorRemote work- ...remote. Position SummaryOur client is seeking a data professional with strong experience in data engineering, analytics engineering, BI engineering, financial data... ...unit, product, application, environment, owner, platform, and vendor. Build analytics to support budget guardrails...SeniorContract workRemote work
$116k - $156k per year
...clinical services on. Nova is the pod that builds and owns the platform everything else sits on: our AWS infrastructure, deployment pipelines... ...North America. What You'll DoWe're hiring a senior platform engineer (infrastructure and observability) for Nova. Take ownership...SeniorLong term contractWork at officeRemote workWork from homeHome office2 days per week3 days per week- What you’ll be doing Our team is focused on building and evolving a modern, scalable data platform that supports critical business and technology priorities across CIBC. As a Senior Consultant, Data Platform DevOps, you'll lead the development and enhancement of DevOps practices...SeniorLong term contractRemote work
$103k - $153k per year
...The IT Enterprise Architecture, Network, Cloud and Data Platform Group at HOOPP is committed to delivering... ...courage to challenge the status quo. Reporting to the Sr. Manager, Cloud Platform, the Sr. Cloud Platform Engineer will be responsible for designing, maintaining and...SeniorLong term contractPermanent employmentImmediate start- ClearGov is looking for a Software Engineer to join our team. You'll be a key contributor in designing, developing, and scaling the next generation... ...and APIs using Node.js, Java, and Spring Boot. Support data-intensive budgeting and reporting workflows. Apply AI-assisted...SeniorFull timeWork at officeLocal area
$120k - $140k per year
Requisition Number: 106522Data Engineer Sr Location This role is hybrid, with the onsite locations in Montreal... ...the Role We are seeking a Senior Data Engineer to design, build, and optimize modern data platforms that enable analytics, reporting, operational intelligence...SeniorApprenticeshipWork at office- ...Role :Build the source-to-Silver ingestion layer for a complex data and AI platform transformation at a regulated financial institution. Own the... .... You are not a pipeline configuration resource. You are an engineer who understands what the data means, where it breaks, and why...SeniorWork at officeImmediate startFlexible hours
- ...complex, high-velocity supply chain, and data is at the heart of how we plan, route, and... .... We're looking for a Senior Data Engineer to design, build, and scale the data infrastructure... ...performance and cost across cloud data platforms, monitoring for reliability, latency, and...Senior
$120k - $140k per year
Job Title: Senior Data Engineer Location: Greater Toronto Area, ON (Hybrid: 4 days onsite / 1 day remote) Salary Range: $120,000 – $140,000... ...production data and AI foundation on the Azure Databricks Lakehouse platform. Reporting to IT leadership, you will play a hands‑on role in...SeniorWork at officeRemote work- ...Hospitality being others.Start Date - Immediate Duration - Long Term Job Description: This role is intended for a Senior Data Engineer who combines deep technical fluency with proven delivery leadership, driving predictable execution, engineering discipline, and...SeniorLong term contractLocal areaImmediate start
- We are looking for a Senior Data Engineer to joint their Data & Analytics team within Data & Technology team, reporting directly to the Director of Data & Analytics.Soft skills are key here - this person needs to be a self-starter who takes initiative, with strong communication...Senior
- ...Build and operate the data pipelines, warehouses, and transformation layers that form the analytical and operational data foundations for enterprise clients. Quix is looking for a Data Platform Engineer to design and maintain the data infrastructure that enterprise analytics...Contract work
- Shift4 is seeking a Data Platform Engineer to join our Data Platform team and build, maintain, and optimize the pipelines that move data from our production systems into our analytics warehouse.Today, our infrastructure uses Amazon ECS services and SQS queues to replicate data...InternshipWork at office
- Job TitleData Platform Engineer LocationToronto, Canada Job TypeContract Reports ToDirector Data and AI, Embedded Finance Job OverviewThe primary focus of this role will... ...tables to support day‑end processing engines that run natively within the Snowflake compute...Contract workLocal area
- ...the ASICS Runkeeper app), and other exciting platforms that will help us better serve the endurance... ...Overview We are building our enterprise data platform from the ground up, and we are looking for a Senior Data Platform Engineer to partner directly with our Data Architect...SeniorWork at officeLocal areaRemote work
- ...will report to the Manager, P&C/Tel Strategy and Standards and join the Protection & Control (P&C) Asset Management team as a Senior Engineer. The P&C Asset Management team has responsibility for the following functions: Assist with Planning, developing and maintaining asset...SeniorRemplacementPermanent employmentFull timeImmediate startFlexible hours
- Job Title: Data Platform EngineerLocation: Edmonton, Alberta (Hybrid)Type: Permanent Full-Time All applicants must be legally entitled... ...Edmonton-based client is seeking an experienced Data Platform Engineer to build, operate, and support a modern enterprise data...Permanent employmentFull time
$93.5k - $108.5k per year
The Data Platform Engineer is a hands‑on, mid‑level role responsible for building, maintaining, and enhancing 360insights' Microsoft Fabric data platform. Reporting to the Head of Data Platform, this position contributes to the delivery of reliable, scalable analytics solutions...Worldwide- We are looking for a hands-on engineer who is equally comfortable building client data pipelines and writing production code for our own product.You will split your... ..., you will help build Finaptive's Data Integrations Platform, our cloud-based integration and automation platform...
- As a Data Platform Engineer working in the Data Solutions group, you will play a key role in extending the capabilities, and improving the efficiency of our data platform. You will collaborate on the design and development of tooling and custom applications, evaluate the suitability...Summer workFlexible hours
$130k - $155k per year
What you will do: Job Summary As the Sr. Manager, Data Engineering, you will have the opportunity to shape and scale the data foundations that... ...Delivery Partner with Data Science, BI & Insights, Data Platforms, and business teams to translate requirements into sustainable...SeniorInternship- Strong experience architecting enterprise data platforms on Google Cloud (GCP). The architect will work as a strategic technical partner to... ...Partner with enterprise architects, security teams, and platform engineering teams on cross‑functional initiatives. Guide data engineers...SeniorRemote work
$144.1k - $193.2k per year
Job Posting Title: Sr Software Engineer - Content Platform Engineering Req ID: 10142399 Job Description: Department/Group Overview:Disney Entertainment... ...engineers, product developers, designers, technologists, data scientists, and more – all working to build and advance...SeniorLong term contractFull timeWorldwide- ...Snowflake, DBT, Glue 8+ years of professional experience in data engineering, with a proven track record of delivering 3+ high-impact data... ...relational databases (Snowflake, PostgreSQL, Amazon Aurora), big data platforms (Hadoop), and NoSQL databases (MongoDB). Advanced...Senior
$186.1k - $292.85k per year
About the RoleYou’ll lead engineering for some of CaptivateIQ’s most important platform building blocks and use that leverage to support our journey into a multi-product company. Core Platform is the foundation the rest of our product runs on. As Senior Manager, Core Platform...SeniorLong term contractFull timeRemote workFlexible hours- Job Title: Senior Databricks Data Platform Engineer Location: Canada, Remote Seniority on the skill/s required on this requirement: Senior Level Estimated Duration: 1 year contract with possible extension Work authorization: Candidate must be authorized to work in...SeniorContract workRemote work
- ...applications and next steps. Our partner is looking for a Senior Data Platform Engineer based in Canada. The Senior Data Platform Engineer will play... ...data platform infrastructure, including distributed query engines, lakehouse storage, orchestration systems, and streaming pipelines...SeniorRemote workHome office
- Join Bally’s Intralot as a Data Cloud Platform Engineer (DBA) - AWS Infrastructure At Bally’s Intralot, we shape the future of gaming through innovation... ...(MySQL/PostgreSQL), self-managed DBs on EC2. Database Engines: MySQL, PostgreSQL, Oracle, SQL Server (one or more)....Worldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr. Data Engineer - Data Platform. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
- junior data engineer Winnipeg, MB

