Sr. Data Engineer - Data Platform
Paytm
If working with billions of events, petabytes of data, and optimizing for the last millisecond is something that excites you then read on! We are looking for a Senior Data Engineer who has seen their fair share of messy data sets and has been able to structure them for further fraud detection and prevention;
anomaly detection and other AI products.
You will be working on writing frameworks for real-time and batch pipelines to ingest and transform events from 100’s of applications every day. These events will be consumed by both machines and people. Our ML and Software engineers consume these events to build new and optimize existing models to detect and fight new fraud patterns. You will also help optimize the feature pipelines for fast execution and work with software engineers to build event‑driven microservices.
You will get to put cutting‑edge tech in production and the freedom to experiment with new frameworks, try new ways to optimize, and resources to build the next big thing in fintech using data!
This position will operate on a hybrid model and be based in our Toronto office, mandatory in‑office days are every Tuesday and one Friday every month. These designated days and frequency may change according to the company's discretion.
Responsibilities
Work directly with the Platform Engineering Team to create reusable experimental and production data pipelines and centralize the data store.
Unbox, deep‑dive, understand, tune, and master the frameworks and technologies used day‑to‑day.
Adopt problem‑solving as a way of life – always go to the root cause.
Keep the data whole, safe, and flowing with expertise on high‑volume data ingest and streaming platforms (like Spark Streaming, Kafka, etc).
Make the data available for online and offline consumption by machines and humans.
Maintain and optimize underlying storage systems to perform according to the set SLAs.
Shape the data by developing efficient structures and schema for the data in storage and transit.
Explore new technology options for data processing, storage, and share them with the team.
Develop tools and contribute to open source wherever possible.
Qualifications
Degree in Computer Science, Engineering, or a related field
Proficient in Spark/Scala/Python/Java.
You are passionate about producing clean, maintainable, and testable code as part of a real‑time data pipeline.
You have worked with Spark and Kafka before and have experimented with or heard about Spark Streaming/Kafka Streams/Flink and understand when to use one over the other.
You have experience implementing offline and online data processing flows and understand how to choose and optimize underlying storage technologies. You have worked or experimented with NoSQL databases such as
You can connect different services and processes together even if you have not worked with them before and follow the flow of data through various pipelines to debug data issues.
You have previously worked on building serious data pipelines ingesting and transforming >
10 ^6 events per minuteand terabytes of data per day.
On a bad day, maintaining and bringing up a cluster doesn’t bother you.
You may not be a computer network expert but you understand issues with ingesting data from applications in multiple data centers across geographies, on‑premises and cloud, and will find a way to solve them.
Why join Paytm Labs
For the fifth year in a row, we are proud to announce that we have been certified as a Great Place to Work
We are an open work environment that fosters collaboration, ownership, creativity, and urgency
We ensure flexible hours outside of our core working hours
Enrolment in the group health benefits plan right from day 1, no waiting period
Team building events
We support continued learning and self‑improvement
Fuel for the day: Weekly delivery of groceries, and all types of snacks
Catered desserts every month
#J-18808-Ljbffr
anomaly detection and other AI products.
You will be working on writing frameworks for real-time and batch pipelines to ingest and transform events from 100’s of applications every day. These events will be consumed by both machines and people. Our ML and Software engineers consume these events to build new and optimize existing models to detect and fight new fraud patterns. You will also help optimize the feature pipelines for fast execution and work with software engineers to build event‑driven microservices.
You will get to put cutting‑edge tech in production and the freedom to experiment with new frameworks, try new ways to optimize, and resources to build the next big thing in fintech using data!
This position will operate on a hybrid model and be based in our Toronto office, mandatory in‑office days are every Tuesday and one Friday every month. These designated days and frequency may change according to the company's discretion.
Responsibilities
Work directly with the Platform Engineering Team to create reusable experimental and production data pipelines and centralize the data store.
Unbox, deep‑dive, understand, tune, and master the frameworks and technologies used day‑to‑day.
Adopt problem‑solving as a way of life – always go to the root cause.
Keep the data whole, safe, and flowing with expertise on high‑volume data ingest and streaming platforms (like Spark Streaming, Kafka, etc).
Make the data available for online and offline consumption by machines and humans.
Maintain and optimize underlying storage systems to perform according to the set SLAs.
Shape the data by developing efficient structures and schema for the data in storage and transit.
Explore new technology options for data processing, storage, and share them with the team.
Develop tools and contribute to open source wherever possible.
Qualifications
Degree in Computer Science, Engineering, or a related field
Proficient in Spark/Scala/Python/Java.
You are passionate about producing clean, maintainable, and testable code as part of a real‑time data pipeline.
You have worked with Spark and Kafka before and have experimented with or heard about Spark Streaming/Kafka Streams/Flink and understand when to use one over the other.
You have experience implementing offline and online data processing flows and understand how to choose and optimize underlying storage technologies. You have worked or experimented with NoSQL databases such as
You can connect different services and processes together even if you have not worked with them before and follow the flow of data through various pipelines to debug data issues.
You have previously worked on building serious data pipelines ingesting and transforming >
10 ^6 events per minuteand terabytes of data per day.
On a bad day, maintaining and bringing up a cluster doesn’t bother you.
You may not be a computer network expert but you understand issues with ingesting data from applications in multiple data centers across geographies, on‑premises and cloud, and will find a way to solve them.
Why join Paytm Labs
For the fifth year in a row, we are proud to announce that we have been certified as a Great Place to Work
We are an open work environment that fosters collaboration, ownership, creativity, and urgency
We ensure flexible hours outside of our core working hours
Enrolment in the group health benefits plan right from day 1, no waiting period
Team building events
We support continued learning and self‑improvement
Fuel for the day: Weekly delivery of groceries, and all types of snacks
Catered desserts every month
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Sr. Data Engineer - Data Platform in Winnipeg, MB vacancy
$108.2k - $135.3k per year
The Data and AI Platform team at Rivian supports developing and deploying Generative AI systems. We operate highly scalable infrastructure for... ...orchestrating LLMs, Vector Stores, and agents. As a senior full-stack engineer, we want you to join our diverse, talented, and collaborative...SeniorHourly payLocal area- ...remote. Position SummaryOur client is seeking a data professional with strong experience in data engineering, analytics engineering, BI engineering, financial data... ...unit, product, application, environment, owner, platform, and vendor. Build analytics to support budget guardrails...SeniorContract workRemote work
$85k - $110k per year
...behaviors. About the OpportunityWe are looking for an experienced Sr. Platform Engineer to help build the next generation of our cloud-native... ...architecture, helping to identify performance bottlenecks, improve data and caching flows, and simplify architectural complexity....SeniorRemote work$116k - $156k per year
...clinical services on. Nova is the pod that builds and owns the platform everything else sits on: our AWS infrastructure, deployment pipelines... ...North America. What You'll DoWe're hiring a senior platform engineer (infrastructure and observability) for Nova. Take ownership...SeniorLong term contractWork at officeRemote workWork from homeHome office2 days per week3 days per week- ...Role :Build the source-to-Silver ingestion layer for a complex data and AI platform transformation at a regulated financial institution. Own the... .... You are not a pipeline configuration resource. You are an engineer who understands what the data means, where it breaks, and why...SeniorWork at officeImmediate startFlexible hours
$120k - $140k per year
Requisition Number: 106522Data Engineer Sr Location This role is hybrid, with the onsite locations in Montreal... ...the Role We are seeking a Senior Data Engineer to design, build, and optimize modern data platforms that enable analytics, reporting, operational intelligence...SeniorApprenticeshipWork at office- ClearGov is looking for a Software Engineer to join our team. You'll be a key contributor in designing, developing, and scaling the next generation... ...and APIs using Node.js, Java, and Spring Boot. Support data-intensive budgeting and reporting workflows. Apply AI-assisted...SeniorFull timeWork at officeLocal area
$103k - $153k per year
...The IT Enterprise Architecture, Network, Cloud and Data Platform Group at HOOPP is committed to delivering... ...courage to challenge the status quo. Reporting to the Sr. Manager, Cloud Platform, the Sr. Cloud Platform Engineer will be responsible for designing, maintaining and...SeniorLong term contractPermanent employmentImmediate start- ...complex, high-velocity supply chain, and data is at the heart of how we plan, route, and... .... We're looking for a Senior Data Engineer to design, build, and scale the data infrastructure... ...performance and cost across cloud data platforms, monitoring for reliability, latency, and...Senior
$120k - $140k per year
Job Title: Senior Data Engineer Location: Greater Toronto Area, ON (Hybrid: 4 days onsite / 1 day remote) Salary Range: $120,000 – $140,000... ...production data and AI foundation on the Azure Databricks Lakehouse platform. Reporting to IT leadership, you will play a hands‑on role in...SeniorWork at officeRemote work- What you’ll be doing Our team is focused on building and evolving a modern, scalable data platform that supports critical business and technology priorities across CIBC. As a Senior Consultant, Data Platform DevOps, you'll lead the development and enhancement of DevOps practices...SeniorLong term contractRemote work
- ...Hospitality being others.Start Date - Immediate Duration - Long Term Job Description: This role is intended for a Senior Data Engineer who combines deep technical fluency with proven delivery leadership, driving predictable execution, engineering discipline, and...SeniorLong term contractLocal areaImmediate start
- ...annually for hundreds of thousands of businesses in virtually every industry. For more information, visit Shift4 is seeking a Data Platform Engineer to join our Data Platform team and build, maintain, and optimize the pipelines that move data from our production systems...InternshipLocal area
- As a Data Platform Engineer working in the Data Solutions group, you will play a key role in extending the capabilities, and improving the efficiency of our data platform. You will collaborate on the design and development of tooling and custom applications, evaluate the suitability...Summer workFlexible hours
- We are looking for a Senior Data Engineer to joint their Data & Analytics team within Data & Technology team, reporting directly to the Director of Data & Analytics.Soft skills are key here - this person needs to be a self-starter who takes initiative, with strong communication...Senior
- We are looking for a hands-on engineer who is equally comfortable building client data pipelines and writing production code for our own product.You will split your... ..., you will help build Finaptive's Data Integrations Platform, our cloud-based integration and automation platform...
- ...Build and operate the data pipelines, warehouses, and transformation layers that form the analytical and operational data foundations for enterprise clients. Quix is looking for a Data Platform Engineer to design and maintain the data infrastructure that enterprise analytics...Contract work
- ...the ASICS Runkeeper app), and other exciting platforms that will help us better serve the endurance... ...Overview: We are building our enterprise data platform from the ground up, and we are looking for a Senior Data Platform Engineer to partner directly with our Data Architect...SeniorWork at officeLocal areaRemote work
$93.5k - $108.5k per year
The Data Platform Engineer is a hands‑on, mid‑level role responsible for building, maintaining, and enhancing 360insights' Microsoft Fabric data platform. Reporting to the Head of Data Platform, this position contributes to the delivery of reliable, scalable analytics solutions...Worldwide- Job TitleData Platform Engineer LocationToronto, Canada Job TypeContract Reports ToDirector Data and AI, Embedded Finance Job OverviewThe primary focus of this role will... ...tables to support day‑end processing engines that run natively within the Snowflake compute...Contract workLocal area
- Job Title: Data Platform EngineerLocation: Edmonton, Alberta (Hybrid)Type: Permanent Full-Time All applicants must be legally entitled... ...Edmonton-based client is seeking an experienced Data Platform Engineer to build, operate, and support a modern enterprise data...Permanent employmentFull time
- What you will do: Job Summary As the Sr. Manager, Data Engineering, you will have the opportunity to shape and scale the data foundations that... ...Partner with Data Science, BI & Insights, Data Platforms, and business teams to translate requirements into sustainable...SeniorInternship
- Strong experience architecting enterprise data platforms on Google Cloud (GCP). The architect will work as a strategic technical partner to... ...Partner with enterprise architects, security teams, and platform engineering teams on cross‑functional initiatives. Guide data engineers...SeniorRemote work
- ...Snowflake, DBT, Glue 8+ years of professional experience in data engineering, with a proven track record of delivering 3+ high-impact data... ...relational databases (Snowflake, PostgreSQL, Amazon Aurora), big data platforms (Hadoop), and NoSQL databases (MongoDB). Advanced...Senior
- ...will report to the Manager, P&C/Tel Strategy and Standards and join the Protection & Control (P&C) Asset Management team as a Senior Engineer. The P&C Asset Management team has responsibility for the following functions: Assist with Planning, developing and maintaining asset...SeniorRemplacementPermanent employmentFull timeImmediate startFlexible hours
$144.1k - $193.2k per year
Job Posting Title: Sr Software Engineer - Content Platform Engineering Req ID: 10142399 Job Description: Department/Group Overview:Disney Entertainment... ...engineers, product developers, designers, technologists, data scientists, and more – all working to build and advance...SeniorLong term contractFull timeWorldwide$186.1k - $292.85k per year
About the RoleYou’ll lead engineering for some of CaptivateIQ’s most important platform building blocks and use that leverage to support our journey into a multi-product company. Core Platform is the foundation the rest of our product runs on. As Senior Manager, Core Platform...SeniorLong term contractFull timeRemote workFlexible hours- Join Bally’s Intralot as a Data Cloud Platform Engineer (DBA) - AWS Infrastructure At Bally’s Intralot, we shape the future of gaming through innovation... ...(MySQL/PostgreSQL), self-managed DBs on EC2. Database Engines: MySQL, PostgreSQL, Oracle, SQL Server (one or more)....Worldwide
- Shape Jobber’s data platform through scalable pipelines, AWS expertise, and technical leadership across teams. This is a strategic, hands-on engineering role.As a Staff Data Engineer on Jobber’s Data Platform Team, you will shape data integration architecture and delivery....
- ...and responsibilitiesWe are looking for an experiencedData Engineer to strengthen our Data & AI capabilities within ABB Motion Drive Products and High... ...data solutions, with Snowflake as our primary data platform. You will work across the data engineering lifecycle, from...Work at officeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr. Data Engineer - Data Platform. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
- junior data engineer Winnipeg, MB

