Staff Engineer - Open Source Data Platform
$180k - $210k per yearThe Consensus
ABOUT THE ROLEWe are seeking a Staff Engineer with at least 9 years of experience in distributed systems or data platform development. In this role, you will be a technical leader responsible for architecting and driving the technical direction of critical components within the Acceldata Open Data Platform (ODP). You will work on solving the most challenging distributed systems problems, contribute to open-source communities, and mentor senior engineers while shaping the future of large‑scale data infrastructure.
You'll lead high‑impact initiatives that directly influence how petabyte‑scale data is managed, observed, and optimized across hybrid and cloud ecosystems. You'll collaborate with industry experts, Apache committers, and seasoned engineers who share your passion for distributed systems and open‑source innovation.
WHY JOIN USAt Acceldata, you won't just be writing code;
you'll be defining the architecture and technical vision for modern data platforms used by some of the world's largest enterprises.
Your technical decisions will shape mission‑critical systems, and your contributions will be visible across the global data ecosystem. If you're ready to take ownership of complex technical challenges and drive innovation at scale, Acceldata is where you belong.
RESPONSIBILITIES
Own the end‑to‑end architecture of major platform components, driving design decisions that impact scalability, reliability, and performance.
Architect and implement next‑generation distributed data storage, processing, and query optimization systems.
Partner with product, engineering leadership, and stakeholders to define technical roadmaps and translate business requirements into scalable solutions.
Lead contributions to Apache projects and open‑source communities, establishing Acceldata's presence and technical reputation.
Identify and resolve complex performance bottlenecks across distributed systems, optimizing for cost, latency, and throughput.
Mentor and guide Senior Software Engineers, fostering technical excellence and a culture of continuous learning.
Establish and enforce coding standards, perform thorough code reviews, and ensure architectural consistency across the platform.
Evaluate and recommend emerging technologies, tools, and frameworks that align with platform goals.
Lead root cause analysis for critical production issues and drive systemic improvements to prevent recurrence.
Work across diverse environments: Bare Metals, VM, Kubernetes, and multi‑cloud architectures.
REQUIREMENTS
9+ years of hands‑on software development experience with at least 5 years focused on distributed systems or big data platforms.
Expert‑level proficiency in Java or Scala, with strong Python skills. Experience with systems languages is a plus.
Deep understanding of distributed computing principles, including consensus algorithms, data partitioning, replication, fault tolerance, and consistency models.
Extensive hands‑on experience with multiple components of the big data stack (Hadoop, Spark, Hive, Trino, Kafka, Flink, NiFi or similar).
Expert‑level Linux proficiency, including kernel tuning, performance analysis, and debugging at the system level.
Strong experience with Kubernetes, Docker, and cloud platforms (AWS, GCP, or Azure).
Deep expertise with Maven, Gradle, or SBT;
experienced in CI/CD pipelines, GitHub, and artifact management (Nexus).
Proven ability to diagnose and resolve complex issues, including memory leaks, deadlocks, GC tuning, and distributed system failures.
Strong understanding of architectural patterns for scalable, fault‑tolerant distributed systems.
Excellent written and verbal communication skills;
ability to articulate complex technical concepts to diverse audiences, including senior leadership.
Demonstrated ability to work effectively with cross‑functional teams, external contributors, and the open‑source community.
PREFERRED SKILLS
History of significant contributions or committer status in Apache projects (e.G., Spark, Kafka, Hive, Iceberg, Flink, etc.).
Experience with modern table formats (Apache Iceberg, Delta Lake, Hudi) and data lake architectures.
Experience developing or optimizing query engines, query planners, or execution frameworks.
Familiarity with data governance, security, lineage, and compliance frameworks.
Experience leading large‑scale data platform migrations or Hadoop distribution upgrades.
Published technical blogs, papers, or conference presentations on distributed systems topics.
Experience leading or maintaining open‑source projects.
$180,000 - $210,000 a year
#J-18808-Ljbffr
You'll lead high‑impact initiatives that directly influence how petabyte‑scale data is managed, observed, and optimized across hybrid and cloud ecosystems. You'll collaborate with industry experts, Apache committers, and seasoned engineers who share your passion for distributed systems and open‑source innovation.
WHY JOIN USAt Acceldata, you won't just be writing code;
you'll be defining the architecture and technical vision for modern data platforms used by some of the world's largest enterprises.
Your technical decisions will shape mission‑critical systems, and your contributions will be visible across the global data ecosystem. If you're ready to take ownership of complex technical challenges and drive innovation at scale, Acceldata is where you belong.
RESPONSIBILITIES
Own the end‑to‑end architecture of major platform components, driving design decisions that impact scalability, reliability, and performance.
Architect and implement next‑generation distributed data storage, processing, and query optimization systems.
Partner with product, engineering leadership, and stakeholders to define technical roadmaps and translate business requirements into scalable solutions.
Lead contributions to Apache projects and open‑source communities, establishing Acceldata's presence and technical reputation.
Identify and resolve complex performance bottlenecks across distributed systems, optimizing for cost, latency, and throughput.
Mentor and guide Senior Software Engineers, fostering technical excellence and a culture of continuous learning.
Establish and enforce coding standards, perform thorough code reviews, and ensure architectural consistency across the platform.
Evaluate and recommend emerging technologies, tools, and frameworks that align with platform goals.
Lead root cause analysis for critical production issues and drive systemic improvements to prevent recurrence.
Work across diverse environments: Bare Metals, VM, Kubernetes, and multi‑cloud architectures.
REQUIREMENTS
9+ years of hands‑on software development experience with at least 5 years focused on distributed systems or big data platforms.
Expert‑level proficiency in Java or Scala, with strong Python skills. Experience with systems languages is a plus.
Deep understanding of distributed computing principles, including consensus algorithms, data partitioning, replication, fault tolerance, and consistency models.
Extensive hands‑on experience with multiple components of the big data stack (Hadoop, Spark, Hive, Trino, Kafka, Flink, NiFi or similar).
Expert‑level Linux proficiency, including kernel tuning, performance analysis, and debugging at the system level.
Strong experience with Kubernetes, Docker, and cloud platforms (AWS, GCP, or Azure).
Deep expertise with Maven, Gradle, or SBT;
experienced in CI/CD pipelines, GitHub, and artifact management (Nexus).
Proven ability to diagnose and resolve complex issues, including memory leaks, deadlocks, GC tuning, and distributed system failures.
Strong understanding of architectural patterns for scalable, fault‑tolerant distributed systems.
Excellent written and verbal communication skills;
ability to articulate complex technical concepts to diverse audiences, including senior leadership.
Demonstrated ability to work effectively with cross‑functional teams, external contributors, and the open‑source community.
PREFERRED SKILLS
History of significant contributions or committer status in Apache projects (e.G., Spark, Kafka, Hive, Iceberg, Flink, etc.).
Experience with modern table formats (Apache Iceberg, Delta Lake, Hudi) and data lake architectures.
Experience developing or optimizing query engines, query planners, or execution frameworks.
Familiarity with data governance, security, lineage, and compliance frameworks.
Experience leading large‑scale data platform migrations or Hadoop distribution upgrades.
Published technical blogs, papers, or conference presentations on distributed systems topics.
Experience leading or maintaining open‑source projects.
$180,000 - $210,000 a year
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Staff Engineer - Open Source Data Platform in Winnipeg, MB vacancy
- Advance Shopify’s Apache Flink platform through open source contribution, engine expertise, and infrastructure leadership at significant scale.As a Staff Engineer on Streaming Compute, you will push the core Flink ecosystem forward internally and in the open source community...Data
$210k - $240k per year
...the market leader in Enterprise Data Observability. Founded in 2018... ...Enterprise Data Observability Platform—the first of its kind—helps... ...ROLEWe are seeking a Principal Engineer with at least 14 years of experience... ...leader for Acceldata's Open Data Platform (ODP). In this role...DataLong term contractWork at office- Build reliable data platforms with Python and SQL at Function Health, working remotely from Canada on infrastructure for AI-powered healthcare.As a Staff Software Engineer, you will shape Function Health’s data platform infrastructure. Your work will support reliable contracts...DataLocal areaRemote work
- Shape Jobber’s data platform through scalable pipelines, technical leadership, and hands-on engineering across batch and real-time systems.As a Staff Data Engineer on the Data Platform Team, you will shape foundational data components and guide engineering excellence. You will...Data
- Shape Jobber’s data platform through scalable pipelines, AWS expertise, and technical leadership across teams. This is a strategic, hands-on engineering role.As a Staff Data Engineer on Jobber’s Data Platform Team, you will shape data integration architecture and delivery....Data
- Build Meeru AI’s data foundation with expert SQL and Python for production pipelines, connectors, and curated models across enterprise finance systems.As a Staff Data Engineer, you will own major data-platform subsystems end to end. You will transform warehouse data, integrate...Data
- ...members comprehensive lab testing, imaging, longitudinal data, and guidance from AI and clinical teams. The... ...$298M Series B and is scaling its integrated health platform.Role Function is hiring a Staff Software Engineer for its data platform. The role focuses on building...DataFull timeContract workLocal areaRemote workFlexible hours
$100k - $140k per year
...the market leader in Enterprise Data Observability. Founded in 2018... ...Enterprise Data Observability Platform—the first of its kind—helps... ...are seeking a Senior Software Engineer with at least 7 years of experience... ...components of the Acceldata Open Data Platform (ODP),...DataWork at office- Lead Juniper Square’s data platform transformation with advanced SQL and cloud engineering in a remote-first environment across the United States and Canada.As Senior Staff Software Engineer, Data, you will define architecture, operating models, and execution roadmaps for a...DataRemote work
$160k - $220k per year
...this mission. If you are too, let's talk. About the TeamThe Data Platform team is responsible for the foundational data services,... ...flexible. We encourage ownership. We expect great things from our engineers and reward them with stimulating new projects, new technologies...DataLocal areaWorldwideFlexible hours- Shape Forma.Ai’s Spark-based data platform through backend architecture, data modeling, and reliable systems development. This staff-level role carries broad technical ownership.Reporting... ..., and production reliabilityMentor engineers and strengthen backend engineering standardsRequirements...Data
$160k - $200k per year
Position: Staff Software Engineer, Data PlatformEmployment Type: Full-timeWork Arrangement: Remote within CanadaAnnual Base Salary: CAD... ...for teams, media and fans.As Staff Software Engineer, Data Platform, you will independently own the database and data-platform...DataInternshipRemote work- A leading data platform company in Canada is seeking a Senior Engineer to build and maintain their Boréal hosting platform and Moose open-source project. This role offers the chance to collaborate closely with product and design teams in a flexible, remote-first environment...DataRemote workFlexible hours
$147k - $196.6k per year
...existing vacancy within the organization and is open to new applications.Job Description... ...three days per week, at minimum.The Role The Data Engineering organization at General Motors is building a unified Vehicle Data Platform that moves data and configuration between vehicle...DataWork at officeRemote work3 days per week- Staff Software Engineer – Data Platform – Canada Job Description About PantheonPantheon WebOps Platform powers the open web, running more than 300,000 sites in the cloud for customers including Google, Princeton, Salesloft and Doctors Without Borders. Every day, thousands...Data
- Shape Instacart’s Ads data platform remotely with Spark, SQL, and distributed systems expertise. Build compliant, reliable infrastructure for critical advertising workflows.As a Staff Software Engineer, you will advance a robust data platform addressing strategic challenges...DataRemote work
$200k - $255k per year
...TerminalTerminal builds telematics data infrastructure for the... ...Intact Insurance, depend on our platform to access GPS, speeding, and vehicle... ...Note that this role is only open to Toronto/GTA-based... ...The RoleWe’re looking for an engineer who thrives on building scalable...DataInternshipWork at officeFlexible hours$147k - $196.6k per year
...existing vacancy within the organization and is open to new applications. AI Disclosure: As part... ...days per week, at minimum. The Role The Data Engineering organization at General Motors is building a unified Vehicle Data Platform that moves data and configuration between...DataWork at officeRemote work3 days per week$92.58 per hour
...per Week: 35 hours Hourly Rate: $92.58 Job OverviewAs a Staff Data Engineer/Data Architect, you will be responsible for leading the architecture... ...and data infrastructure leveraging the wide range of data sources across the organization. Design curated common data models...DataHourly payRemote work- ...building features for the PennyLane framework, coordinating with Product Managers and cross-functional groups to deliver high-quality open-source software. Experience in quantum software is not required, but an advanced scientific degree is strongly preferred and you will be...
- ...entering the workforce, or looking for a new job, this is where you belong. As a Staff Data Engineer, you will play a technical leadership and architecture role on the Retail Media Platform team. This is a senior, hands‑on position focused on designing, building, and...DataPermanent employmentTemporary workInternship
- Design open source software with Canonical as a remote Senior Engineer, using deep experience in Go, Rust, Python, or C. Lead architecture across global teams and time... ...zones.This Senior+ Engineer track welcomes Senior, Staff, and Principal Engineers across Canonical teams....Remote workWorldwide
- ...creating something big!About the Team Engineers on this team construct our rules-based... ...be doing Reporting to the Manager of Data Platform, you will play a critical role in the evolution... ...the most challenging code at Forma.As a Staff Engineer, you are expected to operate...DataLong term contract
- ...misspelled a variable? Do you like to work in an open and transparent environment? If so, our Open Source Software Release Engineer is likely the job for you!The Eclipse... ...working within the constraints of the General Data Protection Regulation (GDPR).About the Eclipse...DataRemote workWork from homeHome office
$240k - $300k per year
...Brex is the intelligent finance platform that enables companies to... ...you need to grow your career. Engineering at Brex Engineering at Brex... ...intention. Our teams span Software, Data, Security, and IT, and operate... ...distributed systems. As a Staff Software Engineer, you'll shape...DataLong term contractWork at officeRemote workWork from home- Instacart · instacart.Careers · checked today Staff Software Engineer, Ads Data PlatformCanada - Remote (ON, AB, BC, or NS Only) Staff · Remote 8+ yrs Data Platform posted 2 d ago We're transforming the grocery industry At Instacart, we invite the world to share love...DataRemote work
- ...Faire Wholesale Inc. is seeking a Staff Engineer to own the data plumbing that powers our analytic platform. You will design and build the next-gen movement of data from production databases into analytical stores, partnering with data scientists, analysts, and engineers...Data
$170k per year
...mission to simplify and democratize data and AI — from making the next... ...data and AI infrastructure platform so our customers can use deep... ...their business. Founded by engineers — and customer obsessed — we leap... ...site and we have several open roles across the teams below,...DataSummer workWorldwide- Stripe is seeking a Staff-level data engineering leader to drive high-impact data pipelines and ML-enabled data initiatives. You will mentor engineers... .... In this role, you will collaborate across Stripe's platforms to ensure reliable, explainable data flows and architectures...Data
- Support Ubuntu contributors remotely as a Community Engineer at Canonical, using Linux expertise and strong organizational skills to scale... ...Engineers across multiple seniority levels to facilitate open source community work. You will coordinate with developers, technical...Remote workWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Engineer - Open Source Data Platform. Be the first to apply!
Related searches
- project engineer assistant project manager Winnipeg, MB
- assistant electrical engineer Winnipeg, MB
- data integration developer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB

