Principal Engineer - Open Source Data Platform
$210k - $240k per yearThe Consensus
Acceldata is the market leader in Enterprise Data Observability. Founded in 2018 and backed by top investors including Insight Partners, March Capital, Lightspeed, Sorenson Ventures, Industry Ventures, and Emergent Ventures, we are a Series-C funded company headquartered in Silicon Valley.
Our Enterprise Data Observability Platform—the first of its kind—helps enterprises build and operate world-class data products by ensuring data is reliable, trusted, and ready to power today’s most critical technologies, including AI, LLMs, Analytics, and DataOps.
Delivered as a SaaS solution, Acceldata is trusted by leading global organizations such as HPE, HSBC, Visa, Freddie Mac, Manulife, Workday, Oracle, PubMatic, PhonePe (Walmart), Hershey’s, Dun & Bradstreet, and many more.
ABOUT USABOUT THE ROLEWe are seeking a Principal Engineer with at least 14 years of experience to serve as a technical visionary and thought leader for Acceldata's Open Data Platform (ODP). In this role, you will define the long-term technical strategy, lead the most complex architectural initiatives, and represent Acceldata in the global open-source and distributed systems community. You will work directly with engineering leadership and executives to shape product direction while driving innovation across the organization.
WHY JOIN US?As a Principal Engineer at Acceldata, you will be at the forefront of shaping the future of enterprise data platforms, defining the technical vision for systems that power mission-critical workloads across the world's largest organizations. Your decisions will directly influence not only our platform but also the broader data ecosystem through open-source contributions and industry leadership.
You’ll work alongside Apache members, committers, and industry veterans who are passionate about solving the hardest problems in distributed computing. This is a rare opportunity to combine deep technical impact with strategic influence, building technology that matters while shaping the direction of a growing data observability company.
RESPONSIBILITIES
Define and drive the long-term technical strategy and architecture for the Open Data Platform, aligning with business objectives and industry trends.
Own the design of the most complex, high-impact systems and establish architectural principles and patterns that scale across the organization.
Identify emerging technologies and industry trends;
lead research and development initiatives that position Acceldata at the cutting edge of data platform innovation.
Serve as a recognized leader in the open-source community;
drive Apache project contributions, represent Acceldata at conferences, and influence project roadmaps.
Collaborate with CTO, VP of Engineering, and Product leadership to translate business strategy into technical execution;
provide technical due diligence for strategic initiatives.
Influence engineering practices, tools, and culture across multiple teams;
establish best practices that elevate the entire engineering organization.
Mentor Staff Engineers and Senior Engineers;
develop technical leadership capabilities across the organization.
Lead resolution of the most challenging technical problems spanning architecture, performance, scalability, and reliability.
Engage with strategic customers and partners on complex technical discussions;
translate customer needs into platform capabilities.
Drive alignment across engineering, product, and operations on technical decisions with broad organizational impact.
Work across diverse environments: Bare Metals, VM, Kubernetes, multi-cloud, and hybrid architectures at enterprise scale.
REQUIREMENTS
12+ years of hands-on software development experience with at least 8 years focused on distributed systems, big data platforms, or data infrastructure.
Proven track record of leading large-scale technical initiatives from conception to production across multiple teams.
Expert-level proficiency in Java or Scala;
strong skills in Pythonand systems languages.
Deep expertise in distributed computing, including consensus protocols, distributed transactions, data replication, partitioning strategies, and optimization with modern table formats.
Extensive experience in architecting and scaling systems using Hadoop, Spark, Hive, Trino, Kafka, Flink, and related technologies at production scale (100s to 1000s of nodes).
Demonstrated ability to design and evolve complex systems that handle petabyte-scale data with high availability and performance requirements.
Expert knowledge of cloud-native architectures, Kubernetes orchestration, and multi-cloud deployment patterns.
Track record of diagnosing and resolving complex distributed system issues, including performance optimization, resource management, and failure mode analysis.
Significant contributions to major open-source projects;
experience working withdistributed global teams and open-source governance models.
Exceptional written and verbal communication skills;
proven ability to influence technical direction across organizations and with external stakeholders.
Ability to balance long-term technical vision with near-term delivery requirements;
experience making buildvs. buy decisions.
DESIRED BACKGROUND
PMC member or committer status in Apache projects (e.G., Spark, Kafka, Hive, Hadoop, Iceberg, Flink, Trino).
Speaker at major conferences (ApacheCon, Spark Summit, Kafka Summit, QCon, etc.);
published papers or widely-read technical content.
Experience building or contributing to query engines, optimizers, or execution frameworks.
Deep experience with modern lakehouse architectures, table formats (Iceberg, Delta, Hudi), and data mesh patterns.
Experience with ML infrastructure, feature stores, or MLOps platforms.
Experience scaling engineering organizations in high-growth environments.
Master's or PhD in Computer Science, with a focus on distributed systems, databases, or related fields.
$210,000 - $240,000 a year
At Acceldata,
we are committed to providing equal employment opportunities regardless of job history, disability, gender identity, religion, race, color, caste, marital/parental status, veteran status, or any other special status. We stand against the discrimination of employees and individuals and are proud to be an equitable workplace that welcomes individuals from all walks of life if they fit the designated roles and responsibilities.
#LifeAtAcceldata
is all about working with some of the best minds in the industry and experiencing a culture that values an ‘out-of-the-box’ mindset. If you want to push boundaries, learn continuously, and grow to be the best version of yourself, Acceldata is the place to be!
We also believe in providing our employees with the right tools and resources to help them excel at their jobs. We offer:
- PTO Plan with unlimited negative balance
- RRSP Plan
- Up to 100% employer-paid benefit options for health, dental, and vision coverage
- Supplemental Benefits
- Apple Air Mac Equipment
- Office gym access (includes workout equipment, basketball court, and showers)
- Becoming part of the team that coined the term “Data Observability”!
#J-18808-Ljbffr
Our Enterprise Data Observability Platform—the first of its kind—helps enterprises build and operate world-class data products by ensuring data is reliable, trusted, and ready to power today’s most critical technologies, including AI, LLMs, Analytics, and DataOps.
Delivered as a SaaS solution, Acceldata is trusted by leading global organizations such as HPE, HSBC, Visa, Freddie Mac, Manulife, Workday, Oracle, PubMatic, PhonePe (Walmart), Hershey’s, Dun & Bradstreet, and many more.
ABOUT USABOUT THE ROLEWe are seeking a Principal Engineer with at least 14 years of experience to serve as a technical visionary and thought leader for Acceldata's Open Data Platform (ODP). In this role, you will define the long-term technical strategy, lead the most complex architectural initiatives, and represent Acceldata in the global open-source and distributed systems community. You will work directly with engineering leadership and executives to shape product direction while driving innovation across the organization.
WHY JOIN US?As a Principal Engineer at Acceldata, you will be at the forefront of shaping the future of enterprise data platforms, defining the technical vision for systems that power mission-critical workloads across the world's largest organizations. Your decisions will directly influence not only our platform but also the broader data ecosystem through open-source contributions and industry leadership.
You’ll work alongside Apache members, committers, and industry veterans who are passionate about solving the hardest problems in distributed computing. This is a rare opportunity to combine deep technical impact with strategic influence, building technology that matters while shaping the direction of a growing data observability company.
RESPONSIBILITIES
Define and drive the long-term technical strategy and architecture for the Open Data Platform, aligning with business objectives and industry trends.
Own the design of the most complex, high-impact systems and establish architectural principles and patterns that scale across the organization.
Identify emerging technologies and industry trends;
lead research and development initiatives that position Acceldata at the cutting edge of data platform innovation.
Serve as a recognized leader in the open-source community;
drive Apache project contributions, represent Acceldata at conferences, and influence project roadmaps.
Collaborate with CTO, VP of Engineering, and Product leadership to translate business strategy into technical execution;
provide technical due diligence for strategic initiatives.
Influence engineering practices, tools, and culture across multiple teams;
establish best practices that elevate the entire engineering organization.
Mentor Staff Engineers and Senior Engineers;
develop technical leadership capabilities across the organization.
Lead resolution of the most challenging technical problems spanning architecture, performance, scalability, and reliability.
Engage with strategic customers and partners on complex technical discussions;
translate customer needs into platform capabilities.
Drive alignment across engineering, product, and operations on technical decisions with broad organizational impact.
Work across diverse environments: Bare Metals, VM, Kubernetes, multi-cloud, and hybrid architectures at enterprise scale.
REQUIREMENTS
12+ years of hands-on software development experience with at least 8 years focused on distributed systems, big data platforms, or data infrastructure.
Proven track record of leading large-scale technical initiatives from conception to production across multiple teams.
Expert-level proficiency in Java or Scala;
strong skills in Pythonand systems languages.
Deep expertise in distributed computing, including consensus protocols, distributed transactions, data replication, partitioning strategies, and optimization with modern table formats.
Extensive experience in architecting and scaling systems using Hadoop, Spark, Hive, Trino, Kafka, Flink, and related technologies at production scale (100s to 1000s of nodes).
Demonstrated ability to design and evolve complex systems that handle petabyte-scale data with high availability and performance requirements.
Expert knowledge of cloud-native architectures, Kubernetes orchestration, and multi-cloud deployment patterns.
Track record of diagnosing and resolving complex distributed system issues, including performance optimization, resource management, and failure mode analysis.
Significant contributions to major open-source projects;
experience working withdistributed global teams and open-source governance models.
Exceptional written and verbal communication skills;
proven ability to influence technical direction across organizations and with external stakeholders.
Ability to balance long-term technical vision with near-term delivery requirements;
experience making buildvs. buy decisions.
DESIRED BACKGROUND
PMC member or committer status in Apache projects (e.G., Spark, Kafka, Hive, Hadoop, Iceberg, Flink, Trino).
Speaker at major conferences (ApacheCon, Spark Summit, Kafka Summit, QCon, etc.);
published papers or widely-read technical content.
Experience building or contributing to query engines, optimizers, or execution frameworks.
Deep experience with modern lakehouse architectures, table formats (Iceberg, Delta, Hudi), and data mesh patterns.
Experience with ML infrastructure, feature stores, or MLOps platforms.
Experience scaling engineering organizations in high-growth environments.
Master's or PhD in Computer Science, with a focus on distributed systems, databases, or related fields.
$210,000 - $240,000 a year
At Acceldata,
we are committed to providing equal employment opportunities regardless of job history, disability, gender identity, religion, race, color, caste, marital/parental status, veteran status, or any other special status. We stand against the discrimination of employees and individuals and are proud to be an equitable workplace that welcomes individuals from all walks of life if they fit the designated roles and responsibilities.
#LifeAtAcceldata
is all about working with some of the best minds in the industry and experiencing a culture that values an ‘out-of-the-box’ mindset. If you want to push boundaries, learn continuously, and grow to be the best version of yourself, Acceldata is the place to be!
We also believe in providing our employees with the right tools and resources to help them excel at their jobs. We offer:
- PTO Plan with unlimited negative balance
- RRSP Plan
- Up to 100% employer-paid benefit options for health, dental, and vision coverage
- Supplemental Benefits
- Apple Air Mac Equipment
- Office gym access (includes workout equipment, basketball court, and showers)
- Becoming part of the team that coined the term “Data Observability”!
#J-18808-Ljbffr
Vacancy posted 56 minutes ago
Similar jobs that could be interesting for youBased on the Principal Engineer - Open Source Data Platform in Winnipeg, MB vacancy
$180k - $210k per year
ABOUT THE ROLEWe are seeking a Staff Engineer with at least 9 years of experience in distributed systems or data platform development. In this role, you will be a technical leader... ...of critical components within the Acceldata Open Data Platform (ODP). You will work on solving...Data- Advance Shopify’s Apache Flink platform through open source contribution, engine expertise, and infrastructure leadership at significant scale.As a Staff Engineer on Streaming Compute, you will push the core Flink ecosystem forward internally and in the open source community...Data
- Linux and Open Source Platform SpecialistWhen applicable, Bombardier promotes flexible and hybrid work policies. At Bombardier, we design,... ...availability, security, and lifecycle management. Platform Engineering & Implementation: Design, configure, implement, and...SuggestedFlexible hoursShift work
$100k - $140k per year
...the market leader in Enterprise Data Observability. Founded in 2018... ...Enterprise Data Observability Platform—the first of its kind—helps... ...are seeking a Senior Software Engineer with at least 7 years of experience... ...components of the Acceldata Open Data Platform (ODP),...DataWork at office- A leading data platform company in Canada is seeking a Senior Engineer to build and maintain their Boréal hosting platform and Moose open-source project. This role offers the chance to collaborate closely with product and design teams in a flexible, remote-first environment...DataRemote workFlexible hours
- ...organization committed to leveraging big data and advanced analytics to drive... ...innovation. We are seeking a highly experienced Principal Data Engineer to lead the design and implementation... ...possesses deep expertise in cloud platforms and big data technologies, with a proven...Data
- ...building features for the PennyLane framework, coordinating with Product Managers and cross-functional groups to deliver high-quality open-source software. Experience in quantum software is not required, but an advanced scientific degree is strongly preferred and you will be...
- Design open source software with Canonical as a remote Senior Engineer, using deep experience in Go, Rust, Python, or C. Lead architecture across global teams and time... ...Engineer track welcomes Senior, Staff, and Principal Engineers across Canonical teams. You will drive high...Remote workWorldwide
$196.6k - $258.1k per year
Principal Software Engineer, Data and AI PlatformsBusiness Unit: Store Support Centre (SSC) Time Type: Full-time Description & Requirementswho... ...for lululemon, owning and building the data and AI platforms and services that enable the enterprise to operate with intelligence...DataLong term contractPermanent employmentFull timePart timeLocal areaImmediate start- ...misspelled a variable? Do you like to work in an open and transparent environment? If so, our Open Source Software Release Engineer is likely the job for you!The Eclipse... ...working within the constraints of the General Data Protection Regulation (GDPR).About the Eclipse...DataRemote workWork from homeHome office
$195k - $235k per year
...revolutionizing how earth observation data is accessed and utilized globally. Our innovative platform empowers businesses, researchers... ...data from numerous satellite sources, offering unparalleled access... ...holds up, and you will lead the engineers who build it. The roleYou set...DataInternshipRemote workFlexible hours- As a Data Platform Engineer working in the Data Solutions group, you will play a key role in extending the capabilities, and improving the efficiency... ...of the platform via automated workflows, CI/CD, and sound source control practices. Pursue and promote platform engineering...DataSummer workFlexible hours
usd158k - usd238k per year
...SummaryThe Digital Information Security Engineering team is seeking a deeply... ...Operating System—a foundational platform that powers security services, automation, and data-driven decision-making across the... ...from diverse tools and data sources Design and build integrations...DataLong term contractFull timeWork at office- Support Ubuntu contributors remotely as a Community Engineer at Canonical, using Linux expertise and strong organizational skills to scale... ...Engineers across multiple seniority levels to facilitate open source community work. You will coordinate with developers, technical...Remote workWorldwide
- ...for a Senior Solutions Consultant with deep Hadoop knowledge and strong enterprise presence. You’ll be the principal technical owner of ODP (open data platform) deployments - responsible not just for standing up the platform, but for guiding a customer’s infrastructure,...DataLong term contractLocal area
- Microchip Technology Inc. seeks a Principle Engineer - Applications to join the DCS organization in Burnaby, Canada. You will lead platform enablement for Switchtec PCIe switch... ...and software integration expertise across data-center and AI platforms. You will collaborate...Data
- We are looking for a hands-on engineer who is equally comfortable building client data pipelines and writing production code... ...Finaptive's Data Integrations Platform, our cloud-based integration and... ...and Flask.Build and extend ERP and source-system connectors as reusable platform...Data
$150k per year
...recognized externally. Enabled by modern platforms and AI, you’ll do the most meaningful... ...to millions of records. As a Principal AI Platform Engineer, you will design and build the platform... ...evidence‑based answers grounded in case data. AI Accelerators. AI‑powered workflows...DataLong term contractLocal areaWorldwide$187k - $250k per year
...drive to push the boundaries of storytelling. Learn more.The Principal Software Engineer (Platform) provides the team with deep technical insight into the... ...and scalability requirementsCollaborate with vendors and open source communities to ensure that critical issues are solved...Long term contractTemporary workWorldwide- Open — Freshfields has a posting for this job. Posted 19 Oct 2026.About this job Overview of the FunctionWe are seeking an experienced and forward-thinking Senior Data Platform Engineer to manage, optimize, and evolve the cloud-native platforms used by the Data Office. The...DataManual laborWork at officeLocal area
- Drive Amazon Ads data platform delivery from Toronto, combining architecture depth, roadmap strategy, and program leadership across engineering teams.In this Principal Technical Program Manager role, you will guide programs behind Amazon Marketing Stream and Reporting APIs....Data
- ...Build and operate the data pipelines, warehouses, and transformation layers that form... ...clients. Quix is looking for a Data Platform Engineer to design and maintain the data infrastructure... ...pipelines from diverse enterprise sources: databases, APIs, event streams, and file...DataContract work
- ...Runkeeper app), and other exciting platforms that will help us better serve... ...are building our enterprise data platform from the ground up,... ...for a Senior Data Platform Engineer to partner directly with our Data... ...ability to translate complex source systems into clear architecture...DataWork at officeLocal areaRemote work
$93.5k - $108.5k per year
The Data Platform Engineer is a hands‑on, mid‑level role responsible for building, maintaining, and enhancing 360insights' Microsoft Fabric data... ...Analyze and validate transformed data against legacy reporting sources and document findings.Pipeline Operations & Platform...DataWorldwide- ...coding agents and developer tools as a Principal Software Engineer with OpenTable in Toronto, using cloud... ...found OpenTable’s Agentic Engineering Platform team within Product Engineering. The... ...Identify software delivery bottlenecks using data and direct observationBuild and...Data
- ...expanding telecommunications firm, is seeking a highly experienced Principal Data Engineer to establish and lead their data infrastructure initiatives.... ...ecosystem). Experience with cloud data services on platforms like AWS (Redshift, S3, Glue), Azure (Data Factory, Synapse)...DataRemote workHome office
- Set Android platform direction at COSMO through architecture, reliability, performance... ..., and security expertise in a remote engineering environment.As Principal Engineer, you will serve as the most... ...Binder, AIDL, drivers, and hardware data flowBring Android architecture,...DataRemote work
- ...industry. For more information, visit Shift4 is seeking a Data Platform Engineer to join our Data Platform team and build, maintain, and... ...MySQL into Snowflake, with plans to expand to additional data sources and consumers as our platform evolves. This is a hands‑on...DataInternshipLocal area
- Lead open-pit mine planning and optimization from G Mining Ventures’ Brossard office, with remote flexibility and international travel to South America.The Principal Mining Engineer provides senior technical leadership across gold operations, development projects, and growth...Work at officeRemote work
$135k - $165k per year
...strategic and detail-driven sourcing expert with experience across... ...partnering closely with hardware engineering, assay development, and... ...mitigate supply chain risks (single source, MOQs, component end-of-life,... ...management systems or ERP platforms. Advanced degree (MBA, MSc...Long term contractContract workWork from homeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal Engineer - Open Source Data Platform. Be the first to apply!
Related searches
- project engineer assistant project manager Winnipeg, MB
- chief engineer Winnipeg, MB
- director software engineering Winnipeg, MB
- engineering project manager Winnipeg, MB
- mechanical engineering project manager Winnipeg, MB
- mechanical engineering director Winnipeg, MB
- chief power engineer Winnipeg, MB
- directeur ingénierie Winnipeg, MB
- general engineer Winnipeg, MB
- data integration developer Winnipeg, MB

