Apache Iceberg Platform Engineer
Hyve Solutions
Apache Iceberg, Spark, and object storage are central to this Data Warehouse System Engineer position at Hyve Solutions. Build enterprise Lakehouse capabilities.As an experienced Data Platform Engineer, you will modernize traditional Hadoop and Hive architecture into a cloud-native platform. Your focus is platform engineering, including metadata, catalogs, governance, and unified access across processing engines. You will address scalability, concurrency, performance, and operational stability in petabyte-scale environments.Key Responsibilities:
Build Lakehouse services supporting batch and streaming workloadsImplement compute-storage separation at enterprise scaleEnable access through Spark, Flink, and TrinoIntegrate Azure, Databricks, and Snowflake ecosystemsCreate ingestion, orchestration, quality, and diagnostic toolsRequirements:
Deep understanding of Iceberg metadata and snapshotsExperience with Spark, Kubernetes, and resource schedulingKnowledge of Azure Blob, Amazon S3, or MinIOProgramming skills in Java, Scala, or PythonBachelor’s or Master’s degree in a technical fieldUse Apache Iceberg, Spark, cloud storage, and platform engineering skills to advance Hyve Solutions’ enterprise data architecture.
#J-18808-Ljbffr
Build Lakehouse services supporting batch and streaming workloadsImplement compute-storage separation at enterprise scaleEnable access through Spark, Flink, and TrinoIntegrate Azure, Databricks, and Snowflake ecosystemsCreate ingestion, orchestration, quality, and diagnostic toolsRequirements:
Deep understanding of Iceberg metadata and snapshotsExperience with Spark, Kubernetes, and resource schedulingKnowledge of Azure Blob, Amazon S3, or MinIOProgramming skills in Java, Scala, or PythonBachelor’s or Master’s degree in a technical fieldUse Apache Iceberg, Spark, cloud storage, and platform engineering skills to advance Hyve Solutions’ enterprise data architecture.
#J-18808-Ljbffr
Vacancy posted 52 minutes ago
Similar jobs that could be interesting for youBased on the Apache Iceberg Platform Engineer in Winnipeg, MB vacancy
- ...scale, with deep collaboration across AWS partner teams and the Iceberg community. You will shape architecture for distributed systems,... ...mentor a diverse team while partnering with product and analytics leadership to align customer needs with engineering #J-18808-LjbffrSuggested
- Design scalable Apache Kafka messaging solutions with Python automation and Grafana monitoring for Tata Consultancy Services in Canada. Support enterprise streaming platforms.As a Kafka Engineer, you will develop, deploy, and maintain messaging and streaming solutions across...Suggested
- Apache Kafka and Python expertise define this Engineer role supporting distributed systems in an Investment Banking environment. Linux and Grafana skills are central... ...Python automation and utility scriptsMonitor platform health using GrafanaResolve production issues across...Suggested
- Work with Apache DataFusion and Rust at UrbanLogiq, building governed data infrastructure... ...arrangement.UrbanLogiq seeks a senior systems engineer to develop infrastructure for public-... ...to strengthen UrbanLogiq’s transparent government data platform. #J-18808-LjbffrSuggested
- ...Shape backend platforms for EA game development with C#/.NET, RESTful APIs, and scalable systems in a hybrid collaborative environment. This experienced Software Engineer III joins Electronic Arts’ Quality Verification and Standards team. You will lead backend components...SuggestedFull time
- Hyve Solutions is seeking an experienced Data Warehouse SE to evolve our data platform from Hadoop to a cloud-native Lakehouse built on Apache Iceberg. You will focus on platform engineering, running large-scale data infrastructure, not just pipelines, with emphasis on Spark...
- ...Nous sommes à la recherche d’un Développeur spécialisé Apache NiFi pour plateforme de données dont le rôle sera de contribuer à la mise en place, au développement et à la modernisation de la plateforme. Description du poste Le ou la titulaire du poste contribue à la mise...Weekend workAfternoon shift
$200k - $255k per year
...Intact Insurance, depend on our platform to access GPS, speeding, and... ...the roleWe're looking for an engineer who thrives on building scalable... ...storage) Lakehouse storage (Iceberg, Delta, Paimon, Doris).... ...AWS S3, Postgres, DynamoDB, Apache Doris, Apache Iceberg, Redis...InternshipWork at officeFlexible hours- ...Build scalable machine learning platforms at PointClickCare using Python, Java, and MLOps expertise. This role supports AI products across healthcare. As a Senior Machine Learning Systems Engineer, you will design, build, and operate platform capabilities for model development...
- ...applications and next steps. Our partner is looking for a Senior Data Platform Engineer based in Canada. The Senior Data Platform Engineer will play... ...as Trino, Presto, or Spark, and open table formats such as Apache Iceberg. Familiarity with streaming and real‑time data...Remote workHome office
$139k - $257.55k per year
Senior Software Engineer – Adobe Real-Time Customer Data PlatformDrive... .... Our Real-Time Customer Data Platform (RTCDP) processes trillions of... ...Frameworks: Spring Boot, Apache Spark, Apache Flink Data Infrastructure... ...systems, Delta Lake, Apache Iceberg, Snowflake Cloud & Infra:...Long term contractTemporary workLocal areaWorldwideFlexible hours- ...We are looking for a Senior Routing Engine Developer to design and build the next generation interaction routing platform powering enterprise-scale contact center operation. You will develop the core routing engine responsible for intelligent distribution of voice and digital...InternshipRemote workRelocation
- ...industry. For more information, visit Shift4 is seeking a Data Platform Engineer to join our Data Platform team and build, maintain, and... ...) and MySQL Binlog replication Message brokers beyond SQS: Apache Kafka/Confluent, RabbitMQ Elastic Stack or time‑series...InternshipLocal area
- ...seeking a highly motivated and experienced Software Engineer with strong expertise in Core Java, Apache Spark, Python, SQL, and Linux to design, develop, and... ...high-performance applications, integrating analytical platforms, and working with large-scale data processing frameworks...
- Senior Java development and Apache Spark expertise define this software development role, focused on scalable data processing solutions and ETL pipelines.With 10+ years of software development experience, you will build Java-based Spark applications. The work requires Java 8...
- ...growth product company building the data platform behind a modern telematics API, supporting... ...The RoleThis is not a traditional data engineering seat; you will own the long-term buildout... ...and streaming ecosystems such as Iceberg or Delta, plus Kafka or Flink or Spark...Long term contract
- ...ASICS Runkeeper app), and other exciting platforms that will help us better serve the endurance... ...are looking for a Senior Data Platform Engineer to partner directly with our Data... ...file and execution formats like Parquet , Apache Arrow , and DuckDB . ~ Python tooling ecosystem...Work at officeLocal areaRemote work
- Intégrez des applications avec Apache et Tomcat à Saint-Denis, en assurant déploiements, automatisation et exploitation technique. Jusqu’à dix jours de télétravail mensuel sont autorisés depuis la France métropolitaine.Ce poste confirmé intervient au sein d’une équipe d’intégration...Remote work
- ...technical Senior DataPlatform Engineer to architect, implement, scale, and maintain the data engine powering our next-generation... ...engineering, treating the data platform as an internal product with our... ...recent experience using e.g. Ray, Apache Spark, workflow orchestrators,...
- ...applications and next steps. Our partner is looking for a Senior Data Engineer – Data Platform based in Canada.As a Senior Data Engineer – Data Platform,... ...and data products using Databricks, Python, SQL, and Apache Spark. Working with Data Vault 2.0 and dbt Core, you will...Contract workFixed term contractImmediate startRemote workWorldwide
- ...FunctionWe are seeking an experienced and forward-thinking Senior Data Platform Engineer to manage, optimize, and evolve the cloud-native platforms... ..., GitHub Actions, or equivalent tooling.Experience with dbt, Apache Airflow, Azure Event Hubs, Spark Structured Streaming, or...Manual laborWork at officeLocal area
- ...applications and next steps. Our partner is looking for a Senior Platform Engineer (Crossplane) based in Canada. The Senior Platform Engineer... ...with large-scale data platforms and technologies such as Apache Kafka, Apache Flink, or Apache Spark. Production experience...Long term contractRemote work
$100k - $120k per year
...Required skill set \"Skills and Responsibilities Platform Engineer We are seeking a highly skilled and experienced Platform Engineer with strong DevOps and Site Reliability Engineering (SRE) expertise to join our technology team. The ideal candidate will be responsible...$100k - $160k per year
...needed to enjoy the game. For more information, visit xsolla.Com.Qualifications & Skills 4 to 7 years of experience as a DevOps/SRE/Platform engineerExtensive experience with LinuxExtensive experience with container orchestration using KubernetesExperience with Self-hosted...$86.1k - $136.1k per year
Platform EngineerAre you passionate about building reliable, scalable cloud platforms and automating the infrastructure that powers modern applications? We’re looking for a Platform Engineer who enjoys solving complex infrastructure challenges, improving developer experiences...Long term contractTemporary workLocal area- Build Dialogue’s modern data platform with Python and Snowflake while shaping scalable data... ...sourcesOrchestrate resilient pipelines with Apache AirflowDefine modelling, semantic layer,... ...experienceBring senior data platform engineering, Snowflake, Airflow, and Python expertise...
- ...We are seeking an experienced and motivated engineer to join the Observability fleet which focuses on delivering tools in private and public... .... The role focuses on developing and modernizing Observability platforms for cloud-native and hybrid applications. This role involves...
$86.1k - $136.1k per year
...Platform Engineer Are you passionate about building reliable, scalable cloud platforms and automating the infrastructure that powers modern applications? We’re looking for a Platform Engineer who enjoys solving complex infrastructure challenges, improving developer...Local area$120k - $140k per year
Job DescriptionOwn and improve components of our internal developer platform. Use strong engineering fundamentals and AI coding agents to deliver useful, tested changes at pace. Make common development and operational tasks self-service, and support the services you build in...Permanent employment- Lead Databricks data platform architecture at ShyftLabs from our downtown Toronto office three... ...Spark and Python.As a Senior / Lead Data Engineer, you will guide enterprise-scale... ...for Fortune 500 clients. Apply Databricks, Apache Spark, Python, SQL, Delta Lake, and cloud...Work at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Apache Iceberg Platform Engineer. Be the first to apply!

