Apache Iceberg Platform Engineer
Hyve Solutions
Apache Iceberg, Spark, and object storage are central to this Data Warehouse System Engineer position at Hyve Solutions. Build enterprise Lakehouse capabilities.As an experienced Data Platform Engineer, you will modernize traditional Hadoop and Hive architecture into a cloud-native platform. Your focus is platform engineering, including metadata, catalogs, governance, and unified access across processing engines. You will address scalability, concurrency, performance, and operational stability in petabyte-scale environments.Key Responsibilities:
Build Lakehouse services supporting batch and streaming workloadsImplement compute-storage separation at enterprise scaleEnable access through Spark, Flink, and TrinoIntegrate Azure, Databricks, and Snowflake ecosystemsCreate ingestion, orchestration, quality, and diagnostic toolsRequirements:
Deep understanding of Iceberg metadata and snapshotsExperience with Spark, Kubernetes, and resource schedulingKnowledge of Azure Blob, Amazon S3, or MinIOProgramming skills in Java, Scala, or PythonBachelor’s or Master’s degree in a technical fieldUse Apache Iceberg, Spark, cloud storage, and platform engineering skills to advance Hyve Solutions’ enterprise data architecture.
#J-18808-Ljbffr
Build Lakehouse services supporting batch and streaming workloadsImplement compute-storage separation at enterprise scaleEnable access through Spark, Flink, and TrinoIntegrate Azure, Databricks, and Snowflake ecosystemsCreate ingestion, orchestration, quality, and diagnostic toolsRequirements:
Deep understanding of Iceberg metadata and snapshotsExperience with Spark, Kubernetes, and resource schedulingKnowledge of Azure Blob, Amazon S3, or MinIOProgramming skills in Java, Scala, or PythonBachelor’s or Master’s degree in a technical fieldUse Apache Iceberg, Spark, cloud storage, and platform engineering skills to advance Hyve Solutions’ enterprise data architecture.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Apache Iceberg Platform Engineer in Winnipeg, MB vacancy
- ...scale, with deep collaboration across AWS partner teams and the Iceberg community. You will shape architecture for distributed systems,... ...mentor a diverse team while partnering with product and analytics leadership to align customer needs with engineering #J-18808-LjbffrSuggested
- Apache Kafka and Python expertise define this Engineer role supporting distributed systems in an Investment Banking environment. Linux and Grafana skills are central... ...Python automation and utility scriptsMonitor platform health using GrafanaResolve production issues across...Suggested
- Design scalable Apache Kafka messaging solutions with Python automation and Grafana monitoring for Tata Consultancy Services in Canada. Support enterprise streaming platforms.As a Kafka Engineer, you will develop, deploy, and maintain messaging and streaming solutions across...Suggested
- Work with Apache DataFusion and Rust at UrbanLogiq, building governed data infrastructure... ...arrangement.UrbanLogiq seeks a senior systems engineer to develop infrastructure for public-... ...to strengthen UrbanLogiq’s transparent government data platform. #J-18808-LjbffrSuggested
- Hyve Solutions is seeking an experienced Data Warehouse SE to evolve our data platform from Hadoop to a cloud-native Lakehouse built on Apache Iceberg. You will focus on platform engineering, running large-scale data infrastructure, not just pipelines, with emphasis on Spark...Suggested
- ...Build scalable machine learning platforms at PointClickCare using Python, Java, and MLOps expertise. This role supports AI products across healthcare. As a Senior Machine Learning Systems Engineer, you will design, build, and operate platform capabilities for model development...
- ...applications and next steps. Our partner is looking for a Senior Data Platform Engineer based in Canada. The Senior Data Platform Engineer will play... ...as Trino, Presto, or Spark, and open table formats such as Apache Iceberg. Familiarity with streaming and real‑time data...Remote workHome office
- ...Nous sommes à la recherche d’un Développeur spécialisé Apache NiFi pour plateforme de données dont le rôle sera de contribuer à la mise en place, au développement et à la modernisation de la plateforme. Description du poste Le ou la titulaire du poste contribue à la mise...Weekend workAfternoon shift
- ...seeking a highly motivated and experienced Software Engineer with strong expertise in Core Java, Apache Spark, Python, SQL, and Linux to design, develop, and... ...high-performance applications, integrating analytical platforms, and working with large-scale data processing frameworks...
- ...annual growth rate exceeds 25%. Job Description We are looking for a Senior Routing Engine Developer to design and build the next generation interaction routing platform powering enterprise-scale contact center operation. You will develop the core routing engine...Full timeInternshipRemote workRelocation
- ...industry. For more information, visit Shift4 is seeking a Data Platform Engineer to join our Data Platform team and build, maintain, and... ...) and MySQL Binlog replication Message brokers beyond SQS: Apache Kafka/Confluent, RabbitMQ Elastic Stack or time‑series...InternshipLocal area
- ...ASICS Runkeeper app), and other exciting platforms that will help us better serve the endurance... ...are looking for a Senior Data Platform Engineer to partner directly with our Data... ...file and execution formats like Parquet , Apache Arrow , and DuckDB . ~ Python tooling ecosystem...Work at officeLocal areaRemote work
- ...growth product company building the data platform behind a modern telematics API, supporting... ...The RoleThis is not a traditional data engineering seat; you will own the long-term buildout... ...and streaming ecosystems such as Iceberg or Delta, plus Kafka or Flink or Spark...Long term contract
- Intégrez des applications avec Apache et Tomcat à Saint-Denis, en assurant déploiements, automatisation et exploitation technique. Jusqu’à dix jours de télétravail mensuel sont autorisés depuis la France métropolitaine.Ce poste confirmé intervient au sein d’une équipe d’intégration...Remote work
- ...seeking a visionary and highly technical Senior Data Platform Engineer to architect, implement, scale, and maintain the data engine powering our next-generation frontier models.... ..., with recent experience using e.G. Ray, Apache Spark, workflow orchestrators, Apache Arrow, and...
- ...FunctionWe are seeking an experienced and forward-thinking Senior Data Platform Engineer to manage, optimize, and evolve the cloud-native platforms... ..., GitHub Actions, or equivalent tooling.Experience with dbt, Apache Airflow, Azure Event Hubs, Spark Structured Streaming, or...Manual laborWork at officeLocal area
- Senior Java development and Apache Spark expertise define this software development role, focused on scalable data processing solutions and ETL pipelines.With 10+ years of software development experience, you will build Java-based Spark applications. The work requires Java 8...
- Build Dialogue’s modern data platform with Python and Snowflake while shaping scalable data... ...sourcesOrchestrate resilient pipelines with Apache AirflowDefine modelling, semantic layer,... ...experienceBring senior data platform engineering, Snowflake, Airflow, and Python expertise...
- ...applications and next steps. Our partner is looking for a Senior Data Engineer – Data Platform based in Canada.As a Senior Data Engineer – Data Platform,... ...and data products using Databricks, Python, SQL, and Apache Spark. Working with Data Vault 2.0 and dbt Core, you will...Contract workFixed term contractImmediate startRemote workWorldwide
$100k - $120k per year
...Required skill set \"Skills and Responsibilities Platform Engineer We are seeking a highly skilled and experienced Platform Engineer with strong DevOps and Site Reliability Engineering (SRE) expertise to join our technology team. The ideal candidate will be responsible...- Join a purpose driven winning team, committed to results, in an inclusive and high‑performing culture. The Platform Engineer will play a critical role within the Enterprise Data & AI Technology organization - one of Scotiabank’s most significant enterprise‑wide strategic...Flexible hoursWeekend work
$86.1k - $136.1k per year
Platform EngineerAre you passionate about building reliable, scalable cloud platforms and automating the infrastructure that powers modern applications? We’re looking for a Platform Engineer who enjoys solving complex infrastructure challenges, improving developer experiences...Long term contractTemporary workLocal area- ..., we believe that together, we can move faster, dream bigger, and build better tomorrows for all. We’re looking for a Senior Platform Engineer to join a North America-based team focused on delivering secure, scalable automation and cloud platforms. This role is about enabling...InternshipWork at office
- ...We are seeking an experienced and motivated engineer to join the Observability fleet which focuses on delivering tools in private and public... .... The role focuses on developing and modernizing Observability platforms for cloud-native and hybrid applications. This role involves...
$120k - $140k per year
Job DescriptionOwn and improve components of our internal developer platform. Use strong engineering fundamentals and AI coding agents to deliver useful, tested changes at pace. Make common development and operational tasks self-service, and support the services you build in...Permanent employment$100k - $160k per year
...needed to enjoy the game. For more information, visit xsolla.Com.Qualifications & Skills 4 to 7 years of experience as a DevOps/SRE/Platform engineerExtensive experience with LinuxExtensive experience with container orchestration using KubernetesExperience with Self-hosted...$86.1k - $136.1k per year
...Platform Engineer Are you passionate about building reliable, scalable cloud platforms and automating the infrastructure that powers modern applications? We’re looking for a Platform Engineer who enjoys solving complex infrastructure challenges, improving developer...Local area- Snowflake and Terraform expertise define this Senior Data Platform Engineer role with Zonda in Toronto, Ontario, focused on production data platforms... ...platform capabilities across Snowflake, AWS, dbt, and Apache Airflow. The work establishes safer deployments, reusable automation...
- Lead Databricks data platform architecture at ShyftLabs from our downtown Toronto office three... ...Spark and Python.As a Senior / Lead Data Engineer, you will guide enterprise-scale... ...for Fortune 500 clients. Apply Databricks, Apache Spark, Python, SQL, Delta Lake, and cloud...Work at office
$100k - $120k per year
...inception in 1968, TCS has upheld the highest standards of innovation, engineering excellence and customer service.It has set an aspiration to... ...Overview We are seeking a highly skilled and experienced Platform Engineer with strong expertise in DevOps, Site...Long term contractWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Apache Iceberg Platform Engineer. Be the first to apply!

