Data Engineer

Temps plein

TechBiz Global GmbH

At TechBiz Global, we are providing recruitment service to our TOP clients from our portfolio. We are currently seeking an Data Engineer to join one of our clients ' teams. If you're looking for an exciting opportunity to grow in a innovative environment, this could be the perfect fit for you.

Key Responsibilities:

● Design, develop, and maintain data ingestion pipelines using Kafka Connect and

Debezium for real-time and batch data integration.

● Ingest data from MySQL and PostgreSQL databases into AWS S3, Google Cloud

Storage (GCS), and BigQuery.

● Implement best practices for data modeling, schema evolution, and efficient partitioning

in the Bronze Layer.

● Ensure reliability, scalability, and monitoring of Kafka Connect clusters and connectors.

● Collaborate with cross-functional teams to understand source systems and downstream

data requirements.

● Optimize data ingestion processes for performance and cost efficiency.

● Contribute to automation and deployment scripts using Python and cloud-native tools.

● Stay updated with emerging data lake technologies such as Apache Hudi or Apache

Iceberg.

Required Skills and Qualifications:

● 5+ years of hands-on experience as a Data Engineer or similar role.

● Strong experience with Apache Kafka and Kafka Connect (sink and source

connectors).

● Experience with Debezium for change data capture (CDC) from RDBMS.

● Proficiency in working with MySQL and PostgreSQL.

● Hands-on experience with AWS S3, GCP BigQuery, and GCS.

● Proficiency in Python for automation, data handling, and scripting.

● Understanding of data lake architectures and ingestion patterns.

● Solid understanding of ETL/ELT pipelines, data quality, and observability practices.

Good to Have:

● Experience with containerization (Docker, Kubernetes).

● Familiarity with workflow orchestration tools (Airflow, Dagster, etc.).

● Exposure to infrastructure-as-code tools (Terraform, CloudFormation).

● Familiarity with data versioning and table

Postuler

L'offre d'emploi a été publiée il y a 5 jours

Des emplois similaires qui pourraient vous intéresserBasé sur l'offre Data Engineer à à domicile

Platform Data Engineer
...Architect, optimize, and maintain scalable ETL/ELT pipelines, data lakes, and cloud data warehouses to support both internal analytics... ...contracts, and cataloging. Collaborate cross-functionally with engineers, product managers, and analysts to turn complex business needs into...
Suggéré
Travail d'été
Stage
Travail au bureau
Travail à distance
Horaires flexibles
PVcase
Remote
il y a 9 jours
Senior Data Engineer
...PART OF You would join the AI Automation team. They build the data infrastructure and AI foundations that power Adikteev's internal... ...of our tech team, Team fit Interview with Aldenis, VP of Engineering and Lamyaa, Engineering Team lead, Final interview with Cédric...
Suggéré
Emploi permanent
Temps plein
Stage
Zone locale
Travail à distance
Horaires flexibles
2 jours par semaine
1 jour par semaine
Adikteev
Remote
il y a 11 jours
Data Engineer (Databricks)
...Addepto is a leading AI consulting () and data engineering () company that builds scalable, ROI-focused AI solutions for some of the world's largest enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. With an exclusive focus on Artificial...
Suggéré
Contrat Longue Durée
Emploi permanent
Temps plein
Stage
Travail à distance
Horaires flexibles
Addepto
Remote
il y a 16 jours
Senior Data Analytics Engineer
...Platform for Transformative Brand Growth. We’re building the AI Growth Engine that powers the next generation of consumer brands. With over $... ...Job Responsibilities This role sits at the intersection of data engineering, analytics, business intelligence, and machine...
Suggéré
Emploi permanent
Temps plein
Travail à distance
Trafilea
Remote
il y a 4 jours
Data Engineer Semi Senior
...Buscamos un Data Engineer con sólida experiencia en el ecosistema de Google Cloud Platform, capaz de diseñar, desarrollar y mantener pipelines de datos robustos y escalables. El rol implica trabajar en proyectos de implementación donde la calidad, trazabilidad y eficiencia...
Suggéré
Emploi permanent
Temps plein
Join ready
Remote
il y a 2 jours
Data Engineer
...Job Description Job Description Hybrid Hadoop Engineer and Hadoop Infrastructure Administrator to build and maintain a scalable and resilient Big Data framework to support Data Scientists. As an administrator, your responsibility will be to deploy and maintain Hadoop clusters...
I-cube Software Llc
Remote
il y a 22 jours
Software Engineer - Market Data
...Responsibilities Design highly scalable, mission-critical market-data provider services. Build and productionize services and libraries for Alpaca’s streaming and historical market-data APIs. Maintain software quality and test coverage. Participate in code reviews...
Temps plein
Bureau à domicile
Alpaca
Remote
il y a 10 jours
Senior Data Engineer
...Deep Digital are seeking a highly skilled and experienced Senior Data Engineer with a proven track record in successfully implementing, optimizing, and maintaining the data integration and historian systems. The ideal candidate will possess in-depth knowledge of industrial...
Emploi permanent
Temps plein
Travail à distance
Deep DSG
Remote
il y a 12 jours
Data Engineer
...Data Engineer at Support test account - Optimize We are seeking a talented Data Engineer to join our team at Support test account - Optimize. As a Data Engineer, you will be responsible for designing, developing, and maintaining our data infrastructure to ensure optimal performance...
Emploi permanent
Temps partiel
Support test account - Optimize
Remote
Il y a un mois
Data Engineer, Security
$115.3k - $144.1k par année
...Opportunities to make an impact with bold thinking are real—and happening daily at Coalition. About the role We are hiring a Data Engineer to build our data platform across our Cyber Security value chain. This includes Security and Sales management. You will be the go-...
Temps plein
Emploi en cdd
Travail au bureau
Travail à distance
Bureau à domicile
Horaires flexibles
Coalition, Inc.
Remote
il y a 23 jours
Principal Engineer - Platform & Data
...you no matter what. The Role_ // We’re looking for a Principal Engineer to join Masabi’s Architecture team. This is a senior role for... ...most. A particular focus for this role is strengthening our data architecture, how we structure, use and build on the data our platform...
Temps plein
Stage
Travail au bureau
Travail à distance
Bureau à domicile
Masabi
Remote
il y a 19 jours
Data & Insights Engineer, Customer Solutions
...decisions using reliable, accessible and carefully curated product data. Every day, we collect, standardize and deliver large-scale... ...using it. About the role We are hiring a Data & Insights Engineer – Customer Solutions for a hands-on, customer-facing role bridging...
Emploi permanent
Temps plein
Travail à distance
Horaires flexibles
Daltix
Remote
il y a 4 jours
Databricks Data Engineer / Developer
...HAVE atleast 3+ years of hands-on Databricks development experience. Overview Our consulting client is seeking a Databricks Data Engineer / Developer to support a strategic Enterprise Data Platform (EDP) transformation initiative. The organization is modernizing its...
Temps plein
Сontrat
Emploi en cdd
Recrutement immédiat
Travail à distance
Paralucent
Remote
il y a 24 jours
Staff Software Engineer, Data Platform
...industry-leading safety standards and years of proven deployment data, we're pioneering a new era of automation that enhances human potential... ...that powers fleet-scale humanoid robotics. As a Staff Software Engineer on our Data Platform team, you will play a pivotal role in...
Contrat Longue Durée
Temps plein
Travail temporaire
Travail à distance
Programme de réinstallation
Horaires flexibles
Agility Robotics
Remote
il y a 12 jours
Data Engineer
...Maybe you call yourself a Data Engineer or a Data Specialist or a BI Developer or a Data Architect or an Azure Developer, or maybe you just call yourself Alex? This vacancy is part of our Delivery team and applies to all the above titles. What you get ~ A salary between...
Emploi permanent
Temps plein
Сontrat
Stage
Zone locale
Travail à distance
Bureau à domicile
All Your BI
Remote
il y a 6 jours
Staff Software Engineer, Data Platform
...Responsibilities Design and implement scalable pipelines for telemetry, logs, sensor data, and cloud-software ingestion and processing. Develop and maintain robot-side data ingestion agents for high-volume collection in low-connectivity environments. Develop data formats...
Contrat Longue Durée
Temps plein
Travail temporaire
Travail à distance
Programme de réinstallation
Horaires flexibles
Agility Robotics
Remote
il y a 13 jours
Staff Software Engineer - Data Platform
$135.8k - $169.7k par année
...publishing using Pantheon’s collaborative workflows. The Role The Data Platform team powers Pantheon’s data infrastructure and delivers... ...-wide access to data — and we’re looking for a Staff Software Engineer to take it to the next level. In this role, you’ll extend the...
Temps plein
Travail au bureau
Zone locale
Horaires flexibles
Pantheon
Remote
il y a 18 jours
Data Scientist / AI Engineer
...Addepto is a leading AI consulting () and data engineering () company that builds scalable, ROI-focused AI solutions for some of the world's... ...are seeking talented individuals to join: AI optimization engine for airport operation management. This project involves creating...
Contrat Longue Durée
Emploi permanent
Temps plein
Travail à distance
Horaires flexibles
Addepto
Remote
il y a 21 heures
Data Engineer (Spark)
...Addepto is a leading AI consulting () and data engineering () company that builds scalable, ROI-focused AI solutions for some of the world's largest enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. With an exclusive focus on Artificial...
Contrat Longue Durée
Emploi permanent
Temps plein
Stage
Travail à distance
Horaires flexibles
Addepto
Remote
il y a 9 jours
Senior Data Engineer
...Maybe you call yourself a Senior Data Engineer or an Azure wrangler, a Databricks whisperer, a senior "works-on-my-cluster" engineer… or maybe you just call yourself Sam. Whatever you call yourself, you'll join our Delivery team and build the data platforms our clients actually...
Emploi permanent
Temps plein
Сontrat
Zone locale
Travail à distance
Bureau à domicile
All Your BI
Remote
il y a 17 jours
Senior Data Engineer & Data Architect
...At TechBiz Global, we are providing recruitment service to our TOP clients from our portfolio. We are currently seeking a Senior Data Engineer Data Architect to join one of our clients ' teams. If you're looking for an exciting opportunity to grow in a innovative environment...
TechBiz Global GmbH
Remote
il y a 25 jours
Senior AI Data Engineer
...we are providing recruitment service to our TOP clients from our portfolio. We are currently looking for a dedicated Senior AI Data Engineer to join one of our clients' teams . If you're looking for an exciting opportunity to grow in an innovative environment, this...
Emploi permanent
Temps plein
TechBiz Global GmbH
Remote
il y a 12 jours
Senior Data Platform Engineer
$127k - $164k par année
...depend on physical operations to harness Internet of Things (IoT) data to develop actionable insights and improve their operations. At... ...for the long term. About the role The Integrations, Data Engineering and AI (IDEA) team within Samsara’s Business Technology organization...
Travail à distance
Contrat Longue Durée
Temps plein
Stage
Horaires flexibles
Samsara
Remote
Il y a 2 mois
Data Engineer (Adobe AEP)
...At TechBiz Global, we are providing recruitment service to our TOP clients from our portfolio. We are currently seeking a Data Engineer (Adobe AEP) to join one of our clients ' teams. If you're looking for an exciting opportunity to grow in a innovative environment, this...
Emploi permanent
Temps plein
TechBiz Global GmbH
Remote
il y a 11 jours
Data Engineer & BI Solution Expert
...Worum geht es: Als Data Engineer & BI Solution Expert unterstützt du Kunden dabei, aus Daten echte Klarheit zu gewinnen, nicht nur schöne Reports. Du bringst Daten zusammen, machst sie nutzbar und baust Lösungen, die im Alltag funktionieren, nicht nur im Konzept. Dabei...
Emploi permanent
Temps plein
Travail à distance
Bureau à domicile
Horaires flexibles
Experts Inside
Remote
il y a 18 jours
LT Data Integration Engineer + Inglés
...LT Data Integration Engineer En Ready Buscamos un(a) LT Data Integration Engineer con experiencia en el diseño, desarrollo y operación de soluciones de integración de datos empresariales utilizando Informatica Intelligent Data Management Cloud (IDMC) como plataforma principal...
Emploi permanent
Temps plein
Pour les contractants
Freelance
Travail à distance
Lundi au vendredi
Join ready
Remote
il y a 2 jours
Data Engineer junior (con Experiencia) (Chile- Perú)
...Estamos en búsqueda de un Data Engineer con 2+ años de experiencia para un proyecto internacional enfocado en el desarrollo y modernización de soluciones de datos. Buscamos un profesional con experiencia en procesamiento de datos, desarrollo de pipelines y plataformas de...
Temps plein
Pour les contractants
Freelance
Travail à distance
Lundi au vendredi
Join ready
Remote
il y a 1 jour
Data Developer
...utilities modernize the way they serve their communities. As a Data Developer, you’ll play an important role in turning data into meaningful... ...updated with emerging technologies and best practices in data engineering, reporting, and analytics What You Bring: Bachelor's...
Travail à distance
Horaires flexibles
SpryPoint
Remote
il y a 7 jours
Principal Data Architect
$180k - $220k par année
...Job Responsibility: OpsGuru, a Carbon60 Company, is a global engineering and consulting group specializing in data, machine learning/artificial intelligence, and cloud-native technologies. We empower customers by leveraging technology to solve their unique business challenges...
Contrat Longue Durée
Temps plein
Stage
Travail à distance
Horaires flexibles
Carbon60
Remote
il y a 8 jours
Data Scientist / Machine Learning H/F
...international portfolio. We are currently looking for a Senior Data Scientist with strong hands-on experience in training AI models,... ...used throughout the model-training process. Collaborate with engineering, data, and business teams to move models from experimentation into...
Emploi permanent
Temps plein
TechBiz Global GmbH
Remote
il y a 25 jours

Voulez-vous recevoir plus d'offres d'emploi ?

S'abonner et recevoir des offres d'emploi similaires à Data Engineer. Soyez parmi les premiers à postuler !

Recherches connexes