Data Engineer Pipelines And Lakehouses
Sarsfield Group
Build scalable data pipelines and lakehouse systems at Spade Technologies, Inc., with Manitoba preferred and all locations considered. Work full time.As a Data Engineer reporting to the CTO, you will own ingestion pipelines, data models, and infrastructure. You will support herd, feed, financial, and operational datasets for farmer-facing and enterprise products. Your work will focus on reliable, secure, performant data systems.Key Responsibilities:
Design scalable batch and streaming ingestion pipelinesImplement ETL/ELT workflows and validation layersDevelop unified models for herd and financial datasetsManage modern data lake complexity, including Iceberg and DatabricksPrepare data for ML and AI systemsRequirements:
Four or more years of production data engineering experienceExpertise with Databricks, Airflow, dbt, Spark, or similarExperience managing warehouses or lakehousesHands-on AWS, GCP, or Azure infrastructure experienceKnowledge of structured and semi-structured data formatsApply data modeling, cloud infrastructure, and pipeline expertise to strengthen Spade’s food data platform.
#J-18808-Ljbffr
Design scalable batch and streaming ingestion pipelinesImplement ETL/ELT workflows and validation layersDevelop unified models for herd and financial datasetsManage modern data lake complexity, including Iceberg and DatabricksPrepare data for ML and AI systemsRequirements:
Four or more years of production data engineering experienceExpertise with Databricks, Airflow, dbt, Spark, or similarExperience managing warehouses or lakehousesHands-on AWS, GCP, or Azure infrastructure experienceKnowledge of structured and semi-structured data formatsApply data modeling, cloud infrastructure, and pipeline expertise to strengthen Spade’s food data platform.
#J-18808-Ljbffr
Vacancy posted more than 2 months ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer Pipelines And Lakehouses. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
- junior data engineer Winnipeg, MB
