Data Engineer Pipelines And Lakehouses
Sarsfield Group
Build scalable data pipelines and lakehouse systems at Spade Technologies, Inc., with Manitoba preferred and all locations considered. Work full time.As a Data Engineer reporting to the CTO, you will own ingestion pipelines, data models, and infrastructure. You will support herd, feed, financial, and operational datasets for farmer-facing and enterprise products. Your work will focus on reliable, secure, performant data systems.Key Responsibilities:
Design scalable batch and streaming ingestion pipelinesImplement ETL/ELT workflows and validation layersDevelop unified models for herd and financial datasetsManage modern data lake complexity, including Iceberg and DatabricksPrepare data for ML and AI systemsRequirements:
Four or more years of production data engineering experienceExpertise with Databricks, Airflow, dbt, Spark, or similarExperience managing warehouses or lakehousesHands-on AWS, GCP, or Azure infrastructure experienceKnowledge of structured and semi-structured data formatsApply data modeling, cloud infrastructure, and pipeline expertise to strengthen Spade’s food data platform.
#J-18808-Ljbffr
Design scalable batch and streaming ingestion pipelinesImplement ETL/ELT workflows and validation layersDevelop unified models for herd and financial datasetsManage modern data lake complexity, including Iceberg and DatabricksPrepare data for ML and AI systemsRequirements:
Four or more years of production data engineering experienceExpertise with Databricks, Airflow, dbt, Spark, or similarExperience managing warehouses or lakehousesHands-on AWS, GCP, or Azure infrastructure experienceKnowledge of structured and semi-structured data formatsApply data modeling, cloud infrastructure, and pipeline expertise to strengthen Spade’s food data platform.
#J-18808-Ljbffr
Vacancy posted 57 minutes ago
Similar jobs that could be interesting for youBased on the Data Engineer Pipelines And Lakehouses in Winnipeg, MB vacancy
- Build trustworthy data pipelines at Foresight using Python, advanced SQL, and production-grade workflow orchestration. Preferred locations... ...include New York, San Francisco, and Montreal.As a Senior Data Engineer, you will build Foresight's data foundation for predictions, AI...Pipeline
- Build trusted measurement data pipelines with Python and SQL as a remote-first Data Engineer serving Canada or the United States. Turn messy site data into dependable systems.In this full-time core engineering role, you will build and run production pipelines for data from installed...PipelineFull timeRemote work
- Join datastore in building reliable data pipelines that decode years of on-chain history into trustworthy Parquet files for researchers. Elevate... ...while ensuring high quality and accuracy. As a Data Engineer, you will design and run large-scale decoding pipelines, focusing...PipelinePart timeWork at office
- AWS Data Engineer building Salesforce pipelines and analytics infrastructure powers Kindsight’s customer-facing products through production data systems.As a hands-on Data Engineer, you will ingest customer data into AWS and transform it through warehouses supporting dashboards...Pipeline
- Engineer monitored, governed data flows with Python and Spark for Croesus's wealth management platforms. This hybrid position requires two weekly office... ...Expert develops and operates modern Databricks Lakehouse pipelines supporting analytics and artificial intelligence...PipelineWork at office
- Build Azure data pipelines with Databricks, Python, and SQL for the Government of Ontario’s Ontario Data Platform, working five days onsite... ...data solutions across government organizations through scalable engineering and reliable processing.This Data Engineer / Software...Pipeline
- Build complex data pipelines with Python and SQL Server while working onsite five days weekly alongside operational teams. Maintain extremely accurate reporting solutions and data systems.As a Data Engineer, you will develop, test, deploy, and maintain ELT pipelines from varied...Pipeline
- Build Azure data pipelines with Tata Consultancy Services using SQL, Python, and cloud data platforms. Apply big data expertise to structured and semi-structured datasets.As an Azure Data Engineer, you will design and develop cloud-based pipelines from business requirements...Pipeline
- Shape LLM and RAG pipelines through data modeling, embeddings, and vector databases at Connor, Clark & Lunn Financial Group.As a Senior Data Integration Engineer, you will enrich structured, semi-structured, and unstructured data for enterprise AI. The role combines semantic...Pipeline
- ...s agent-era products from a hybrid Toronto office schedule.As a Machine Learning Engineer, you will transform customer CRM and warehouse records into model-ready data. You will design pipelines that help each customer’s digital twins improve without leaking information across...PipelineWork at office
- ...recherche un Développeur.euse principal.e, Données, pour concevoir et livrer des pipelines et ensembles de données fiables alimentant les rapports, l'analytique et les systèmes en aval dans le data mesh de SSENSE. Intégré au groupe Technologie et ingénierie, vous mettrez à...Pipeline
$136k - $160k per year
...Unchain Data in Toronto is seeking a Software Developer on our Data Engineering team to build core datasets powering analytics, experimentation, and ML across our platform. You will design scalable pipelines and tooling, collaborating with engineers, data scientists, and business...Pipeline- Build AWS data pipelines as a Senior Data Developer Engineer at Intact, using Python or Java, SQL, and production-grade engineering practices.You will help establish Contact Distributor, Intact’s platform for trusted broker and distributor master data. As a senior data engineer...Pipeline
- Build cloud-based data pipelines at Ipsos using Python, SQL, and serverless technologies to process large-scale datasets. This role supports the Ipsos DataHub.As a Senior Software Engineer focused on data engineering, you will expand and optimize pipeline architecture within...Pipeline
- Client is seeking a Senior Data Engineer to support the modernization of tooling enablement functions. This role is responsible for designing... ...objects in the Snowflake cloud data store, utilizing ETL pipelines (Talend, Informatica) and APIs. The ideal candidate is a self-...Pipeline
- A leading IT consulting firm is seeking a Senior Azure Data Engineer in Toronto, Ontario. The candidate will design and optimize scalable data pipelines within the Microsoft Fabric and SAP BW ecosystem. Qualifications include over 7 years of experience in data engineering,...PipelineFull time
- ...experience in Scala and Apache Spark to design, develop, and optimize scalable big data processing solutions within the Hadoop Spark SparkSQL ecosystem. You will design, implement, and optimize data pipelines, collaborating with data scientists, analysts, and architects to deliver...Pipeline
- ...ML arteka in Canada is seeking a seasoned Data Ingestion Engineer to build 30+ source connectors for a regulated financial platform on AWS. You... ...ensure production readiness with tests and observability across the pipeline, including CloudWatch dashboards. #J-18808-LjbffrPipeline
- AWS architecture and data pipeline leadership define this full-time Senior Data Pipeline Engineering Lead role at Hartree Partners. Lead a small engineering team.Reporting to the Head of Finance Technology, you will shape data technology for Finance, Operations, Risk and Compliance...PipelineFull time
- Quandri is seeking a Senior Data Engineer to own the Databricks data lake, medallion layers, and streaming ingestion. You will partner with engineers, data scientists, and product teams to build scalable data platforms and AI data infrastructure. You’ll design multi-tenant...Pipeline
- ...Dialogue is seeking a Senior Data Platform Developer to design, build, and maintain our modern data platform. You will define engineering best practices, enable power users, and own Snowflake, dbt, and deployment pipelines. You will collaborate with Product, Sales, Ops, and...Pipeline
- Cardinal Health Canada is seeking a Data Engineer to design, build, and maintain scalable data pipelines and models that support reporting, analytics, and decision making. The role requires hands-on SQL, data integration, and cloud platform experience within a collaborative...Pipeline
- The Databricks Engineer will design, develop, and optimize large-scale data pipelines using Databricks and Azure cloud services.This role requires advanced expertise in Spark/PySpark, Delta Lake technologies, data governance, and cloud-based data engineering.The engineer will...Pipeline
- AeroVect is hiring a Staff Software Engineer, Infrastructure (Cloud) to own data infrastructure powering our autonomous driving platform. You will design scalable pipelines moving data from on-prem to cloud, and manage cloud infrastructure for performance and reliability. The...Pipeline
- ...Cohere is seeking a Senior Member of Technical Staff specializing in web data for pre-training. You will design and own the large-scale web data pipeline that feeds Cohere’s language models, transforming raw internet data into high-quality training data. You will work with...PipelineRemote work
- ...ZoomInfo Technologies LLC is seeking a Data Engineer III to join the Strategic Partnerships data platform. You’ll design and ship ETL pipelines, semantic models, and the infrastructure powering cross-functional initiatives with Marketing, Finance, Sales, Legal, HR, and Product...PipelineRemote work
- Shift4 is seeking a Data Platform Engineer to build, maintain, and optimize data ingestion pipelines from production systems into Snowflake. You will focus on pipeline performance, reliability, scalability, cost efficiency, and observability. Experience with ECS, SQS, Python...Pipeline
- Punt, a Vancouver-based tech company, seeks an Associate Data Engineer to design and maintain core data pipelines powering our prediction-led platform. You will ingest high-volume datasets, write production transformations, and ensure data accuracy for business-critical applications...Pipeline
- ...hireVouch is seeking a Senior Data Engineer, ML Platform to own the data infrastructure for training, inference and monitoring. You will shape the lake architecture, build end-to-end ML pipelines and own both offline and online feature stores, ensuring data quality and lineage...Pipeline
- ...Samsara is seeking a Data Engineer in Canada to join our Data team. You will design and maintain data pipelines in a central data lake, using SparkSQL and PySpark to ingest and transform IoT device data and software product data into our core data model for analytics and dashboards...PipelineRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer Pipelines And Lakehouses. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
- junior data engineer Winnipeg, MB

