Data Engineer Pipelines And Lakehouses
Sarsfield Group
Build scalable data pipelines and lakehouse systems at Spade Technologies, Inc., with Manitoba preferred and all locations considered. Work full time.As a Data Engineer reporting to the CTO, you will own ingestion pipelines, data models, and infrastructure. You will support herd, feed, financial, and operational datasets for farmer-facing and enterprise products. Your work will focus on reliable, secure, performant data systems.Key Responsibilities:
Design scalable batch and streaming ingestion pipelinesImplement ETL/ELT workflows and validation layersDevelop unified models for herd and financial datasetsManage modern data lake complexity, including Iceberg and DatabricksPrepare data for ML and AI systemsRequirements:
Four or more years of production data engineering experienceExpertise with Databricks, Airflow, dbt, Spark, or similarExperience managing warehouses or lakehousesHands-on AWS, GCP, or Azure infrastructure experienceKnowledge of structured and semi-structured data formatsApply data modeling, cloud infrastructure, and pipeline expertise to strengthen Spade’s food data platform.
#J-18808-Ljbffr
Design scalable batch and streaming ingestion pipelinesImplement ETL/ELT workflows and validation layersDevelop unified models for herd and financial datasetsManage modern data lake complexity, including Iceberg and DatabricksPrepare data for ML and AI systemsRequirements:
Four or more years of production data engineering experienceExpertise with Databricks, Airflow, dbt, Spark, or similarExperience managing warehouses or lakehousesHands-on AWS, GCP, or Azure infrastructure experienceKnowledge of structured and semi-structured data formatsApply data modeling, cloud infrastructure, and pipeline expertise to strengthen Spade’s food data platform.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Data Engineer Pipelines And Lakehouses in Winnipeg, MB vacancy
- Build trustworthy data pipelines at Foresight using Python, advanced SQL, and production-grade workflow orchestration. Preferred locations... ...include New York, San Francisco, and Montreal.As a Senior Data Engineer, you will build Foresight's data foundation for predictions, AI...Pipeline
$136k - $160k per year
...Unchain Data in Toronto is seeking a Software Developer on our Data Engineering team to build core datasets powering analytics, experimentation, and ML across our platform. You will design scalable pipelines and tooling, collaborating with engineers, data scientists, and business...Pipeline- Shape LLM and RAG pipelines through data modeling, embeddings, and vector databases at Connor, Clark & Lunn Financial Group.As a Senior Data Integration Engineer, you will enrich structured, semi-structured, and unstructured data for enterprise AI. The role combines semantic...Pipeline
- ...ML arteka in Canada is seeking a seasoned Data Ingestion Engineer to build 30+ source connectors for a regulated financial platform on AWS. You... ...ensure production readiness with tests and observability across the pipeline, including CloudWatch dashboards. #J-18808-LjbffrPipeline
- ...CIBC is seeking a Senior Data Engineer to lead the design and delivery of data products on modern cloud platforms. You will collaborate with business partners and engineering teams to clarify requirements, design data movement across systems, and guide implementation from...Pipeline
- ...Tailscale is seeking an Analytics Engineer to design and maintain scalable data models and pipelines. You will collaborate with Finance, Engineering, Sales, and other teams to deliver reliable data for reporting, analysis, and decision-making. You’ll own production-grade...PipelineRemote work
- ...Cohere is seeking a Senior Member of Technical Staff specializing in web data for pre-training. You will design and own the large-scale web data pipeline that feeds Cohere’s language models, transforming raw internet data into high-quality training data. You will work with...PipelineRemote work
- Punt, a Vancouver-based tech company, seeks an Associate Data Engineer to design and maintain core data pipelines powering our prediction-led platform. You will ingest high-volume datasets, write production transformations, and ensure data accuracy for business-critical applications...Pipeline
- ...Samsara is seeking a Data Engineer in Canada to join our Data team. You will design and maintain data pipelines in a central data lake, using SparkSQL and PySpark to ingest and transform IoT device data and software product data into our core data model for analytics and dashboards...PipelineRemote work
- ...ZoomInfo Technologies LLC is seeking a Data Engineer III to join the Strategic Partnerships data platform. You’ll design and ship ETL pipelines, semantic models, and the infrastructure powering cross-functional initiatives with Marketing, Finance, Sales, Legal, HR, and Product...PipelineRemote work
$85k - $90k per year
...Job Description Design and maintain scalable data pipelines that collect, transform and store business data. Build data models and datasets... ...: · Degree or Diploma in Computer Science, Data Engineering, Information Systems, or related field. · 5+ years of experience...PipelinePermanent employment- ...300 million members across 25 countries and builds data infrastructure and analytics at Amazon scale. You... ...and decisioning. As Prime grows its data capabilities globally, you will join an engineering team focused on reliable, high-throughput data pipelines. #J-18808-LjbffrPipeline
- Shift4 is seeking a Data Platform Engineer to build, maintain, and optimize data ingestion pipelines from production systems into Snowflake. You will focus on pipeline performance, reliability, scalability, cost efficiency, and observability. Experience with ECS, SQS, Python...Pipeline
- AeroVect is hiring a Staff Software Engineer, Infrastructure (Cloud) to own data infrastructure powering our autonomous driving platform. You will design scalable pipelines moving data from on-prem to cloud, and manage cloud infrastructure for performance and reliability. The...Pipeline
- A leading IT consulting firm is seeking a Senior Azure Data Engineer in Toronto, Ontario. The candidate will design and optimize scalable data pipelines within the Microsoft Fabric and SAP BW ecosystem. Qualifications include over 7 years of experience in data engineering,...PipelineFull time
- ...hireVouch is seeking a Senior Data Engineer, ML Platform to own the data infrastructure for training, inference and monitoring. You will shape the lake architecture, build end-to-end ML pipelines and own both offline and online feature stores, ensuring data quality and lineage...Pipeline
- ...Scotiabank is seeking a Software Engineer (Python) in Toronto to design, develop, and support enterprise applications and data platforms. The role emphasizes Python, SQL, APIs, and scalable data pipelines, collaborating with business and technology teams to deliver high-performance...Pipeline
- The Databricks Engineer will design, develop, and optimize large-scale data pipelines using Databricks and Azure cloud services.This role requires advanced expertise in Spark/PySpark, Delta Lake technologies, data governance, and cloud-based data engineering.The engineer will...Pipeline
- ...Semios is seeking a Data Engineer to design, build, and maintain scalable cloud-based data systems that transform raw data into trusted,... ...collaborate with Engineering and Data Science teams to optimize data pipelines and integrate diverse data sources for AI-ready foundations...Pipeline
- Smart IT Frame LLC is seeking an experienced software engineer to design, build, and deploy Python-based AI/LLM... ...APIs, scalable enterprise solutions, and AI-powered data analytics platforms. You will optimize data pipelines for performance and scalability while collaborating...Pipeline
- Quandri Technologies, Inc. is seeking a senior data engineer to own our Databricks data lake end-to-end, manage pipelines and backfill strategies, and drive data governance across products. You will collaborate with software/AI teams, design scalable data models, and mentor...Pipeline
- Capgemini is seeking a data engineering lead to design, build, and scale data pipelines using Azure Data Factory and Azure Databricks in Brampton, Canada. You will guide a 10–15 person team and collaborate with executives, product, and analytics stakeholders to deliver robust...PipelineContract work
- ...Confluence Technologies, Inc. in Montreal is seeking a Senior Data Engineer to design and deliver scalable data solutions powering decision... ..., working hands-on with modern tools to build reliable data pipelines. Collaborate with multiple teams, mentor fellow engineers, and...Pipeline
- Pipeline EngineerDepartment: Piping Engineering Employment Type: Full Time Location: Calgary, AB, Canada DescriptionEquinox Engineering Ltd.... ...Material specifications. Valve and induction bend data sheets. Pigging facility arrangements. Preferred...PipelineFull time
- ...and guidance to other, less experienced, engineers and designers. You will lead the evaluation... ...work and ensure the drafting of the pipeline alignment sheets, detailed crossings plans... ...interface and accurate exchange of technical data Lead collaboration within project...PipelineLong term contractFull timeTemporary workPart timeCasual workWork at office
- ...reliability, affordability and sustainability.Join us. Connect to what matters.The Opportunity The Pipeline Integrity Engineer/Technologist completes analysis of Inline Inspection data for corrosion threats on gas transmission pipelines and supports integrity program planning,...PipelineWork at officeFlexible hours
- ...talking to devices in the field and turning raw measurement data into decisions our clients trust. If that sounds like a challenge... ...our team!About the RoleWe are currently looking to add a Pipeline Integrity Engineer to our team in Calgary, AB. Reporting to the Team Lead, Risk...PipelineLocal area
- Virtusa in Mississauga is seeking a Lead Software Engineer to guide the design and development of scalable, API‑driven solutions with Generative AI capabilities. You will lead cross‑functional teams to deliver innovative, API‑first architectures that meet client requirements...Pipeline
- ...to impact the world in a positive way. To learn more visit: a Senior/Staff Software Engineer embedded within our Autonomy & Algorithms team, you will build the scalable ML data pipelines necessary to train and evaluate Waabi’s autonomous driving platform. Working closely with...Pipeline
- ...Syndio is hiring a Staff engineer to drive high-performance data workflows and scalable architectures in Calgary, with a remote-first approach. You’ll own ingestion, validation, modeling, and reporting pipelines, while building agentic tooling and ensuring trustworthy, observable...PipelineRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer Pipelines And Lakehouses. Be the first to apply!
Related searches
- junior data engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data integration developer Winnipeg, MB
- big data engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
- data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB

