Senior Data Pipeline Engineer
Foresight
Build trustworthy data pipelines at Foresight using Python, advanced SQL, and production-grade workflow orchestration. Preferred locations include New York, San Francisco, and Montreal.As a Senior Data Engineer, you will build Foresight's data foundation for predictions, AI recommendations, analytics, and customer reporting. You will own production pipelines from source to consumer while shaping standards on a new team. The work includes project data ingestion, modeling, observability, and governance.Key Responsibilities:
Build robust pipelines from industry scheduling and planning toolsPreserve update history for confident point-in-time comparisonsDevelop features, training datasets, and search indexes for AICreate models and pipelines for dashboards, reports, and exportsSet data contracts, freshness targets, and quality standardsRequirements:
Five or more years building production data pipelinesStrong Python and advanced SQL skillsDeep Postgres or relational database modeling experienceExperience normalizing messy, inconsistent real-world dataHands-on workflow orchestration, retries, dependencies, and backfillsBring pipeline ownership, data modeling, and quality engineering to Foresight's infrastructure intelligence platform.
#J-18808-Ljbffr
Build robust pipelines from industry scheduling and planning toolsPreserve update history for confident point-in-time comparisonsDevelop features, training datasets, and search indexes for AICreate models and pipelines for dashboards, reports, and exportsSet data contracts, freshness targets, and quality standardsRequirements:
Five or more years building production data pipelinesStrong Python and advanced SQL skillsDeep Postgres or relational database modeling experienceExperience normalizing messy, inconsistent real-world dataHands-on workflow orchestration, retries, dependencies, and backfillsBring pipeline ownership, data modeling, and quality engineering to Foresight's infrastructure intelligence platform.
#J-18808-Ljbffr
Vacancy posted 8 minutes ago
Similar jobs that could be interesting for youBased on the Senior Data Pipeline Engineer in Winnipeg, MB vacancy
- Build trustworthy data pipelines at Foresight using Python, advanced SQL, and production-grade workflow orchestration. Preferred locations include New York, San Francisco, and Montreal.As a Senior Data Engineer, you will build Foresight's data foundation for predictions, AI...Senior
- Build cloud-based data pipelines at Ipsos using Python, SQL, and serverless technologies to process large-scale datasets. This role supports the Ipsos DataHub.As a Senior Software Engineer focused on data engineering, you will expand and optimize pipeline architecture within...Senior
- ...recherche un Développeur.euse principal.e, Données, pour concevoir et livrer des pipelines et ensembles de données fiables alimentant les rapports, l'analytique et les systèmes en aval dans le data mesh de SSENSE. Intégré au groupe Technologie et ingénierie, vous mettrez à...Senior
- Shape LLM and RAG pipelines through data modeling, embeddings, and vector databases at Connor, Clark & Lunn Financial Group.As a Senior Data Integration Engineer, you will enrich structured, semi-structured, and unstructured data for enterprise AI. The role combines semantic...Senior
- Build AWS data pipelines as a Senior Data Developer Engineer at Intact, using Python or Java, SQL, and production-grade engineering practices.You will help establish Contact Distributor, Intact’s platform for trusted broker and distributor master data. As a senior data engineer...Senior
- ...hireVouch is seeking a Senior Data Engineer, ML Platform to own the data infrastructure for training, inference and monitoring. You will shape the lake architecture, build end-to-end ML pipelines and own both offline and online feature stores, ensuring data quality and lineage...Senior
- ...Cohere is seeking a Senior Member of Technical Staff specializing in web data for pre-training. You will design and own the large-scale web data pipeline that feeds Cohere’s language models, transforming raw internet data into high-quality training data. You will work with...SeniorRemote work
- ...experience in Scala and Apache Spark to design, develop, and optimize scalable big data processing solutions within the Hadoop Spark SparkSQL ecosystem. You will design, implement, and optimize data pipelines, collaborating with data scientists, analysts, and architects to deliver...Senior
- ...ML arteka in Canada is seeking a seasoned Data Ingestion Engineer to build 30+ source connectors for a regulated financial platform on AWS. You... ...ensure production readiness with tests and observability across the pipeline, including CloudWatch dashboards. #J-18808-LjbffrSenior
- A leading IT consulting firm is seeking a Senior Azure Data Engineer in Toronto, Ontario. The candidate will design and optimize scalable data pipelines within the Microsoft Fabric and SAP BW ecosystem. Qualifications include over 7 years of experience in data engineering, strong...SeniorFull time
- ...Scotiabank is seeking a Software Engineer (Python) in Toronto to design, develop, and support enterprise applications and data platforms. The role emphasizes Python, SQL, APIs, and scalable data pipelines, collaborating with business and technology teams to deliver high-performance...Senior
- Quandri is seeking a Senior Data Engineer to own the Databricks data lake, medallion layers, and streaming ingestion. You will partner with engineers, data scientists, and product teams to build scalable data platforms and AI data infrastructure. You’ll design multi-tenant data...Senior
- ...CIBC is seeking a Senior Data Engineer to lead the design and delivery of data products on modern cloud platforms. You will collaborate with business partners and engineering teams to clarify requirements, design data movement across systems, and guide implementation from concept...Senior
- Autodesk is seeking an analytics/data engineer to transform and maintain architectures for enterprise analytics pipelines. You will build and optimize pipelines for Snowflake/Hive, Python/SQL, and self-serve analytics, while enabling data-driven decision making across cross-...Senior
- Join datastore in building reliable data pipelines that decode years of on-chain history into trustworthy Parquet files for researchers. Elevate... ...while ensuring high quality and accuracy. As a Data Engineer, you will design and run large-scale decoding pipelines, focusing...Part timeWork at office
- Build scalable data pipelines and lakehouse systems at Spade Technologies, Inc., with Manitoba preferred and all locations considered. Work full time.As a Data Engineer reporting to the CTO, you will own ingestion pipelines, data models, and infrastructure. You will support...Full time
- Build trusted measurement data pipelines with Python and SQL as a remote-first Data Engineer serving Canada or the United States. Turn messy site data into dependable systems.In this full-time core engineering role, you will build and run production pipelines for data from installed...Full timeRemote work
- Transform agricultural sensor data into analysis-ready datasets at Semios, combining production pipelines with cloud infrastructure. Hybrid working arrangements are available.This Data Engineer role supports Semios Group brands, including Semios, Agworld, Altrac, and Greenbook...
- ...CoFoMo Inc. is seeking an experienced data engineer to design, develop, and optimize ETL/ELT pipelines for structured and unstructured data across cloud platforms. You will integrate sources, build data models, and ensure scalable data flows for analytics and AI initiatives...Senior
- A leading recruitment firm is seeking a Senior Java Lead Engineer to design and maintain data pipeline architecture. You will implement data products, provide tech support, and ensure data quality while collaborating with cross-functional teams. Ideal candidates will have extensive...Senior
- The Data Engineer will be responsible for developing and maintaining scalable data solutions, with a primary focus on Snowflake and SQL.This... ...will bring extensive experience in building efficient data pipelines, optimizing data models, and supporting cloud-based data environments...Senior
- ...recherchons un(e) Ingénieur(e) de données de niveau intermédiaire à senior pour concevoir, développer et maintenir des solutions de données... ...principalesConcevoir, développer et maintenir des pipelines de données fiables et évolutifs.Développer et optimiser des requêtes...Senior
- Chainlink Labs is seeking a data engineer to build scalable data models and pipelines powering analytics across the Chainlink ecosystem. You will work with SQL and Python to ingest, process, and validate large time-series datasets, enabling benchmarking and data-driven decisions...SeniorRemote work
- Litmus in Canada is building the data foundation that powers industrial AI. We’re looking for a Senior Golang Engineer to own high-throughput data pipelines and real-time streams that ingest, transform, and route industrial data at scale, across edge and cloud environments....SeniorWorldwide
- Ipsos in Canada is seeking a Data Engineer for the Ipsos DataHub to build and optimize cloud-based data pipelines and warehouses. The role involves processing large-scale datasets using Python and SQL on cloud platforms, with a focus on scalable, production-ready data infrastructure...Senior
- Smart IT Frame LLC is seeking an experienced software engineer to design, build, and deploy Python-based AI/LLM... ...APIs, scalable enterprise solutions, and AI-powered data analytics platforms. You will optimize data pipelines for performance and scalability while collaborating...Senior
- Senior Data Engineer Department: Development - Software DevelopmentEmployment Type: Permanent - Full TimeLocation: Montreal, CanadaReporting... ...tools and technologies to build reliable, high-quality data pipelines. You’ll collaborate with teams across the business,...SeniorPermanent employmentFlexible hours
- Capgemini is seeking a data engineering lead to design, build, and scale data pipelines using Azure Data Factory and Azure Databricks in Brampton, Canada. You will guide a 10–15 person team and collaborate with executives, product, and analytics stakeholders to deliver robust...SeniorContract work
- Equinox Engineering Ltd. is a leading Calgary-based EPCM firm known for... ...oil, carbon capture, and pipeline infrastructure projects. We partner... ...open to both intermediate and senior-level engineers. Why Join... ...specifications.Valve and induction bend data sheets.Pigging facility...Senior
- ...and guidance to other, less experienced, engineers and designers. You will lead the evaluation... ...work and ensure the drafting of the pipeline alignment sheets, detailed crossings plans... ...interface and accurate exchange of technical data Lead collaboration within project...SeniorLong term contractFull timeTemporary workPart timeCasual workWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Pipeline Engineer. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
- junior data engineer Winnipeg, MB

