Senior Data Pipeline Engineer
Foresight
Build trustworthy data pipelines at Foresight using Python, advanced SQL, and production-grade workflow orchestration. Preferred locations include New York, San Francisco, and Montreal.As a Senior Data Engineer, you will build Foresight's data foundation for predictions, AI recommendations, analytics, and customer reporting. You will own production pipelines from source to consumer while shaping standards on a new team. The work includes project data ingestion, modeling, observability, and governance.Key Responsibilities:
Build robust pipelines from industry scheduling and planning toolsPreserve update history for confident point-in-time comparisonsDevelop features, training datasets, and search indexes for AICreate models and pipelines for dashboards, reports, and exportsSet data contracts, freshness targets, and quality standardsRequirements:
Five or more years building production data pipelinesStrong Python and advanced SQL skillsDeep Postgres or relational database modeling experienceExperience normalizing messy, inconsistent real-world dataHands-on workflow orchestration, retries, dependencies, and backfillsBring pipeline ownership, data modeling, and quality engineering to Foresight's infrastructure intelligence platform.
#J-18808-Ljbffr
Build robust pipelines from industry scheduling and planning toolsPreserve update history for confident point-in-time comparisonsDevelop features, training datasets, and search indexes for AICreate models and pipelines for dashboards, reports, and exportsSet data contracts, freshness targets, and quality standardsRequirements:
Five or more years building production data pipelinesStrong Python and advanced SQL skillsDeep Postgres or relational database modeling experienceExperience normalizing messy, inconsistent real-world dataHands-on workflow orchestration, retries, dependencies, and backfillsBring pipeline ownership, data modeling, and quality engineering to Foresight's infrastructure intelligence platform.
#J-18808-Ljbffr
Vacancy posted 30 minutes ago
Similar jobs that could be interesting for youBased on the Senior Data Pipeline Engineer in Winnipeg, MB vacancy
- Build cloud-based data pipelines at Ipsos using Python, SQL, and serverless technologies to process large-scale datasets. This role supports the Ipsos DataHub.As a Senior Software Engineer focused on data engineering, you will expand and optimize pipeline architecture within...Senior
- ...recherche un Développeur.euse principal.e, Données, pour concevoir et livrer des pipelines et ensembles de données fiables alimentant les rapports, l'analytique et les systèmes en aval dans le data mesh de SSENSE. Intégré au groupe Technologie et ingénierie, vous mettrez à...Senior
- ...ML arteka in Canada is seeking a seasoned Data Ingestion Engineer to build 30+ source connectors for a regulated financial platform on AWS. You... ...ensure production readiness with tests and observability across the pipeline, including CloudWatch dashboards. #J-18808-LjbffrSenior
- ...hireVouch is seeking a Senior Data Engineer, ML Platform to own the data infrastructure for training, inference and monitoring. You will shape the lake architecture, build end-to-end ML pipelines and own both offline and online feature stores, ensuring data quality and lineage...Senior
- ...Cohere is seeking a Senior Member of Technical Staff specializing in web data for pre-training. You will design and own the large-scale web data pipeline that feeds Cohere’s language models, transforming raw internet data into high-quality training data. You will work with...SeniorRemote work
- A leading IT consulting firm is seeking a Senior Azure Data Engineer in Toronto, Ontario. The candidate will design and optimize scalable data pipelines within the Microsoft Fabric and SAP BW ecosystem. Qualifications include over 7 years of experience in data engineering, strong...SeniorFull time
- ...Scotiabank is seeking a Software Engineer (Python) in Toronto to design, develop, and support enterprise applications and data platforms. The role emphasizes Python, SQL, APIs, and scalable data pipelines, collaborating with business and technology teams to deliver high-performance...Senior
- ...CIBC is seeking a Senior Data Engineer to lead the design and delivery of data products on modern cloud platforms. You will collaborate with business partners and engineering teams to clarify requirements, design data movement across systems, and guide implementation from concept...Senior
- Build scalable data pipelines and lakehouse systems at Spade Technologies, Inc., with Manitoba preferred and all locations considered. Work full time.As a Data Engineer reporting to the CTO, you will own ingestion pipelines, data models, and infrastructure. You will support...Full time
- Transform agricultural sensor data into analysis-ready datasets at Semios, combining production pipelines with cloud infrastructure. Hybrid working arrangements are available.This Data Engineer role supports Semios Group brands, including Semios, Agworld, Altrac, and Greenbook...
- ...Capgemini is seeking a Databricks Data Engineer to design, develop, and maintain scalable data pipelines and cloud-based platforms. You will work with Databricks, PySpark, Python, SQL, and Delta Lake to support analytics, reporting, and ML workloads in a Calgary-based environment...Senior
- Ipsos in Canada is seeking a Data Engineer for the Ipsos DataHub to build and optimize cloud-based data pipelines and warehouses. The role involves processing large-scale datasets using Python and SQL on cloud platforms, with a focus on scalable, production-ready data infrastructure...Senior
$105.4k - $125.12k per year
...careers page.Your role asSenior Data Platform DeveloperWe are looking for a Senior Data Platform Developer that... ...role, you will define and implement engineering best practices across the full... ...Orchestrate robust and resilient data pipelines utilizing Airflow (with...SeniorInternshipWork at officeRemote work3 days per week- ...and guidance to other, less experienced, engineers and designers. You will lead the evaluation... ...work and ensure the drafting of the pipeline alignment sheets, detailed crossings plans... ...interface and accurate exchange of technical data Lead collaboration within project...SeniorLong term contractFull timeTemporary workPart timeCasual workWork at office
- Equinox Engineering Ltd. is a leading Calgary-based EPCM firm known for... ...oil, carbon capture, and pipeline infrastructure projects. We partner... ...open to both intermediate and senior-level engineers. Why Join... ...specifications.Valve and induction bend data sheets.Pigging facility...Senior
- Senior Data Engineer Department: Development - Software DevelopmentEmployment Type: Permanent - Full TimeLocation: Montreal, CanadaReporting... ...tools and technologies to build reliable, high-quality data pipelines. You’ll collaborate with teams across the business,...SeniorPermanent employmentFlexible hours
- Capgemini is seeking a data engineering lead to design, build, and scale data pipelines using Azure Data Factory and Azure Databricks in Brampton, Canada. You will guide a 10–15 person team and collaborate with executives, product, and analytics stakeholders to deliver robust...SeniorContract work
- A leading recruitment firm is seeking a Senior Java Lead Engineer to design and maintain data pipeline architecture. You will implement data products, provide tech support, and ensure data quality while collaborating with cross-functional teams. Ideal candidates will have extensive...Senior
- The Data Engineer will be responsible for developing and maintaining scalable data solutions, with a primary focus on Snowflake and SQL.This... ...will bring extensive experience in building efficient data pipelines, optimizing data models, and supporting cloud-based data environments...Senior
- Quandri Technologies, Inc. is seeking a senior data engineer to own our Databricks data lake end-to-end, manage pipelines and backfill strategies, and drive data governance across products. You will collaborate with software/AI teams, design scalable data models, and mentor...Senior
- Smart IT Frame LLC is seeking an experienced software engineer to design, build, and deploy Python-based AI/LLM... ...APIs, scalable enterprise solutions, and AI-powered data analytics platforms. You will optimize data pipelines for performance and scalability while collaborating...Senior
- Build trusted measurement data pipelines with Python and SQL as a remote-first Data Engineer serving Canada or the United States. Turn messy site data into dependable systems.In this full-time core engineering role, you will build and run production pipelines for data from installed...Full timeRemote work
- ...CoFoMo Inc. is seeking an experienced data engineer to design, develop, and optimize ETL/ELT pipelines for structured and unstructured data across cloud platforms. You will integrate sources, build data models, and ensure scalable data flows for analytics and AI initiatives...Senior
- ...recherchons un(e) Ingénieur(e) de données de niveau intermédiaire à senior pour concevoir, développer et maintenir des solutions de données... ...principalesConcevoir, développer et maintenir des pipelines de données fiables et évolutifs.Développer et optimiser des requêtes...Senior
- Build enterprise data pipelines with advanced SQL and Python at Air Canada Vacations, working from Montréal or Mississauga in a hybrid model.This permanent, full-time Data Analyst Developer reports to the Lead Data Analyst Developer. You will analyze, develop, integrate, and...SeniorPermanent employmentFull time
- We are seeking a Senior ML Data Processing Developer to participate in the development, curation, and scaling of our core data asset pipeline. Sitting at the intersection of data engineering, data curation, and machine learning, you will own the end-to-end pipeline that...SeniorInternship
$136k - $160k per year
...Unchain Data in Toronto is seeking a Software Developer on our Data Engineering team to build core datasets powering analytics, experimentation, and ML across our platform. You will design scalable pipelines and tooling, collaborating with engineers, data scientists, and business...- AWS Data Engineer building Salesforce pipelines and analytics infrastructure powers Kindsight’s customer-facing products through production data systems.As a hands-on Data Engineer, you will ingest customer data into AWS and transform it through warehouses supporting dashboards...
- Build Azure data pipelines with Tata Consultancy Services using SQL, Python, and cloud data platforms. Apply big data expertise to structured and semi-structured datasets.As an Azure Data Engineer, you will design and develop cloud-based pipelines from business requirements...
- Build complex data pipelines with Python and SQL Server while working onsite five days weekly alongside operational teams. Maintain extremely accurate reporting solutions and data systems.As a Data Engineer, you will develop, test, deploy, and maintain ELT pipelines from varied...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Pipeline Engineer. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
- junior data engineer Winnipeg, MB

