Senior Data Pipeline Engineer
Foresight
Build trustworthy data pipelines at Foresight using Python, advanced SQL, and production-grade workflow orchestration. Preferred locations include New York, San Francisco, and Montreal.As a Senior Data Engineer, you will build Foresight's data foundation for predictions, AI recommendations, analytics, and customer reporting. You will own production pipelines from source to consumer while shaping standards on a new team. The work includes project data ingestion, modeling, observability, and governance.Key Responsibilities:
Build robust pipelines from industry scheduling and planning toolsPreserve update history for confident point-in-time comparisonsDevelop features, training datasets, and search indexes for AICreate models and pipelines for dashboards, reports, and exportsSet data contracts, freshness targets, and quality standardsRequirements:
Five or more years building production data pipelinesStrong Python and advanced SQL skillsDeep Postgres or relational database modeling experienceExperience normalizing messy, inconsistent real-world dataHands-on workflow orchestration, retries, dependencies, and backfillsBring pipeline ownership, data modeling, and quality engineering to Foresight's infrastructure intelligence platform.
#J-18808-Ljbffr
Build robust pipelines from industry scheduling and planning toolsPreserve update history for confident point-in-time comparisonsDevelop features, training datasets, and search indexes for AICreate models and pipelines for dashboards, reports, and exportsSet data contracts, freshness targets, and quality standardsRequirements:
Five or more years building production data pipelinesStrong Python and advanced SQL skillsDeep Postgres or relational database modeling experienceExperience normalizing messy, inconsistent real-world dataHands-on workflow orchestration, retries, dependencies, and backfillsBring pipeline ownership, data modeling, and quality engineering to Foresight's infrastructure intelligence platform.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Senior Data Pipeline Engineer in Winnipeg, MB vacancy
- ...recherche un Développeur.euse principal.e, Données, pour concevoir et livrer des pipelines et ensembles de données fiables alimentant les rapports, l'analytique et les systèmes en aval dans le data mesh de SSENSE. Intégré au groupe Technologie et ingénierie, vous mettrez à...Senior
- ...ML arteka in Canada is seeking a seasoned Data Ingestion Engineer to build 30+ source connectors for a regulated financial platform on AWS. You... ...ensure production readiness with tests and observability across the pipeline, including CloudWatch dashboards. #J-18808-LjbffrSenior
- ...CIBC is seeking a Senior Data Engineer to lead the design and delivery of data products on modern cloud platforms. You will collaborate with business partners and engineering teams to clarify requirements, design data movement across systems, and guide implementation from concept...Senior
- ...Scotiabank is seeking a Software Engineer (Python) in Toronto to design, develop, and support enterprise applications and data platforms. The role emphasizes Python, SQL, APIs, and scalable data pipelines, collaborating with business and technology teams to deliver high-performance...Senior
- A leading IT consulting firm is seeking a Senior Azure Data Engineer in Toronto, Ontario. The candidate will design and optimize scalable data pipelines within the Microsoft Fabric and SAP BW ecosystem. Qualifications include over 7 years of experience in data engineering, strong...SeniorFull time
- ...hireVouch is seeking a Senior Data Engineer, ML Platform to own the data infrastructure for training, inference and monitoring. You will shape the lake architecture, build end-to-end ML pipelines and own both offline and online feature stores, ensuring data quality and lineage...Senior
- ...Cohere is seeking a Senior Member of Technical Staff specializing in web data for pre-training. You will design and own the large-scale web data pipeline that feeds Cohere’s language models, transforming raw internet data into high-quality training data. You will work with...SeniorRemote work
- Senior Data Engineer Department: Development - Software DevelopmentEmployment Type: Permanent - Full TimeLocation: Montreal, CanadaReporting... ...tools and technologies to build reliable, high-quality data pipelines. You’ll collaborate with teams across the business,...SeniorPermanent employmentFlexible hours
- Build scalable data pipelines and lakehouse systems at Spade Technologies, Inc., with Manitoba preferred and all locations considered. Work full time.As a Data Engineer reporting to the CTO, you will own ingestion pipelines, data models, and infrastructure. You will support...Full time
- Equinox Engineering Ltd. is a leading Calgary-based EPCM firm known for... ...oil, carbon capture, and pipeline infrastructure projects. We partner... ...open to both intermediate and senior-level engineers. Why Join... ...specifications.Valve and induction bend data sheets.Pigging facility...Senior
- Smart IT Frame LLC is seeking an experienced software engineer to design, build, and deploy Python-based AI/LLM... ...APIs, scalable enterprise solutions, and AI-powered data analytics platforms. You will optimize data pipelines for performance and scalability while collaborating...Senior
- Capgemini is seeking a data engineering lead to design, build, and scale data pipelines using Azure Data Factory and Azure Databricks in Brampton, Canada. You will guide a 10–15 person team and collaborate with executives, product, and analytics stakeholders to deliver robust...SeniorContract work
- Quandri Technologies, Inc. is seeking a senior data engineer to own our Databricks data lake end-to-end, manage pipelines and backfill strategies, and drive data governance across products. You will collaborate with software/AI teams, design scalable data models, and mentor...Senior
- A leading recruitment firm is seeking a Senior Java Lead Engineer to design and maintain data pipeline architecture. You will implement data products, provide tech support, and ensure data quality while collaborating with cross-functional teams. Ideal candidates will have extensive...Senior
- ...and guidance to other, less experienced, engineers and designers. You will lead the evaluation... ...work and ensure the drafting of the pipeline alignment sheets, detailed crossings plans... ...interface and accurate exchange of technical data Lead collaboration within project...SeniorLong term contractFull timeTemporary workPart timeCasual workWork at office
- We are seeking a Senior ML Data Processing Developer to participate in the development, curation, and scaling of our core data asset pipeline. Sitting at the intersection of data engineering, data curation, and machine learning, you will own the end-to-end pipeline that...SeniorInternship
- AWS Data Engineer building Salesforce pipelines and analytics infrastructure powers Kindsight’s customer-facing products through production data systems.As a hands-on Data Engineer, you will ingest customer data into AWS and transform it through warehouses supporting dashboards...
$136k - $160k per year
...Unchain Data in Toronto is seeking a Software Developer on our Data Engineering team to build core datasets powering analytics, experimentation, and ML across our platform. You will design scalable pipelines and tooling, collaborating with engineers, data scientists, and business...$110k per year
...experience. About the Team: The Data & Analytics team is moving... ..., and emerging AI use cases. Pipelines, data products, and platform... ...standards, and creating engineering patterns that let analytics, product... .... About the Role: The Senior Data Engineer will design, build...SeniorFull time- Build scalable ETL pipelines and data integrations as a Senior Software Developer supporting enterprise AI and analytics initiatives.This senior role develops trusted data access across enterprise systems. You will create reusable services, prepare structured and unstructured...Senior
- Virtusa in Mississauga is seeking a Lead Software Engineer to guide the design and development of scalable, API‑driven solutions with Generative AI capabilities. You will lead cross‑functional teams to deliver innovative, API‑first architectures that meet client requirements...Senior
- ...candidates who want to impact the world in a positive way. To learn more visit: a Senior/Staff Software Engineer embedded within our Autonomy & Algorithms team, you will build the scalable ML data pipelines necessary to train and evaluate Waabi’s autonomous driving platform....Senior
- ...plateforme technologique basée à Montréal, recherche un Développeur.euse principal.e, Données, & IA pour concevoir et déployer des pipelines fiables et évolutifs alimentant les rapports et l'analytique dans le maillage de données. Vous rejoindrez l'équipe Technologie et ingénierie...Senior
- ...Clio seeks a Senior Data Engineer to craft data pipelines and warehouses, enabling partner teams with accessible datasets and scalable production code. You will work with state‑of‑the‑art technologies to solve complex data challenges and deliver an exceptional data experience...SeniorRemote work
- ...and professionally. How You’ll Make an Impact As a Senior Technical Analyst, Data Engineering and Business Intelligence, at Fidelity Investments... ...focus on building, automating and scaling internal data pipelines and analytics tools using Python and Snowflake, while also...SeniorWork at officeFlexible hours
- Calgary-based pipeline engineering leads technical design and EPCM execution for underground systems across energy projects and global workshare teams.Equinox Engineering Ltd. seeks an intermediate or senior Pipeline Engineer with strong technical expertise and sound engineering...Senior
- Lead pipeline engineering with Lauren Services as a Senior Project Engineer across Calgary, Kelowna, or Vancouver in a flexible hybrid arrangement.This senior technical leadership role supports major North American pipeline projects. You will apply pipeline systems expertise...SeniorFor contractorsFlexible hours
- ..., and your hard work actually pays off, you’ll feel at home at Lauren. Position OverviewLauren Services is seeking a Senior Project Engineer, Pipelines (P.Eng.) to support and lead the technical execution of major pipeline projects across North America. This is a senior technical...SeniorRemplacementFor contractorsWork from homeFlexible hours
- ...Tailscale is seeking an Analytics Engineer to design and maintain scalable data models and pipelines. You will collaborate with Finance, Engineering, Sales, and other teams to deliver reliable data for reporting, analysis, and decision-making. You’ll own production-grade...Remote work
- The Databricks Engineer will design, develop, and optimize large-scale data pipelines using Databricks and Azure cloud services.This role requires advanced expertise in Spark/PySpark, Delta Lake technologies, data governance, and cloud-based data engineering.The engineer will...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Pipeline Engineer. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
- junior data engineer Winnipeg, MB

