Senior Data Pipeline Engineer
Foresight
Build trustworthy data pipelines at Foresight using Python, advanced SQL, and production-grade workflow orchestration. Preferred locations include New York, San Francisco, and Montreal.As a Senior Data Engineer, you will build Foresight's data foundation for predictions, AI recommendations, analytics, and customer reporting. You will own production pipelines from source to consumer while shaping standards on a new team. The work includes project data ingestion, modeling, observability, and governance.Key Responsibilities:
Build robust pipelines from industry scheduling and planning toolsPreserve update history for confident point-in-time comparisonsDevelop features, training datasets, and search indexes for AICreate models and pipelines for dashboards, reports, and exportsSet data contracts, freshness targets, and quality standardsRequirements:
Five or more years building production data pipelinesStrong Python and advanced SQL skillsDeep Postgres or relational database modeling experienceExperience normalizing messy, inconsistent real-world dataHands-on workflow orchestration, retries, dependencies, and backfillsBring pipeline ownership, data modeling, and quality engineering to Foresight's infrastructure intelligence platform.
#J-18808-Ljbffr
Build robust pipelines from industry scheduling and planning toolsPreserve update history for confident point-in-time comparisonsDevelop features, training datasets, and search indexes for AICreate models and pipelines for dashboards, reports, and exportsSet data contracts, freshness targets, and quality standardsRequirements:
Five or more years building production data pipelinesStrong Python and advanced SQL skillsDeep Postgres or relational database modeling experienceExperience normalizing messy, inconsistent real-world dataHands-on workflow orchestration, retries, dependencies, and backfillsBring pipeline ownership, data modeling, and quality engineering to Foresight's infrastructure intelligence platform.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Senior Data Pipeline Engineer in Winnipeg, MB vacancy
- Build AI-ready data pipelines at Foresight, using Python and advanced SQL to make complex project data trusted. This hands-on role is based in New York, San Francisco, or Montreal.As a Senior Data Engineer, you will build the data foundation behind Foresight’s predictions, AI...Senior
- ...recherche un Développeur.euse principal.e, Données, pour concevoir et livrer des pipelines et ensembles de données fiables alimentant les rapports, l'analytique et les systèmes en aval dans le data mesh de SSENSE. Intégré au groupe Technologie et ingénierie, vous mettrez à...Senior
- Shape LLM and RAG pipelines through data modeling, embeddings, and vector databases at Connor, Clark & Lunn Financial Group.As a Senior Data Integration Engineer, you will enrich structured, semi-structured, and unstructured data for enterprise AI. The role combines semantic...Senior
- ...Python and SQL systems for Mecka AI’s global robotics data infrastructure, working on production delivery pipelines at scale. Turn changing customer specifications into reproducible datasets efficiently.As a Software Engineer in Delivery Ops, you will build systems that...Senior
- Build cloud-based data pipelines at Ipsos using Python, SQL, and serverless technologies to process large-scale datasets. This role supports the Ipsos DataHub.As a Senior Software Engineer focused on data engineering, you will expand and optimize pipeline architecture within...Senior
- A leading IT consulting firm is seeking a Senior Azure Data Engineer in Toronto, Ontario. The candidate will design and optimize scalable data pipelines within the Microsoft Fabric and SAP BW ecosystem. Qualifications include over 7 years of experience in data engineering, strong...SeniorFull time
- A global technology services company is seeking a Senior Production Support Engineer in Halifax to ensure the stability and reliability of production systems. The successful candidate will monitor and troubleshoot issues, adhering to SLAs, and provide customer support. Candidates...Senior
- ...Contribute to Waabi’s cutting edge AV stack and data‑driven simulator.Build and own robust, petabyte‑scale ETL pipelines for ingesting and aggregating multi‑sensor data... ...software.Be part of a team of multidisciplinary Engineers, Research Scientists, and Product Managers using...SeniorFull timeInternshipWork at officeWork from homeFlexible hours
- Questrade Financial Group in Canada is seeking a Senior Data Engineer to architect and deliver scalable data pipelines and platform infra. You will bridge trading and brokerage operations with analytics, using dbt, Spark on Kubernetes, and GCP to ensure reliable, auditable...Senior
- ...Cohere is seeking a Senior Member of Technical Staff specializing in web data for pre-training. You will design and own the large-scale web data pipeline that feeds Cohere’s language models, transforming raw internet data into high-quality training data. You will work with...SeniorRemote work
- ...experience in Scala and Apache Spark to design, develop, and optimize scalable big data processing solutions within the Hadoop Spark SparkSQL ecosystem. You will design, implement, and optimize data pipelines, collaborating with data scientists, analysts, and architects to deliver...Senior
- Quandri is seeking a Senior Data Engineer to own the Databricks data lake, medallion layers, and streaming ingestion. You will partner with engineers, data scientists, and product teams to build scalable data platforms and AI data infrastructure. You’ll design multi-tenant data...Senior
- ...Dialogue is seeking a Senior Data Platform Developer to design, build, and maintain our modern data platform. You will define engineering best practices, enable power users, and own Snowflake, dbt, and deployment pipelines. You will collaborate with Product, Sales, Ops, and...Senior
- An innovative technology firm in Mississauga is seeking a Senior Data Engineer to design and build scalable data pipelines within Microsoft Fabric. This role contributes to major digital transformation projects, ensuring data products are AI-ready and governed. The ideal candidate...Senior
- Ledcor Group is hiring a Senior Data Engineer to join the Data & Analytics Platform team. You will design, build, and maintain enterprise-scale data solutions supporting reporting, analytics, and operational intelligence across Ledcor's construction and infrastructure businesses...Senior
- ...Scotiabank is seeking a Software Engineer (Python) in Toronto to design, develop, and support enterprise applications and data platforms. The role emphasizes Python, SQL, APIs, and scalable data pipelines, collaborating with business and technology teams to deliver high-performance...Senior
- Luxoft seeks an experienced Senior Data Engineer to onboard, integrate, and operationalize datasets for Middle Office functions. You will build scalable, production-grade data pipelines on AWS (EMR, Glue, Athena, S3) using Spark/PySpark, and own the full lifecycle from design...SeniorWork at office
- ...CIBC is seeking a Senior Data Engineer to lead the design and delivery of data products on modern cloud platforms. You will collaborate with business partners and engineering teams to clarify requirements, design data movement across systems, and guide implementation from concept...Senior
- AWS architecture and data pipeline leadership define this full-time Senior Data Pipeline Engineering Lead role at Hartree Partners. Lead a small engineering team.Reporting to the Head of Finance Technology, you will shape data technology for Finance, Operations, Risk and Compliance...SeniorFull time
- ...ML arteka in Canada is seeking a seasoned Data Ingestion Engineer to build 30+ source connectors for a regulated financial platform on AWS. You... ...ensure production readiness with tests and observability across the pipeline, including CloudWatch dashboards. #J-18808-LjbffrSenior
- ...hireVouch is seeking a Senior Data Engineer, ML Platform to own the data infrastructure for training, inference and monitoring. You will shape the lake architecture, build end-to-end ML pipelines and own both offline and online feature stores, ensuring data quality and lineage...Senior
- Build trusted measurement data pipelines with Python and SQL as a remote-first Data Engineer serving Canada or the United States. Turn messy site data into dependable systems.In this full-time core engineering role, you will build and run production pipelines for data from installed...Full timeRemote work
- Join datastore in building reliable data pipelines that decode years of on-chain history into trustworthy Parquet files for researchers. Elevate... ...while ensuring high quality and accuracy. As a Data Engineer, you will design and run large-scale decoding pipelines, focusing...Part timeWork at office
- The Data Engineer will be responsible for developing and maintaining scalable data solutions, with a primary focus on Snowflake and SQL.This... ...will bring extensive experience in building efficient data pipelines, optimizing data models, and supporting cloud-based data environments...Senior
- ...recherchons un(e) Ingénieur(e) de données de niveau intermédiaire à senior pour concevoir, développer et maintenir des solutions de données... ...principalesConcevoir, développer et maintenir des pipelines de données fiables et évolutifs.Développer et optimiser des requêtes...Senior
- Ipsos in Canada is seeking a Data Engineer for the Ipsos DataHub to build and optimize cloud-based data pipelines and warehouses. The role involves processing large-scale datasets using Python and SQL on cloud platforms, with a focus on scalable, production-ready data infrastructure...Senior
- Senior Data Engineer Department: Development - Software DevelopmentEmployment Type: Permanent - Full TimeLocation: Montreal, CanadaReporting... ...tools and technologies to build reliable, high-quality data pipelines. You’ll collaborate with teams across the business,...SeniorPermanent employmentFlexible hours
$100k - $140k per year
A leading cleantech company in Toronto is seeking a Senior Data Engineer to implement secure and scalable data pipelines. The ideal candidate will have a Bachelor's degree in software engineering or a related field, with over 5 years of experience using Python. Collaborating...Senior- A leading recruitment firm is seeking a Senior Java Lead Engineer to design and maintain data pipeline architecture. You will implement data products, provide tech support, and ensure data quality while collaborating with cross-functional teams. Ideal candidates will have extensive...Senior
- ...Confluence is hiring a Senior Data Engineer to design and deliver scalable data solutions that power decision-making across the organization.... ...platform, working hands-on with modern tools to build reliable data pipelines. You will collaborate across teams, contribute to...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Pipeline Engineer. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
- junior data engineer Winnipeg, MB

