Senior Data Pipeline Engineer
Foresight
Build trustworthy data pipelines at Foresight using Python, advanced SQL, and production-grade workflow orchestration. Preferred locations include New York, San Francisco, and Montreal.As a Senior Data Engineer, you will build Foresight's data foundation for predictions, AI recommendations, analytics, and customer reporting. You will own production pipelines from source to consumer while shaping standards on a new team. The work includes project data ingestion, modeling, observability, and governance.Key Responsibilities:
Build robust pipelines from industry scheduling and planning toolsPreserve update history for confident point-in-time comparisonsDevelop features, training datasets, and search indexes for AICreate models and pipelines for dashboards, reports, and exportsSet data contracts, freshness targets, and quality standardsRequirements:
Five or more years building production data pipelinesStrong Python and advanced SQL skillsDeep Postgres or relational database modeling experienceExperience normalizing messy, inconsistent real-world dataHands-on workflow orchestration, retries, dependencies, and backfillsBring pipeline ownership, data modeling, and quality engineering to Foresight's infrastructure intelligence platform.
#J-18808-Ljbffr
Build robust pipelines from industry scheduling and planning toolsPreserve update history for confident point-in-time comparisonsDevelop features, training datasets, and search indexes for AICreate models and pipelines for dashboards, reports, and exportsSet data contracts, freshness targets, and quality standardsRequirements:
Five or more years building production data pipelinesStrong Python and advanced SQL skillsDeep Postgres or relational database modeling experienceExperience normalizing messy, inconsistent real-world dataHands-on workflow orchestration, retries, dependencies, and backfillsBring pipeline ownership, data modeling, and quality engineering to Foresight's infrastructure intelligence platform.
#J-18808-Ljbffr
Vacancy posted 57 minutes ago
Similar jobs that could be interesting for youBased on the Senior Data Pipeline Engineer in Winnipeg, MB vacancy
- Engineer enterprise-scale data pipelines with Python, Apache Spark, and Apache Beam for modern cloud-based data platforms. Apply strong SQL and platform expertise.This Senior Data Engineer role at TechBlocks centers on building and expanding enterprise data capabilities. You...Senior
- Build AI-ready data pipelines at Foresight, using Python and advanced SQL to make complex project data trusted. This hands-on role is based in New York, San Francisco, or Montreal.As a Senior Data Engineer, you will build the data foundation behind Foresight’s predictions, AI...Senior
$136k - $170k per year
...ideas for the benefit of others. As a Infrastructure Engineer at the company, you will run our Production... ...large scale distributed systems. About the TeamData Pipelines is at the heart of all critical data flowing through the company supporting hundreds of services...SeniorHourly payWork at officeFlexible hours3 days per week- Build cloud-based data pipelines at Ipsos using Python, SQL, and serverless technologies to process large-scale datasets. This role supports the Ipsos DataHub.As a Senior Software Engineer focused on data engineering, you will expand and optimize pipeline architecture within...Senior
- Support Airflow scheduling and data pipeline delivery remotely as a Senior Data Engineer for PENN Interactive and theScore platforms.This senior position partners with Data Services, business stakeholders, and data engineers to deliver reliable transformed data. Responsibilities...SeniorRemote work
- Build AWS data pipelines as a Senior Data Engineer at Clio, using streaming, batch processing, and production software development skills. Work remotely across Canada or hybrid in Toronto.Clio seeks a Senior Data Engineer for its growing engineering team. You will create data...SeniorRemote work
- A leading IT consulting firm is seeking a Senior Azure Data Engineer in Toronto, Ontario. The candidate will design and optimize scalable data pipelines within the Microsoft Fabric and SAP BW ecosystem. Qualifications include over 7 years of experience in data engineering, strong...SeniorFull time
- ...ML arteka in Canada is seeking a seasoned Data Ingestion Engineer to build 30+ source connectors for a regulated financial platform on AWS. You... ...ensure production readiness with tests and observability across the pipeline, including CloudWatch dashboards. #J-18808-LjbffrSenior
- Ledcor Group is hiring a Senior Data Engineer to join the Data & Analytics Platform team. You will design, build, and maintain enterprise-scale data solutions supporting reporting, analytics, and operational intelligence across Ledcor's construction and infrastructure businesses...Senior
- ...experience in Scala and Apache Spark to design, develop, and optimize scalable big data processing solutions within the Hadoop Spark SparkSQL ecosystem. You will design, implement, and optimize data pipelines, collaborating with data scientists, analysts, and architects to deliver...Senior
- ...hireVouch is seeking a Senior Data Engineer, ML Platform to own the data infrastructure for training, inference and monitoring. You will shape the lake architecture, build end-to-end ML pipelines and own both offline and online feature stores, ensuring data quality and lineage...Senior
- ...CIBC is seeking a Senior Data Engineer to lead the design and delivery of data products on modern cloud platforms. You will collaborate with business partners and engineering teams to clarify requirements, design data movement across systems, and guide implementation from concept...Senior
$136k - $170k per year
...Space LLC in Toronto is seeking an experienced Infrastructure Engineer to own Production Infrastructure, monitor system health and automate... ...at scale. You will build platforms and services for data pipelines, partnering with cross-functional teams to anticipate customer...SeniorWork at office3 days per week- An innovative technology firm in Mississauga is seeking a Senior Data Engineer to design and build scalable data pipelines within Microsoft Fabric. This role contributes to major digital transformation projects, ensuring data products are AI-ready and governed. The ideal candidate...Senior
- Quandri is seeking a Senior Data Engineer to own the Databricks data lake, medallion layers, and streaming ingestion. You will partner with engineers, data scientists, and product teams to build scalable data platforms and AI data infrastructure. You’ll design multi-tenant data...Senior
- ...Scotiabank is seeking a Software Engineer (Python) in Toronto to design, develop, and support enterprise applications and data platforms. The role emphasizes Python, SQL, APIs, and scalable data pipelines, collaborating with business and technology teams to deliver high-performance...Senior
- ...Contribute to Waabi’s cutting edge AV stack and data‑driven simulator.Build and own robust, petabyte‑scale ETL pipelines for ingesting and aggregating multi‑sensor data... ...software.Be part of a team of multidisciplinary Engineers, Research Scientists, and Product Managers using...SeniorFull timeInternshipWork at officeWork from homeFlexible hours
- ...Dialogue is seeking a Senior Data Platform Developer to design, build, and maintain our modern data platform. You will define engineering best practices, enable power users, and own Snowflake, dbt, and deployment pipelines. You will collaborate with Product, Sales, Ops, and...Senior
- Questrade Financial Group in Canada is seeking a Senior Data Engineer to architect and deliver scalable data pipelines and platform infra. You will bridge trading and brokerage operations with analytics, using dbt, Spark on Kubernetes, and GCP to ensure reliable, auditable...Senior
- Luxoft seeks an experienced Senior Data Engineer to onboard, integrate, and operationalize datasets for Middle Office functions. You will build scalable, production-grade data pipelines on AWS (EMR, Glue, Athena, S3) using Spark/PySpark, and own the full lifecycle from design...SeniorWork at office
- Engineer reliable cloud data pipelines using BigQuery, REST APIs, and Python for Clever Digital Marketing’s fully remote Canadian team. Strengthen the infrastructure behind measurable advertising performance.As an Intermediate Data Engineer, you will build within an established...Remote work
- Join datastore in building reliable data pipelines that decode years of on-chain history into trustworthy Parquet files for researchers. Elevate... ...while ensuring high quality and accuracy. As a Data Engineer, you will design and run large-scale decoding pipelines, focusing...Part timeWork at office
- Build trusted measurement data pipelines with Python and SQL as a remote-first Data Engineer serving Canada or the United States. Turn messy site data into dependable systems.In this full-time core engineering role, you will build and run production pipelines for data from installed...Full timeRemote work
- Capgemini is seeking a data engineering lead to design, build, and scale data pipelines using Azure Data Factory and Azure Databricks in Brampton, Canada. You will guide a 10–15 person team and collaborate with executives, product, and analytics stakeholders to deliver robust...SeniorContract work
$105.4k - $125.12k per year
...careers page.Your role asSenior Data Platform DeveloperWe are looking for a Senior Data Platform Developer that... ...role, you will define and implement engineering best practices across the full... ...Orchestrate robust and resilient data pipelines utilizing Airflow (with...SeniorInternshipWork at officeRemote work3 days per week- Ipsos in Canada is seeking a Data Engineer for the Ipsos DataHub to build and optimize cloud-based data pipelines and warehouses. The role involves processing large-scale datasets using Python and SQL on cloud platforms, with a focus on scalable, production-ready data infrastructure...Senior
- Iris Software Inc. is seeking an experienced AWS Data Engineer in Toronto to design, build, and operate scalable data pipelines on AWS. The role emphasizes ETL/ELT processes, data warehousing concepts, and collaboration with onsite and offshore teams to deliver robust data solutions...Senior
- The Data Engineer will be responsible for developing and maintaining scalable data solutions, with a primary focus on Snowflake and SQL.This... ...will bring extensive experience in building efficient data pipelines, optimizing data models, and supporting cloud-based data environments...Senior
- ...recherchons un(e) Ingénieur(e) de données de niveau intermédiaire à senior pour concevoir, développer et maintenir des solutions de données... ...principalesConcevoir, développer et maintenir des pipelines de données fiables et évolutifs.Développer et optimiser des requêtes...Senior
- A leading recruitment firm is seeking a Senior Java Lead Engineer to design and maintain data pipeline architecture. You will implement data products, provide tech support, and ensure data quality while collaborating with cross-functional teams. Ideal candidates will have extensive...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Pipeline Engineer. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- junior data engineer Winnipeg, MB
- data centre engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB

