Senior Data Pipeline Engineer
Foresight
Build trustworthy data pipelines at Foresight using Python, advanced SQL, and production-grade workflow orchestration. Preferred locations include New York, San Francisco, and Montreal.As a Senior Data Engineer, you will build Foresight's data foundation for predictions, AI recommendations, analytics, and customer reporting. You will own production pipelines from source to consumer while shaping standards on a new team. The work includes project data ingestion, modeling, observability, and governance.Key Responsibilities:
Build robust pipelines from industry scheduling and planning toolsPreserve update history for confident point-in-time comparisonsDevelop features, training datasets, and search indexes for AICreate models and pipelines for dashboards, reports, and exportsSet data contracts, freshness targets, and quality standardsRequirements:
Five or more years building production data pipelinesStrong Python and advanced SQL skillsDeep Postgres or relational database modeling experienceExperience normalizing messy, inconsistent real-world dataHands-on workflow orchestration, retries, dependencies, and backfillsBring pipeline ownership, data modeling, and quality engineering to Foresight's infrastructure intelligence platform.
#J-18808-Ljbffr
Build robust pipelines from industry scheduling and planning toolsPreserve update history for confident point-in-time comparisonsDevelop features, training datasets, and search indexes for AICreate models and pipelines for dashboards, reports, and exportsSet data contracts, freshness targets, and quality standardsRequirements:
Five or more years building production data pipelinesStrong Python and advanced SQL skillsDeep Postgres or relational database modeling experienceExperience normalizing messy, inconsistent real-world dataHands-on workflow orchestration, retries, dependencies, and backfillsBring pipeline ownership, data modeling, and quality engineering to Foresight's infrastructure intelligence platform.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Senior Data Pipeline Engineer in Winnipeg, MB vacancy
$136k - $170k per year
...ideas for the benefit of others. As a Infrastructure Engineer at the company, you will run our Production... ...large scale distributed systems. About the TeamData Pipelines is at the heart of all critical data flowing through the company supporting hundreds of services...SeniorHourly payWork at officeFlexible hours3 days per week- Build AI-ready data pipelines at Foresight, using Python and advanced SQL to make complex project data trusted. This hands-on role is based in New York, San Francisco, or Montreal.As a Senior Data Engineer, you will build the data foundation behind Foresight’s predictions, AI...Senior
- Build cloud-based data pipelines at Ipsos using Python, SQL, and serverless technologies to process large-scale datasets. This role supports the Ipsos DataHub.As a Senior Software Engineer focused on data engineering, you will expand and optimize pipeline architecture within...Senior
- Support Airflow scheduling and data pipeline delivery remotely as a Senior Data Engineer for PENN Interactive and theScore platforms.This senior position partners with Data Services, business stakeholders, and data engineers to deliver reliable transformed data. Responsibilities...SeniorRemote work
- A global technology services company is seeking a Senior Production Support Engineer in Halifax to ensure the stability and reliability of production systems. The successful candidate will monitor and troubleshoot issues, adhering to SLAs, and provide customer support. Candidates...Senior
- Luxoft seeks an experienced Senior Data Engineer to onboard, integrate, and operationalize datasets for Middle Office functions. You will build scalable, production-grade data pipelines on AWS (EMR, Glue, Athena, S3) using Spark/PySpark, and own the full lifecycle from design...SeniorWork at office
- ...Scotiabank is seeking a Software Engineer (Python) in Toronto to design, develop, and support enterprise applications and data platforms. The role emphasizes Python, SQL, APIs, and scalable data pipelines, collaborating with business and technology teams to deliver high-performance...Senior
- ...hireVouch is seeking a Senior Data Engineer, ML Platform to own the data infrastructure for training, inference and monitoring. You will shape the lake architecture, build end-to-end ML pipelines and own both offline and online feature stores, ensuring data quality and lineage...Senior
- Questrade Financial Group in Canada is seeking a Senior Data Engineer to architect and deliver scalable data pipelines and platform infra. You will bridge trading and brokerage operations with analytics, using dbt, Spark on Kubernetes, and GCP to ensure reliable, auditable...Senior
- ...Dialogue is seeking a Senior Data Platform Developer to design, build, and maintain our modern data platform. You will define engineering best practices, enable power users, and own Snowflake, dbt, and deployment pipelines. You will collaborate with Product, Sales, Ops, and...Senior
- ...CIBC is seeking a Senior Data Engineer to lead the design and delivery of data products on modern cloud platforms. You will collaborate with business partners and engineering teams to clarify requirements, design data movement across systems, and guide implementation from concept...Senior
- Ledcor Group is hiring a Senior Data Engineer to join the Data & Analytics Platform team. You will design, build, and maintain enterprise-scale data solutions supporting reporting, analytics, and operational intelligence across Ledcor's construction and infrastructure businesses...Senior
- An innovative technology firm in Mississauga is seeking a Senior Data Engineer to design and build scalable data pipelines within Microsoft Fabric. This role contributes to major digital transformation projects, ensuring data products are AI-ready and governed. The ideal candidate...Senior
- Quandri is seeking a Senior Data Engineer to own the Databricks data lake, medallion layers, and streaming ingestion. You will partner with engineers, data scientists, and product teams to build scalable data platforms and AI data infrastructure. You’ll design multi-tenant data...Senior
- ...ML arteka in Canada is seeking a seasoned Data Ingestion Engineer to build 30+ source connectors for a regulated financial platform on AWS. You... ...ensure production readiness with tests and observability across the pipeline, including CloudWatch dashboards. #J-18808-LjbffrSenior
- AWS architecture and data pipeline leadership define this full-time Senior Data Pipeline Engineering Lead role at Hartree Partners. Lead a small engineering team.Reporting to the Head of Finance Technology, you will shape data technology for Finance, Operations, Risk and Compliance...SeniorFull time
$136k - $170k per year
...Space LLC in Toronto is seeking an experienced Infrastructure Engineer to own Production Infrastructure, monitor system health and automate... ...at scale. You will build platforms and services for data pipelines, partnering with cross-functional teams to anticipate customer...SeniorWork at office3 days per week- A leading IT consulting firm is seeking a Senior Azure Data Engineer in Toronto, Ontario. The candidate will design and optimize scalable data pipelines within the Microsoft Fabric and SAP BW ecosystem. Qualifications include over 7 years of experience in data engineering, strong...SeniorFull time
- ...experience in Scala and Apache Spark to design, develop, and optimize scalable big data processing solutions within the Hadoop Spark SparkSQL ecosystem. You will design, implement, and optimize data pipelines, collaborating with data scientists, analysts, and architects to deliver...Senior
- ...Contribute to Waabi’s cutting edge AV stack and data‑driven simulator.Build and own robust, petabyte‑scale ETL pipelines for ingesting and aggregating multi‑sensor data... ...software.Be part of a team of multidisciplinary Engineers, Research Scientists, and Product Managers using...SeniorFull timeInternshipWork at officeWork from homeFlexible hours
- Engineer reliable cloud data pipelines using BigQuery, REST APIs, and Python for Clever Digital Marketing’s fully remote Canadian team. Strengthen the infrastructure behind measurable advertising performance.As an Intermediate Data Engineer, you will build within an established...Remote work
- SparkSQL and PySpark power this remote Data Engineer role at Samsara for candidates residing in Canada. Build pipelines supporting analytics and machine learning.As a Data Engineer on Samsara’s Data team, you will develop and maintain pipelines within the central data lake....Remote work
- Build trusted measurement data pipelines with Python and SQL as a remote-first Data Engineer serving Canada or the United States. Turn messy site data into dependable systems.In this full-time core engineering role, you will build and run production pipelines for data from installed...Full timeRemote work
- Join datastore in building reliable data pipelines that decode years of on-chain history into trustworthy Parquet files for researchers. Elevate... ...while ensuring high quality and accuracy. As a Data Engineer, you will design and run large-scale decoding pipelines, focusing...Part timeWork at office
- The Data Engineer will be responsible for developing and maintaining scalable data solutions, with a primary focus on Snowflake and SQL.This... ...will bring extensive experience in building efficient data pipelines, optimizing data models, and supporting cloud-based data environments...Senior
- A leading recruitment firm is seeking a Senior Java Lead Engineer to design and maintain data pipeline architecture. You will implement data products, provide tech support, and ensure data quality while collaborating with cross-functional teams. Ideal candidates will have extensive...Senior
- Senior Data Engineer Department: Development - Software DevelopmentEmployment Type: Permanent - Full TimeLocation: Montreal, CanadaReporting... ...tools and technologies to build reliable, high-quality data pipelines. You’ll collaborate with teams across the business,...SeniorPermanent employmentFlexible hours
$105.4k - $125.12k per year
...careers page.Your role asSenior Data Platform DeveloperWe are looking for a Senior Data Platform Developer that... ...role, you will define and implement engineering best practices across the full... ...Orchestrate robust and resilient data pipelines utilizing Airflow (with...SeniorInternshipWork at officeRemote work3 days per week- ...recherchons un(e) Ingénieur(e) de données de niveau intermédiaire à senior pour concevoir, développer et maintenir des solutions de données... ...principalesConcevoir, développer et maintenir des pipelines de données fiables et évolutifs.Développer et optimiser des requêtes...Senior
- Iris Software Inc. is seeking an experienced AWS Data Engineer in Toronto to design, build, and operate scalable data pipelines on AWS. The role emphasizes ETL/ELT processes, data warehousing concepts, and collaboration with onsite and offshore teams to deliver robust data solutions...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Pipeline Engineer. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- junior data engineer Winnipeg, MB
- data centre engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB

