Senior Data Engineer Ai Pipelines
Foresight Works
Build AI-ready data pipelines at Foresight, using Python and advanced SQL to make complex project data trusted. This hands-on role is based in New York, San Francisco, or Montreal.As a Senior Data Engineer, you will build the data foundation behind Foresight’s predictions, AI recommendations, analytics, and reporting. You will work with ML engineers and full stack engineers while shaping standards on a new team. The work spans ingestion, modeling, quality, and governance.Key Responsibilities:
Build pipelines from industry scheduling and planning toolsCreate features, training datasets, and search indexesDefine contracts, freshness targets, and quality targetsDesign retries, reruns, backfills, and failure recoveryMonitor data and control costs as volumes growRequirements:
5+ years building and running production data pipelinesStrong Python and advanced SQL skillsDeep Postgres or relational data modeling experienceExperience normalizing messy, inconsistent real-world dataHands-on workflow orchestration experienceBring Python, SQL, data modeling, and pipeline ownership to Foresight’s AI-powered infrastructure project platform.
#J-18808-Ljbffr
Build pipelines from industry scheduling and planning toolsCreate features, training datasets, and search indexesDefine contracts, freshness targets, and quality targetsDesign retries, reruns, backfills, and failure recoveryMonitor data and control costs as volumes growRequirements:
5+ years building and running production data pipelinesStrong Python and advanced SQL skillsDeep Postgres or relational data modeling experienceExperience normalizing messy, inconsistent real-world dataHands-on workflow orchestration experienceBring Python, SQL, data modeling, and pipeline ownership to Foresight’s AI-powered infrastructure project platform.
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer Ai Pipelines in Winnipeg, MB vacancy
- Build trustworthy data pipelines at Foresight using Python, advanced SQL, and production-grade workflow orchestration. Preferred locations include New York, San Francisco, and Montreal.As a Senior Data Engineer, you will build Foresight's data foundation for predictions, AI...PipelineSenior
- Quandri Technologies, Inc. is seeking a senior data engineer to own our Databricks data lake end-to-end, manage pipelines and backfill strategies, and drive data governance across products. You will collaborate with software/AI teams, design scalable data models, and mentor...PipelineSenior
- ...LLC is seeking an experienced software engineer to design, build, and deploy Python-based AI/LLM applications using FastAPI or Flask.... ...scalable enterprise solutions, and AI-powered data analytics platforms. You will optimize data pipelines for performance and scalability while...PipelineSenior
- ...CoFoMo Inc. is seeking an experienced data engineer to design, develop, and optimize ETL/ELT pipelines for structured and unstructured data across cloud platforms. You... ..., and ensure scalable data flows for analytics and AI initiatives. You will collaborate with data scientists...PipelineSenior
- Ipsos in Canada is seeking a Data Engineer for the Ipsos DataHub to build and optimize cloud-based data pipelines and warehouses. The role involves processing large-scale datasets using Python and SQL on cloud platforms, with a focus on scalable, production-ready data infrastructure...PipelineSenior
- Build cloud-based data pipelines at Ipsos using Python, SQL, and serverless technologies to process large-scale datasets. This role supports the Ipsos DataHub.As a Senior Software Engineer focused on data engineering, you will expand and optimize pipeline architecture within...PipelineSenior
- Virtusa in Mississauga is seeking a Lead Software Engineer to guide the design and development of scalable, API‑driven solutions with Generative AI capabilities. You will lead cross‑functional teams to deliver innovative, API‑first architectures that meet client requirements...PipelineSenior
- ..., a Vancouver-based tech company, seeks an Associate Data Engineer to design and maintain core data pipelines powering our prediction-led platform. You will ingest... ...approach. Early-career candidates who actively leverage AI tools to accelerate output are encouraged. #J-18808...Pipeline
- ...Drive AI innovation as a Senior AI Engineer in Mississauga, Canada. Craft Python-based AI applications using FastAPI or Flask while optimizing performance... ...Develop scalable enterprise REST APIs and solutions Build data analytics and self-service platforms Optimize...PipelineSenior
- AWS architecture and data pipeline leadership define this full-time Senior Data Pipeline Engineering Lead role at Hartree Partners. Lead a small engineering team.Reporting to the Head of Finance Technology, you will shape data technology for Finance, Operations, Risk and Compliance...PipelineSeniorFull time
- ...CIBC is seeking a Senior Data Engineer to lead the design and delivery of data products on modern cloud platforms. You will collaborate with business partners and engineering teams to clarify requirements, design data movement across systems, and guide implementation from concept...PipelineSenior
- ...hireVouch is seeking a Senior Data Engineer, ML Platform to own the data infrastructure for training, inference and monitoring. You will shape the lake architecture, build end-to-end ML pipelines and own both offline and online feature stores, ensuring data quality and lineage...PipelineSenior
- ...clinical research and technology, seeks a Principal Software Engineer to design, implement, and govern architecture for scalable products... ...direction, and mentor engineers while driving end-to-end data pipelines and AI-powered applications. The role emphasizes reliability,...PipelineRemote work
- Semios Group is hiring a Data Engineer to design, build, and maintain scalable cloud-based data systems that transform... ...collaborate with Engineering and Data Science to optimize pipelines, integrate diverse sources, and power AI-ready data foundations for agriculture. You will...Pipeline
- ...Lucrodyne, based in the Greater Toronto Area, seeks an experienced AI/ML engineer to implement and support Data & AI solutions for enterprise clients. You will work closely with the Client Technology Manager and drive end-to-end ML workflows. The role involves structured and...Pipeline
- A leading IT consulting firm is seeking a Senior Azure Data Engineer in Toronto, Ontario. The candidate will design and optimize scalable data pipelines within the Microsoft Fabric and SAP BW ecosystem. Qualifications include over 7 years of experience in data engineering, strong...PipelineSeniorFull time
- ...experience in Scala and Apache Spark to design, develop, and optimize scalable big data processing solutions within the Hadoop Spark SparkSQL ecosystem. You will design, implement, and optimize data pipelines, collaborating with data scientists, analysts, and architects to deliver...PipelineSenior
- Luxoft seeks an experienced Senior Data Engineer to onboard, integrate, and operationalize datasets for Middle Office functions. You will build scalable, production-grade data pipelines on AWS (EMR, Glue, Athena, S3) using Spark/PySpark, and own the full lifecycle from design...PipelineSeniorWork at office
- ...Cohere is seeking a Senior Member of Technical Staff specializing in web data for pre-training. You will design and own the large-scale web data pipeline that feeds Cohere’s language models, transforming raw internet data into high-quality training data. You will work with...PipelineSeniorRemote work
- ...Scotiabank is seeking a Software Engineer (Python) in Toronto to design, develop, and support enterprise applications and data platforms. The role emphasizes Python, SQL, APIs, and scalable data pipelines, collaborating with business and technology teams to deliver high-performance...PipelineSenior
- ...ML arteka in Canada is seeking a seasoned Data Ingestion Engineer to build 30+ source connectors for a regulated financial platform on AWS. You... ...ensure production readiness with tests and observability across the pipeline, including CloudWatch dashboards. #J-18808-LjbffrPipelineSenior
- Questrade Financial Group in Canada is seeking a Senior Data Engineer to architect and deliver scalable data pipelines and platform infra. You will bridge trading and brokerage operations with analytics, using dbt, Spark on Kubernetes, and GCP to ensure reliable, auditable...PipelineSenior
$85k - $225k per year
...accuracy, and safety of our Veeva AI Agents through rigorous... ...communicate technical findings to both engineering and product management... ...integrity and coverage of test data sets to reflect real-world usage... .... Automation of Evaluation Pipelines: Develop, implement, and...PipelineSeniorFull timeWork at officeLocal areaRemote workWork from home- SiftMed seeks a senior engineer to shape the platform’s next stage. You’ll own features from problem to production, work directly with the CTO... ...VP Product, and influence the architecture of the document pipeline, cloud infrastructure, and security. You’ll collaborate closely...PipelineSeniorInternship
- Elevate your career as an AI Engineer, implementing cutting-edge MLOps and ETL pipelines. Join our innovative team to containerize and deploy impactful AI models in... ...prototypes into robust services. Collaborate with data scientists and maintain model governance principles...Pipeline
$105.4k - $125.12k per year
...****@*****.*** .AI Disclosure StatementTo ensure an efficient... ...careers page.Your role asSenior Data Platform DeveloperWe are looking for a Senior Data Platform Developer that... ..., you will define and implement engineering best practices across the full data...PipelineSeniorInternshipWork at officeRemote work3 days per week- Litmus in Canada is building the data foundation that powers industrial AI. We’re looking for a Senior Golang Engineer to own high-throughput data pipelines and real-time streams that ingest, transform, and route industrial data at scale, across edge and cloud environments....PipelineSeniorWorldwide
- Engineer reliable cloud data pipelines using BigQuery, REST APIs, and Python for Clever Digital Marketing’s fully remote Canadian team. Strengthen the infrastructure behind measurable advertising performance.As an Intermediate Data Engineer, you will build within an established...PipelineRemote work
- Build trusted measurement data pipelines with Python and SQL as a remote-first Data Engineer serving Canada or the United States. Turn messy site data into dependable systems.In this full-time core engineering role, you will build and run production pipelines for data from installed...PipelineFull timeRemote work
- ...full-time professionals, and our annual growth rate exceeds 25%. Job Description Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US healthcare client. You will play a key role in developing and enhancing an enterprise...SeniorFull timeInternshipRemote workRelocation
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer Ai Pipelines. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
- junior data engineer Winnipeg, MB

