Senior Data Engineer Ai Pipelines
Foresight Works
Build AI-ready data pipelines at Foresight, using Python and advanced SQL to make complex project data trusted. This hands-on role is based in New York, San Francisco, or Montreal.As a Senior Data Engineer, you will build the data foundation behind Foresight’s predictions, AI recommendations, analytics, and reporting. You will work with ML engineers and full stack engineers while shaping standards on a new team. The work spans ingestion, modeling, quality, and governance.Key Responsibilities:
Build pipelines from industry scheduling and planning toolsCreate features, training datasets, and search indexesDefine contracts, freshness targets, and quality targetsDesign retries, reruns, backfills, and failure recoveryMonitor data and control costs as volumes growRequirements:
5+ years building and running production data pipelinesStrong Python and advanced SQL skillsDeep Postgres or relational data modeling experienceExperience normalizing messy, inconsistent real-world dataHands-on workflow orchestration experienceBring Python, SQL, data modeling, and pipeline ownership to Foresight’s AI-powered infrastructure project platform.
#J-18808-Ljbffr
Build pipelines from industry scheduling and planning toolsCreate features, training datasets, and search indexesDefine contracts, freshness targets, and quality targetsDesign retries, reruns, backfills, and failure recoveryMonitor data and control costs as volumes growRequirements:
5+ years building and running production data pipelinesStrong Python and advanced SQL skillsDeep Postgres or relational data modeling experienceExperience normalizing messy, inconsistent real-world dataHands-on workflow orchestration experienceBring Python, SQL, data modeling, and pipeline ownership to Foresight’s AI-powered infrastructure project platform.
#J-18808-Ljbffr
Vacancy posted 24 minutes ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer Ai Pipelines in Winnipeg, MB vacancy
- Quandri is seeking a Senior Data Engineer to own the Databricks data lake, medallion layers, and streaming ingestion. You will partner with engineers... ..., and product teams to build scalable data platforms and AI data infrastructure. You’ll design multi-tenant data architectures...PipelineSenior
- Build trustworthy data pipelines at Foresight using Python, advanced SQL, and production-grade workflow orchestration. Preferred locations include New York, San Francisco, and Montreal.As a Senior Data Engineer, you will build Foresight's data foundation for predictions, AI...PipelineSenior
- ...LLC is seeking an experienced software engineer to design, build, and deploy Python-based AI/LLM applications using FastAPI or Flask.... ...scalable enterprise solutions, and AI-powered data analytics platforms. You will optimize data pipelines for performance and scalability while...PipelineSenior
- Ipsos in Canada is seeking a Data Engineer for the Ipsos DataHub to build and optimize cloud-based data pipelines and warehouses. The role involves processing large-scale datasets using Python and SQL on cloud platforms, with a focus on scalable, production-ready data infrastructure...PipelineSenior
- Quandri Technologies, Inc. is seeking a senior data engineer to own our Databricks data lake end-to-end, manage pipelines and backfill strategies, and drive data governance across products. You will collaborate with software/AI teams, design scalable data models, and mentor...PipelineSenior
- Build cloud-based data pipelines at Ipsos using Python, SQL, and serverless technologies to process large-scale datasets. This role supports the Ipsos DataHub.As a Senior Software Engineer focused on data engineering, you will expand and optimize pipeline architecture within...PipelineSenior
- ..., a Vancouver-based tech company, seeks an Associate Data Engineer to design and maintain core data pipelines powering our prediction-led platform. You will ingest... ...approach. Early-career candidates who actively leverage AI tools to accelerate output are encouraged. #J-18808...Pipeline
$136k - $170k per year
...ideas for the benefit of others. As a Infrastructure Engineer at the company, you will run our Production... ...large scale distributed systems. About the TeamData Pipelines is at the heart of all critical data flowing through the company supporting hundreds of services...PipelineSeniorHourly payWork at officeFlexible hours3 days per week- Support Airflow scheduling and data pipeline delivery remotely as a Senior Data Engineer for PENN Interactive and theScore platforms.This senior position partners with Data Services, business stakeholders, and data engineers to deliver reliable transformed data. Responsibilities...PipelineSeniorRemote work
- A data-driven company in Canada is seeking an Engineering Manager to lead a team focused on data ingestion and integration. You'll manage engineering processes, drive best practices in data quality, and collaborate on analytics infrastructure for over 7000+ agencies. Ideal...Pipeline
- Virtusa in Mississauga is seeking a Lead Software Engineer to guide the design and development of scalable, API‑driven solutions with Generative AI capabilities. You will lead cross‑functional teams to deliver innovative, API‑first architectures that meet client requirements...PipelineSenior
$160.8k - $260.15k per year
As a Principal Software Engineer on the AEC Solutions team, you will join a team of technologists to build data pipelines to power our work in artificial intelligence, deep learning, generative AI, machine learning, reinforcement learning, information retrieval, and natural...PipelineSenior- Athennian is seeking a Software Engineer to join the Data Migration Team, reporting to the Senior Engineering Manager of Data Management. You will bridge client onboarding... ...will architect and maintain robust migration pipelines that move complex legal data from legacy systems...PipelineSenior
- Waabi, founded by AI pioneer and visionary Raquel Urtasun, is an... ...Waabi’s cutting edge AV stack and data‑driven simulator.Build and own robust, petabyte‑scale ETL pipelines for ingesting and aggregating... ...of a team of multidisciplinary Engineers, Research Scientists, and Product...PipelineSeniorFull timeInternshipWork at officeWork from homeFlexible hours
- An innovative technology firm in Mississauga is seeking a Senior Data Engineer to design and build scalable data pipelines within Microsoft Fabric. This role contributes to major digital transformation projects, ensuring data products are AI-ready and governed. The ideal candidate...PipelineSenior
- Semios Group is hiring a Data Engineer to design, build, and maintain scalable cloud-based data systems that transform... ...collaborate with Engineering and Data Science to optimize pipelines, integrate diverse sources, and power AI-ready data foundations for agriculture. You will...Pipeline
- AWS architecture and data pipeline leadership define this full-time Senior Data Pipeline Engineering Lead role at Hartree Partners. Lead a small engineering team.Reporting to the Head of Finance Technology, you will shape data technology for Finance, Operations, Risk and Compliance...PipelineSeniorFull time
- OpenTable in Toronto is seeking a Data Engineer II to design, build, and maintain data pipelines powering diner features, partner integrations, and AI initiatives. You’ll work with Product Managers, BI Analysts, SREs, and Product Engineers to deliver scalable data products in...PipelineWork at office
- ...Drive AI innovation as a Senior AI Engineer in Mississauga, Canada. Craft Python-based AI applications using FastAPI or Flask while optimizing performance... ...Develop scalable enterprise REST APIs and solutions Build data analytics and self-service platforms Optimize...PipelineSenior
$136k - $170k per year
...Space LLC in Toronto is seeking an experienced Infrastructure Engineer to own Production Infrastructure, monitor system health and automate... ...at scale. You will build platforms and services for data pipelines, partnering with cross-functional teams to anticipate customer...PipelineSeniorWork at office3 days per week- Questrade Financial Group in Canada is seeking a Senior Data Engineer to architect and deliver scalable data pipelines and platform infra. You will bridge trading and brokerage operations with analytics, using dbt, Spark on Kubernetes, and GCP to ensure reliable, auditable...PipelineSenior
- Luxoft seeks an experienced Senior Data Engineer to onboard, integrate, and operationalize datasets for Middle Office functions. You will build scalable, production-grade data pipelines on AWS (EMR, Glue, Athena, S3) using Spark/PySpark, and own the full lifecycle from design...PipelineSeniorWork at office
- ...experience in Scala and Apache Spark to design, develop, and optimize scalable big data processing solutions within the Hadoop Spark SparkSQL ecosystem. You will design, implement, and optimize data pipelines, collaborating with data scientists, analysts, and architects to deliver...PipelineSenior
- A global technology services company is seeking a Senior Production Support Engineer in Halifax to ensure the stability and reliability of production systems. The successful candidate will monitor and troubleshoot issues, adhering to SLAs, and provide customer support. Candidates...PipelineSenior
- A leading IT consulting firm is seeking a Senior Azure Data Engineer in Toronto, Ontario. The candidate will design and optimize scalable data pipelines within the Microsoft Fabric and SAP BW ecosystem. Qualifications include over 7 years of experience in data engineering, strong...PipelineSeniorFull time
- ...Scotiabank is seeking a Software Engineer (Python) in Toronto to design, develop, and support enterprise applications and data platforms. The role emphasizes Python, SQL, APIs, and scalable data pipelines, collaborating with business and technology teams to deliver high-performance...PipelineSenior
- ...hireVouch is seeking a Senior Data Engineer, ML Platform to own the data infrastructure for training, inference and monitoring. You will shape the lake architecture, build end-to-end ML pipelines and own both offline and online feature stores, ensuring data quality and lineage...PipelineSenior
- ...ML arteka in Canada is seeking a seasoned Data Ingestion Engineer to build 30+ source connectors for a regulated financial platform on AWS. You... ...ensure production readiness with tests and observability across the pipeline, including CloudWatch dashboards. #J-18808-LjbffrPipelineSenior
- Ledcor Group is hiring a Senior Data Engineer to join the Data & Analytics Platform team. You will design, build, and maintain enterprise-scale data solutions supporting reporting, analytics, and operational intelligence across Ledcor's construction and infrastructure businesses...PipelineSenior
- ...Dialogue is seeking a Senior Data Platform Developer to design, build, and maintain our modern data platform. You will define engineering best practices, enable power users, and own Snowflake, dbt, and deployment pipelines. You will collaborate with Product, Sales, Ops, and...PipelineSenior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer Ai Pipelines. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- junior data engineer Winnipeg, MB
- data centre engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB

