Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer For On-Chain Pipelines

CLR3

Join datastore in building reliable data pipelines that decode years of on-chain history into trustworthy Parquet files for researchers. Elevate data correctness and infrastructure while ensuring high quality and accuracy.
As a Data Engineer, you will design and run large-scale decoding pipelines, focusing on Solana and Hyperliquid history. This role demands significant experience in building production data pipelines, emphasizing SQL alongside either Python, Rust, or Go. You'll ensure correctness through rigorous validation, checksums, and lineage documentation, addressing customer inquiries about schemas and coverage.
Key Responsibilities: - Design and implement backfill pipelines at scale - Model typed schemas for various protocols - Build validation systems for data correctness - Maintain accurate versioning and documentation - Optimize storage layout for fast query performance
Requirements: - Proven experience in production data pipeline development - Proficiency in SQL plus Python, Rust, or Go - Familiarity with Parquet and tools like DuckDB - Strong focus on data correctness and validation - Willingness to work part-time in Toronto office
Help create a reliable data pipeline that researchers can trust, ensuring high-quality deliveries every time.#J-18808-Ljbffr
Vacancy posted 57 minutes ago
Similar jobs that could be interesting for youBased on the Data Engineer For On-Chain Pipelines in Winnipeg, MB vacancy
  • Build trusted measurement data pipelines with Python and SQL as a remote-first Data Engineer serving Canada or the United States. Turn messy site data into dependable systems.In this full-time core engineering role, you will build and run production pipelines for data from installed... 
    Pipeline
    Full time
    Remote work

    Elastic Energy, Inc.

    Winnipeg, MB
    1 hour ago
  • Build trustworthy data pipelines at Foresight using Python, advanced SQL, and production-grade workflow orchestration. Preferred locations...  ...include New York, San Francisco, and Montreal.As a Senior Data Engineer, you will build Foresight's data foundation for predictions, AI... 
    Pipeline

    Foresight

    Winnipeg, MB
    57 minutes ago
  • Shape LLM and RAG pipelines through data modeling, embeddings, and vector databases at Connor, Clark & Lunn Financial Group.As a Senior Data Integration Engineer, you will enrich structured, semi-structured, and unstructured data for enterprise AI. The role combines semantic... 
    Pipeline

    Connor, Clark & Lunn Financial Group Ltd.

    Winnipeg, MB
    1 hour ago
  • Build cloud-based data pipelines at Ipsos using Python, SQL, and serverless technologies to process large-scale datasets. This role supports the Ipsos DataHub.As a Senior Software Engineer focused on data engineering, you will expand and optimize pipeline architecture within... 
    Pipeline

    Ipsos in Canada

    Winnipeg, MB
    1 hour ago
  • Build AI-ready data pipelines at Foresight, using Python and advanced SQL to make complex project data trusted. This hands-on role is based in New York, San Francisco, or Montreal.As a Senior Data Engineer, you will build the data foundation behind Foresight’s predictions, AI... 
    Pipeline

    Foresight Works

    Winnipeg, MB
    1 hour ago
  • $136k - $160k per year

     ...Unchain Data in Toronto is seeking a Software Developer on our Data Engineering team to build core datasets powering analytics, experimentation, and ML across our platform. You will design scalable pipelines and tooling, collaborating with engineers, data scientists, and business... 
    Pipeline

    Unchain Data

    Winnipeg, MB
    55 minutes ago
  •  ...recherche un Développeur.euse principal.e, Données, pour concevoir et livrer des pipelines et ensembles de données fiables alimentant les rapports, l'analytique et les systèmes en aval dans le data mesh de SSENSE. Intégré au groupe Technologie et ingénierie, vous mettrez à... 
    Pipeline

    Ssense

    Winnipeg, MB
    59 minutes ago
  •  ...Python and SQL systems for Mecka AI’s global robotics data infrastructure, working on production delivery pipelines at scale. Turn changing customer specifications into reproducible datasets efficiently.As a Software Engineer in Delivery Ops, you will build systems that... 
    Pipeline

    Mecka

    Winnipeg, MB
    1 hour ago
  • AWS Data Engineer building Salesforce pipelines and analytics infrastructure powers Kindsight’s customer-facing products through production data systems.As a hands-on Data Engineer, you will ingest customer data into AWS and transform it through warehouses supporting dashboards... 
    Pipeline

    Kindsight

    Winnipeg, MB
    1 hour ago
  •  ...s agent-era products from a hybrid Toronto office schedule.As a Machine Learning Engineer, you will transform customer CRM and warehouse records into model-ready data. You will design pipelines that help each customer’s digital twins improve without leaking information across... 
    Pipeline
    Work at office

    Point11

    Winnipeg, MB
    57 minutes ago
  • Build Azure data pipelines with Tata Consultancy Services using SQL, Python, and cloud data platforms. Apply big data expertise to structured and semi-structured datasets.As an Azure Data Engineer, you will design and develop cloud-based pipelines from business requirements... 
    Pipeline

    Tata Consultancy Services Limited

    Winnipeg, MB
    58 minutes ago
  • Build complex data pipelines with Python and SQL Server while working onsite five days weekly alongside operational teams. Maintain extremely accurate reporting solutions and data systems.As a Data Engineer, you will develop, test, deploy, and maintain ELT pipelines from varied... 
    Pipeline

    Petroglyph Development Group

    Winnipeg, MB
    59 minutes ago
  • Mariner is seeking a Data Engineering Specialist to design and operate scalable data pipelines and cloud data platforms. You will implement ETL/ELT processes, ensure data quality and governance, and collaborate with architects, analysts, and stakeholders to deliver data solutions... 
    Pipeline
    Remote work

    Mariner

    Winnipeg, MB
    59 minutes ago
  • AWS architecture and data pipeline leadership define this full-time Senior Data Pipeline Engineering Lead role at Hartree Partners. Lead a small engineering team.Reporting to the Head of Finance Technology, you will shape data technology for Finance, Operations, Risk and Compliance... 
    Pipeline
    Full time

    Hartree Partners

    Winnipeg, MB
    1 hour ago
  • A leading IT consulting firm is seeking a Senior Azure Data Engineer in Toronto, Ontario. The candidate will design and optimize scalable data pipelines within the Microsoft Fabric and SAP BW ecosystem. Qualifications include over 7 years of experience in data engineering,... 
    Pipeline
    Full time

    Astra-North Infoteck Inc.

    Winnipeg, MB
    59 minutes ago
  • Cardinal Health Canada is seeking a Data Engineer to design, build, and maintain scalable data pipelines and models that support reporting, analytics, and decision making. The role requires hands-on SQL, data integration, and cloud platform experience within a collaborative... 
    Pipeline

    Cardinal Health Canada Inc.

    Winnipeg, MB
    59 minutes ago
  •  ...Tailscale is seeking an Analytics Engineer to design and maintain scalable data models and pipelines. You will collaborate with Finance, Engineering, Sales, and other teams to deliver reliable data for reporting, analysis, and decision-making. You’ll own production-grade... 
    Pipeline
    Remote work

    ProfilHQ

    Winnipeg, MB
    1 hour ago
  • Questrade Financial Group in Canada is seeking a Senior Data Engineer to architect and deliver scalable data pipelines and platform infra. You will bridge trading and brokerage operations with analytics, using dbt, Spark on Kubernetes, and GCP to ensure reliable, auditable data... 
    Pipeline

    Questrade Financial Group

    Winnipeg, MB
    56 minutes ago
  • AeroVect is hiring a Staff Software Engineer, Infrastructure (Cloud) to own data infrastructure powering our autonomous driving platform. You will design scalable pipelines moving data from on-prem to cloud, and manage cloud infrastructure for performance and reliability. The... 
    Pipeline

    AeroVect

    Winnipeg, MB
    58 minutes ago
  •  ...Clever Digital Marketing is seeking an Intermediate Data Engineer to scale our GCP-native data platform. You’ll own Bronze–Gold pipeline components, integrate ad-platform APIs, and deliver trusted datasets for client reporting and AI/ML use. Join a fast-growing team in Canada... 
    Pipeline
    Remote work

    Clever Digital Marketing

    Winnipeg, MB
    58 minutes ago
  •  ...Cohere is seeking a Senior Member of Technical Staff specializing in web data for pre-training. You will design and own the large-scale web data pipeline that feeds Cohere’s language models, transforming raw internet data into high-quality training data. You will work with... 
    Pipeline
    Remote work

    Avenue.io Inc.

    Winnipeg, MB
    1 hour ago
  • Shift4 is seeking a Data Platform Engineer to build, maintain, and optimize data ingestion pipelines from production systems into Snowflake. You will focus on pipeline performance, reliability, scalability, cost efficiency, and observability. Experience with ECS, SQS, Python... 
    Pipeline

    Shift4

    Winnipeg, MB
    57 minutes ago
  •  ...Samsara is seeking a Data Engineer in Canada to join our Data team. You will design and maintain data pipelines in a central data lake, using SparkSQL and PySpark to ingest and transform IoT device data and software product data into our core data model for analytics and dashboards... 
    Pipeline
    Remote work

    Samsara

    Winnipeg, MB
    59 minutes ago
  •  ...hireVouch is seeking a Senior Data Engineer, ML Platform to own the data infrastructure for training, inference and monitoring. You will shape the lake architecture, build end-to-end ML pipelines and own both offline and online feature stores, ensuring data quality and lineage... 
    Pipeline

    hireVouch

    Winnipeg, MB
    1 hour ago
  •  ...experience in Scala and Apache Spark to design, develop, and optimize scalable big data processing solutions within the Hadoop Spark SparkSQL ecosystem. You will design, implement, and optimize data pipelines, collaborating with data scientists, analysts, and architects to deliver... 
    Pipeline

    LTM

    Winnipeg, MB
    55 minutes ago
  • The Databricks Engineer will design, develop, and optimize large-scale data pipelines using Databricks and Azure cloud services.This role requires advanced expertise in Spark/PySpark, Delta Lake technologies, data governance, and cloud-based data engineering.The engineer will... 
    Pipeline

    Compunnel Inc.

    Winnipeg, MB
    1 hour ago
  • Punt, a Vancouver-based tech company, seeks an Associate Data Engineer to design and maintain core data pipelines powering our prediction-led platform. You will ingest high-volume datasets, write production transformations, and ensure data accuracy for business-critical applications... 
    Pipeline

    Punt

    Winnipeg, MB
    59 minutes ago
  •  ...CIBC is seeking a Senior Data Engineer to lead the design and delivery of data products on modern cloud platforms. You will collaborate with business partners and engineering teams to clarify requirements, design data movement across systems, and guide implementation from... 
    Pipeline

    CIBC

    Winnipeg, MB
    1 hour ago
  • Luxoft seeks an experienced Senior Data Engineer to onboard, integrate, and operationalize datasets for Middle Office functions. You will build scalable, production-grade data pipelines on AWS (EMR, Glue, Athena, S3) using Spark/PySpark, and own the full lifecycle from design... 
    Pipeline
    Work at office

    Luxoft

    Winnipeg, MB
    57 minutes ago
  • Client is seeking a Senior Data Engineer to support the modernization of tooling enablement functions. This role is responsible for designing...  ...objects in the Snowflake cloud data store, utilizing ETL pipelines (Talend, Informatica) and APIs. The ideal candidate is a self-... 
    Pipeline

    Compunnel, Inc.

    Winnipeg, MB
    58 minutes ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer For On-Chain Pipelines. Be the first to apply!