Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer For On-Chain Pipelines

CLR3

Join datastore in building reliable data pipelines that decode years of on-chain history into trustworthy Parquet files for researchers. Elevate data correctness and infrastructure while ensuring high quality and accuracy.
As a Data Engineer, you will design and run large-scale decoding pipelines, focusing on Solana and Hyperliquid history. This role demands significant experience in building production data pipelines, emphasizing SQL alongside either Python, Rust, or Go. You'll ensure correctness through rigorous validation, checksums, and lineage documentation, addressing customer inquiries about schemas and coverage.
Key Responsibilities: - Design and implement backfill pipelines at scale - Model typed schemas for various protocols - Build validation systems for data correctness - Maintain accurate versioning and documentation - Optimize storage layout for fast query performance
Requirements: - Proven experience in production data pipeline development - Proficiency in SQL plus Python, Rust, or Go - Familiarity with Parquet and tools like DuckDB - Strong focus on data correctness and validation - Willingness to work part-time in Toronto office
Help create a reliable data pipeline that researchers can trust, ensuring high-quality deliveries every time.#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Data Engineer For On-Chain Pipelines in Winnipeg, MB vacancy
  • SparkSQL and PySpark power this remote Data Engineer role at Samsara for candidates residing in Canada. Build pipelines supporting analytics and machine learning.As a Data Engineer on Samsara’s Data team, you will develop and maintain pipelines within the central data lake.... 
    Pipeline
    Remote work

    Samsara Inc.

    Winnipeg, MB
    1 hour ago
  • Build trustworthy data pipelines at Foresight using Python, advanced SQL, and production-grade workflow orchestration. Preferred locations...  ...include New York, San Francisco, and Montreal.As a Senior Data Engineer, you will build Foresight's data foundation for predictions, AI... 
    Pipeline

    Foresight

    Winnipeg, MB
    1 hour ago
  • Engineer reliable cloud data pipelines using BigQuery, REST APIs, and Python for Clever Digital Marketing’s fully remote Canadian team. Strengthen the infrastructure behind measurable advertising performance.As an Intermediate Data Engineer, you will build within an established... 
    Pipeline
    Remote work

    Clever Digital Marketing

    Winnipeg, MB
    1 hour ago
  • Build trusted measurement data pipelines with Python and SQL as a remote-first Data Engineer serving Canada or the United States. Turn messy site data into dependable systems.In this full-time core engineering role, you will build and run production pipelines for data from installed... 
    Pipeline
    Full time
    Remote work

    Elastic Energy, Inc.

    Winnipeg, MB
    1 hour ago
  • Engineer enterprise-scale data pipelines with Python, Apache Spark, and Apache Beam for modern cloud-based data platforms. Apply strong SQL and platform expertise.This Senior Data Engineer role at TechBlocks centers on building and expanding enterprise data capabilities. You... 
    Pipeline

    Techblocks

    Winnipeg, MB
    1 hour ago
  • $136k - $170k per year

     ...ideas for the benefit of others. As a Infrastructure Engineer at the company, you will run our Production...  ...large scale distributed systems. About the TeamData Pipelines is at the heart of all critical data flowing through the company supporting hundreds of services... 
    Pipeline
    Hourly pay
    Work at office
    Flexible hours
    3 days per week

    Lyft Inc

    Winnipeg, MB
    1 hour ago
  • Engineer monitored, governed data flows with Python and Spark for Croesus's wealth management platforms. This hybrid position requires two weekly office...  ...Expert develops and operates modern Databricks Lakehouse pipelines supporting analytics and artificial intelligence... 
    Pipeline
    Work at office

    Croesus

    Winnipeg, MB
    1 hour ago
  • Engineer fault-tolerant data platforms at Semios, working across GCP and AWS with SQL, dbt, and production workflow orchestration.This Data Engineer...  ...access across multi-cloud environments. You will optimize pipelines, automate manual processes, and maintain models that transform... 
    Pipeline

    Semios

    Winnipeg, MB
    1 hour ago
  • Build AI-ready data pipelines at Foresight, using Python and advanced SQL to make complex project data trusted. This hands-on role is based in New York, San Francisco, or Montreal.As a Senior Data Engineer, you will build the data foundation behind Foresight’s predictions, AI... 
    Pipeline

    Foresight Works

    Winnipeg, MB
    1 hour ago
  • $136k - $160k per year

     ...Unchain Data in Toronto is seeking a Software Developer on our Data Engineering team to build core datasets powering analytics, experimentation, and ML across our platform. You will design scalable pipelines and tooling, collaborating with engineers, data scientists, and business... 
    Pipeline

    Unchain Data

    Winnipeg, MB
    1 hour ago
  • Build Azure data pipelines with Tata Consultancy Services using SQL, Python, and cloud data platforms. Apply big data expertise to structured and semi-structured datasets.As an Azure Data Engineer, you will design and develop cloud-based pipelines from business requirements... 
    Pipeline

    Tata Consultancy Services Limited

    Winnipeg, MB
    1 hour ago
  • Support Airflow scheduling and data pipeline delivery remotely as a Senior Data Engineer for PENN Interactive and theScore platforms.This senior position partners with Data Services, business stakeholders, and data engineers to deliver reliable transformed data. Responsibilities... 
    Pipeline
    Remote work

    Penn Interactive Ventures

    Winnipeg, MB
    1 hour ago
  • Build complex data pipelines with Python and SQL Server while working onsite five days weekly alongside operational teams. Maintain extremely accurate reporting solutions and data systems.As a Data Engineer, you will develop, test, deploy, and maintain ELT pipelines from varied... 
    Pipeline

    Petroglyph Development Group

    Winnipeg, MB
    1 hour ago
  •  ...s agent-era products from a hybrid Toronto office schedule.As a Machine Learning Engineer, you will transform customer CRM and warehouse records into model-ready data. You will design pipelines that help each customer’s digital twins improve without leaking information across... 
    Pipeline
    Work at office

    Point11

    Winnipeg, MB
    1 hour ago
  • Build cloud-based data pipelines at Ipsos using Python, SQL, and serverless technologies to process large-scale datasets. This role supports the Ipsos DataHub.As a Senior Software Engineer focused on data engineering, you will expand and optimize pipeline architecture within... 
    Pipeline

    Ipsos in Canada

    Winnipeg, MB
    1 hour ago
  • Become a key player at Electronic Arts as a Software Data Engineer, enhancing the quality of games through innovative data solutions designed...  ...and ML experts. Your focus will be on building scalable data pipelines, securing data integrity in Frostbite processes, and... 
    Pipeline

    Electronic Arts Inc.

    Winnipeg, MB
    1 hour ago
  •  ...CIBC is seeking a Senior Data Engineer to lead the design and delivery of data products on modern cloud platforms. You will collaborate with business partners and engineering teams to clarify requirements, design data movement across systems, and guide implementation from... 
    Pipeline

    Canadian Imperial Bank of Commerce (Canada)

    Winnipeg, MB
    1 hour ago
  • Quandri is seeking a Senior Data Engineer to own the Databricks data lake, medallion layers, and streaming ingestion. You will partner with engineers, data scientists, and product teams to build scalable data platforms and AI data infrastructure. You’ll design multi-tenant... 
    Pipeline

    Quandri Technologies, Inc.

    Winnipeg, MB
    1 hour ago
  • An innovative technology firm in Mississauga is seeking a Senior Data Engineer to design and build scalable data pipelines within Microsoft Fabric. This role contributes to major digital transformation projects, ensuring data products are AI-ready and governed. The ideal candidate... 
    Pipeline

    LGS, an IBM Company

    Winnipeg, MB
    1 hour ago
  • AWS architecture and data pipeline leadership define this full-time Senior Data Pipeline Engineering Lead role at Hartree Partners. Lead a small engineering team.Reporting to the Head of Finance Technology, you will shape data technology for Finance, Operations, Risk and Compliance... 
    Pipeline
    Full time

    Hartree Partners

    Winnipeg, MB
    1 hour ago
  • Luxoft seeks an experienced Senior Data Engineer to onboard, integrate, and operationalize datasets for Middle Office functions. You will build scalable, production-grade data pipelines on AWS (EMR, Glue, Athena, S3) using Spark/PySpark, and own the full lifecycle from design... 
    Pipeline
    Work at office

    Luxoft

    Winnipeg, MB
    1 hour ago
  •  ...Contribute to Waabi’s cutting edge AV stack and data‑driven simulator.Build and own robust, petabyte‑scale ETL pipelines for ingesting and aggregating multi‑sensor data...  ...software.Be part of a team of multidisciplinary Engineers, Research Scientists, and Product Managers using... 
    Pipeline
    Full time
    Internship
    Work at office
    Work from home
    Flexible hours

    Waabi

    Winnipeg, MB
    1 hour ago
  • Ledcor Group is hiring a Senior Data Engineer to join the Data & Analytics Platform team. You will design, build, and maintain enterprise-scale data solutions supporting reporting, analytics, and operational intelligence across Ledcor's construction and infrastructure businesses... 
    Pipeline

    Ledcor Group

    Winnipeg, MB
    1 hour ago
  • The Databricks Engineer will design, develop, and optimize large-scale data pipelines using Databricks and Azure cloud services.This role requires advanced expertise in Spark/PySpark, Delta Lake technologies, data governance, and cloud-based data engineering.The engineer will... 
    Pipeline

    Compunnel Inc.

    Winnipeg, MB
    1 hour ago
  •  ...Dialogue is seeking a Senior Data Platform Developer to design, build, and maintain our modern data platform. You will define engineering best practices, enable power users, and own Snowflake, dbt, and deployment pipelines. You will collaborate with Product, Sales, Ops, and... 
    Pipeline

    Dialogue

    Winnipeg, MB
    1 hour ago
  •  ...Quix is seeking a Data Platform Engineer to design and maintain the data infrastructure underpinning analytics, AI workflows, and operational...  ...contracts for enterprise environments. You will design ingestion pipelines, implement transformation layers with dbt/SQL/Python, and... 
    Pipeline

    Chair.com.pk

    Winnipeg, MB
    1 hour ago
  • Fivetran, Inc. in Toronto is seeking a Staff Software Engineer to join our databases team, delivering high-performance data pipelines and reliable services for a global customer base. You will write production-grade Java, optimize critical paths, and mentor peers. This full... 
    Pipeline
    Full time

    Fivetran, Inc.

    Winnipeg, MB
    1 hour ago
  • A leading IT consulting firm is seeking a Senior Azure Data Engineer in Toronto, Ontario. The candidate will design and optimize scalable data pipelines within the Microsoft Fabric and SAP BW ecosystem. Qualifications include over 7 years of experience in data engineering,... 
    Pipeline
    Full time

    Astra-North Infoteck Inc.

    Winnipeg, MB
    1 hour ago
  • A global technology services company is seeking a Senior Production Support Engineer in Halifax to ensure the stability and reliability of production systems. The successful candidate will monitor and troubleshoot issues, adhering to SLAs, and provide customer support. Candidates... 
    Pipeline

    NTT DATA, Inc.

    Winnipeg, MB
    1 hour ago
  • Punt, a Vancouver-based tech company, seeks an Associate Data Engineer to design and maintain core data pipelines powering our prediction-led platform. You will ingest high-volume datasets, write production transformations, and ensure data accuracy for business-critical applications... 
    Pipeline

    Punt

    Winnipeg, MB
    1 hour ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer For On-Chain Pipelines. Be the first to apply!