Data Engineer For On-Chain Pipelines
CLR3
Join datastore in building reliable data pipelines that decode years of on-chain history into trustworthy Parquet files for researchers. Elevate data correctness and infrastructure while ensuring high quality and accuracy.
As a Data Engineer, you will design and run large-scale decoding pipelines, focusing on Solana and Hyperliquid history. This role demands significant experience in building production data pipelines, emphasizing SQL alongside either Python, Rust, or Go. You'll ensure correctness through rigorous validation, checksums, and lineage documentation, addressing customer inquiries about schemas and coverage.
Key Responsibilities: - Design and implement backfill pipelines at scale - Model typed schemas for various protocols - Build validation systems for data correctness - Maintain accurate versioning and documentation - Optimize storage layout for fast query performance
Requirements: - Proven experience in production data pipeline development - Proficiency in SQL plus Python, Rust, or Go - Familiarity with Parquet and tools like DuckDB - Strong focus on data correctness and validation - Willingness to work part-time in Toronto office
Help create a reliable data pipeline that researchers can trust, ensuring high-quality deliveries every time.#J-18808-Ljbffr
As a Data Engineer, you will design and run large-scale decoding pipelines, focusing on Solana and Hyperliquid history. This role demands significant experience in building production data pipelines, emphasizing SQL alongside either Python, Rust, or Go. You'll ensure correctness through rigorous validation, checksums, and lineage documentation, addressing customer inquiries about schemas and coverage.
Key Responsibilities: - Design and implement backfill pipelines at scale - Model typed schemas for various protocols - Build validation systems for data correctness - Maintain accurate versioning and documentation - Optimize storage layout for fast query performance
Requirements: - Proven experience in production data pipeline development - Proficiency in SQL plus Python, Rust, or Go - Familiarity with Parquet and tools like DuckDB - Strong focus on data correctness and validation - Willingness to work part-time in Toronto office
Help create a reliable data pipeline that researchers can trust, ensuring high-quality deliveries every time.#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Data Engineer For On-Chain Pipelines in Winnipeg, MB vacancy
- Engineer reliable cloud data pipelines using BigQuery, REST APIs, and Python for Clever Digital Marketing’s fully remote Canadian team. Strengthen the infrastructure behind measurable advertising performance.As an Intermediate Data Engineer, you will build within an established...PipelineRemote work
- Build trustworthy data pipelines at Foresight using Python, advanced SQL, and production-grade workflow orchestration. Preferred locations... ...include New York, San Francisco, and Montreal.As a Senior Data Engineer, you will build Foresight's data foundation for predictions, AI...Pipeline
- Build trusted measurement data pipelines with Python and SQL as a remote-first Data Engineer serving Canada or the United States. Turn messy site data into dependable systems.In this full-time core engineering role, you will build and run production pipelines for data from installed...PipelineFull timeRemote work
- Build cloud-based data pipelines at Ipsos using Python, SQL, and serverless technologies to process large-scale datasets. This role supports the Ipsos DataHub.As a Senior Software Engineer focused on data engineering, you will expand and optimize pipeline architecture within...Pipeline
- Become a key player at Electronic Arts as a Software Data Engineer, enhancing the quality of games through innovative data solutions designed... ...and ML experts. Your focus will be on building scalable data pipelines, securing data integrity in Frostbite processes, and...Pipeline
- Build complex data pipelines with Python and SQL Server while working onsite five days weekly alongside operational teams. Maintain extremely accurate reporting solutions and data systems.As a Data Engineer, you will develop, test, deploy, and maintain ELT pipelines from varied...Pipeline
- Engineer fault-tolerant data platforms at Semios, working across GCP and AWS with SQL, dbt, and production workflow orchestration.This Data Engineer... ...access across multi-cloud environments. You will optimize pipelines, automate manual processes, and maintain models that transform...Pipeline
- Engineer monitored, governed data flows with Python and Spark for Croesus's wealth management platforms. This hybrid position requires two weekly office... ...Expert develops and operates modern Databricks Lakehouse pipelines supporting analytics and artificial intelligence...PipelineWork at office
- Support Airflow scheduling and data pipeline delivery remotely as a Senior Data Engineer for PENN Interactive and theScore platforms.This senior position partners with Data Services, business stakeholders, and data engineers to deliver reliable transformed data. Responsibilities...PipelineRemote work
- ...s agent-era products from a hybrid Toronto office schedule.As a Machine Learning Engineer, you will transform customer CRM and warehouse records into model-ready data. You will design pipelines that help each customer’s digital twins improve without leaking information across...PipelineWork at office
- Build AI-ready data pipelines at Foresight, using Python and advanced SQL to make complex project data trusted. This hands-on role is based in New York, San Francisco, or Montreal.As a Senior Data Engineer, you will build the data foundation behind Foresight’s predictions, AI...Pipeline
- Build Azure data pipelines with Tata Consultancy Services using SQL, Python, and cloud data platforms. Apply big data expertise to structured and semi-structured datasets.As an Azure Data Engineer, you will design and develop cloud-based pipelines from business requirements...Pipeline
$136k - $160k per year
...Unchain Data in Toronto is seeking a Software Developer on our Data Engineering team to build core datasets powering analytics, experimentation, and ML across our platform. You will design scalable pipelines and tooling, collaborating with engineers, data scientists, and business...Pipeline- CGL in Canada is seeking a Sr Data Engineering Developer to design and optimize data products, pipelines, APIs, and analytics solutions, in a hybrid IT environment. You will work with Azure PaaS such as ADLS, Databricks, Synapse, ADF, and Purview; guide junior colleagues; deliver...PipelineFlexible hours
- Build AWS data pipelines as a Senior Data Engineer at Clio, using streaming, batch processing, and production software development skills. Work remotely across Canada or hybrid in Toronto.Clio seeks a Senior Data Engineer for its growing engineering team. You will create data...PipelineRemote work
- Engineer enterprise-scale data pipelines with Python, Apache Spark, and Apache Beam for modern cloud-based data platforms. Apply strong SQL and platform expertise.This Senior Data Engineer role at TechBlocks centers on building and expanding enterprise data capabilities. You...Pipeline
$136k - $170k per year
...ideas for the benefit of others. As a Infrastructure Engineer at the company, you will run our Production... ...large scale distributed systems. About the TeamData Pipelines is at the heart of all critical data flowing through the company supporting hundreds of services...PipelineHourly payWork at officeFlexible hours3 days per week- Questrade Financial Group in Canada is seeking a Senior Data Engineer to architect and deliver scalable data pipelines and platform infra. You will bridge trading and brokerage operations with analytics, using dbt, Spark on Kubernetes, and GCP to ensure reliable, auditable data...Pipeline
- A global technology services company is seeking a Senior Production Support Engineer in Halifax to ensure the stability and reliability of production systems. The successful candidate will monitor and troubleshoot issues, adhering to SLAs, and provide customer support. Candidates...Pipeline
- ...Tailscale is seeking an Analytics Engineer to design and maintain scalable data models and pipelines. You will collaborate with Finance, Engineering, Sales, and other teams to deliver reliable data for reporting, analysis, and decision-making. You’ll own production-grade...PipelineRemote work
- ...Contribute to Waabi’s cutting edge AV stack and data‑driven simulator.Build and own robust, petabyte‑scale ETL pipelines for ingesting and aggregating multi‑sensor data... ...software.Be part of a team of multidisciplinary Engineers, Research Scientists, and Product Managers using...PipelineFull timeInternshipWork at officeWork from homeFlexible hours
- ...Dialogue is seeking a Senior Data Platform Developer to design, build, and maintain our modern data platform. You will define engineering best practices, enable power users, and own Snowflake, dbt, and deployment pipelines. You will collaborate with Product, Sales, Ops, and...Pipeline
- Cardinal Health Canada is seeking a Data Engineer to design, build, and maintain scalable data pipelines and models that support reporting, analytics, and decision making. The role requires hands-on SQL, data integration, and cloud platform experience within a collaborative...Pipeline
- Shift4 is seeking a Data Platform Engineer to build, maintain, and optimize data ingestion pipelines from production systems into Snowflake. You will focus on pipeline performance, reliability, scalability, cost efficiency, and observability. Experience with ECS, SQS, Python...Pipeline
$136k - $170k per year
...Space LLC in Toronto is seeking an experienced Infrastructure Engineer to own Production Infrastructure, monitor system health and automate... ...at scale. You will build platforms and services for data pipelines, partnering with cross-functional teams to anticipate customer...PipelineWork at office3 days per week- Capco in Toronto is hiring an experienced Data Engineer to design, develop and optimize data pipelines powering financial services. You will work with Informatica IDMC, ETL/ELT processes and cross-functional teams to deliver scalable data integration solutions. The role emphasizes...Pipeline
- Client is seeking a Senior Data Engineer to support the modernization of tooling enablement functions. This role is responsible for designing... ...objects in the Snowflake cloud data store, utilizing ETL pipelines (Talend, Informatica) and APIs. The ideal candidate is a self-...Pipeline
- An innovative technology firm in Mississauga is seeking a Senior Data Engineer to design and build scalable data pipelines within Microsoft Fabric. This role contributes to major digital transformation projects, ensuring data products are AI-ready and governed. The ideal candidate...Pipeline
- ...Quix is seeking a Data Platform Engineer to design and maintain the data infrastructure underpinning analytics, AI workflows, and operational... ...contracts for enterprise environments. You will design ingestion pipelines, implement transformation layers with dbt/SQL/Python, and...Pipeline
- ...ML arteka in Canada is seeking a seasoned Data Ingestion Engineer to build 30+ source connectors for a regulated financial platform on AWS. You... ...ensure production readiness with tests and observability across the pipeline, including CloudWatch dashboards. #J-18808-LjbffrPipeline
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer For On-Chain Pipelines. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- junior data engineer Winnipeg, MB
- data centre engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB

