Data Engineer
CLR3
Build the pipelines behind datastore: decoding years of on-chain history into clean, versioned Parquet that researchers can trust.Datastore sells something unusual: files, not API access. Customers download decoded on-chain history as Parquet and run their own queries. That only works if the data is actually right, which makes correctness, lineage and reproducibility the product.You will build and run the pipelines that decode Solana and Hyperliquid history at scale: backfills over billions of rows, schema design, checksums, manifests and the quality checks that let a quant trust a file they did not produce themselves.What you will do
Design and run large-scale decoding and backfill pipelinesModel typed schemas for instructions, events and state across dozens of protocolsBuild validation that catches bad data before customers doKeep versioning, checksums, manifests and lineage docs accurate on every deliveryTune storage layout and partitioning so files query fast in DuckDB and PolarsAdd new protocols and chains to the catalogueSupport customer questions about schemas and coverageWhat we are looking for
Experience building production data pipelines at meaningful scaleStrong SQL plus one of Python, Rust or GoReal familiarity with columnar formats, ideally Parquet, and query engines like DuckDB, Polars or SparkCare for data correctness: testing, validation and reconciliationComfort owning pipelines in production, including when they break at nightAble to work from our Toronto office part of the weekNice to have
Experience with blockchain data or other messy, high-volume event streamsFamiliarity with warehouse ecosystems your customers use, like Snowflake, BigQuery or ClickHouseBackground in quantitative research support or backtesting infrastructureExperience with orchestration tools and with knowing when a cron job is enoughWho you are
You think an unverified number is worse than no numberYou write pipelines you would be happy to debug at 2am, so they rarely need itYou like schemas that make the next person's query obviousYou get satisfaction from a backfill that reconciles to the last rowHow we hire
1 Intro call with an engineer, about 30 minutes2 Short take-home assignment working with a real decoded dataset3 Technical conversation about your assignment and pipelines you have run4 Conversation with the founders5 Offer
#J-18808-Ljbffr
Design and run large-scale decoding and backfill pipelinesModel typed schemas for instructions, events and state across dozens of protocolsBuild validation that catches bad data before customers doKeep versioning, checksums, manifests and lineage docs accurate on every deliveryTune storage layout and partitioning so files query fast in DuckDB and PolarsAdd new protocols and chains to the catalogueSupport customer questions about schemas and coverageWhat we are looking for
Experience building production data pipelines at meaningful scaleStrong SQL plus one of Python, Rust or GoReal familiarity with columnar formats, ideally Parquet, and query engines like DuckDB, Polars or SparkCare for data correctness: testing, validation and reconciliationComfort owning pipelines in production, including when they break at nightAble to work from our Toronto office part of the weekNice to have
Experience with blockchain data or other messy, high-volume event streamsFamiliarity with warehouse ecosystems your customers use, like Snowflake, BigQuery or ClickHouseBackground in quantitative research support or backtesting infrastructureExperience with orchestration tools and with knowing when a cron job is enoughWho you are
You think an unverified number is worse than no numberYou write pipelines you would be happy to debug at 2am, so they rarely need itYou like schemas that make the next person's query obviousYou get satisfaction from a backfill that reconciles to the last rowHow we hire
1 Intro call with an engineer, about 30 minutes2 Short take-home assignment working with a real decoded dataset3 Technical conversation about your assignment and pipelines you have run4 Conversation with the founders5 Offer
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Data Engineer in Winnipeg, MB vacancy
$85k - $90k per year
...Job Description Design and maintain scalable data pipelines that collect, transform and store business data. Build data models... ...Qualifications: · Degree or Diploma in Computer Science, Data Engineering, Information Systems, or related field. · 5+ years of experience...SuggestedPermanent employment- ...part of that. • Our convenient Price Café offers free Tea and Coffee. Data Steward Price Electronics, a division of Price Industries · Winnipeg, Manitoba DEPARTMENT Software Engineering LOCATION Winnipeg, MB (on-site) EMPLOYMENT Permanent, full-time About the...SuggestedLong term contractPermanent employmentFull timeContract workWork at office
- ...Shape CATC’s Azure SQL data warehouse using advanced SQL, relational modelling, and dbt. This permanent, full-time role connects critical business systems. The Data Engineering & Platforms Manager owns the technical operation and continuous improvement of CATC’s enterprise...SuggestedPermanent employmentFull time
- ...Devenez Expert Cloud Data Engineer chez Synechron, en concevant des solutions de données avancées sur AWS et GCP. Participez à l'automatisation et à l'optimisation des pipelines de données. Dans ce rôle, vous appliquerez vos compétences acquises durant plus de six ans pour...Suggested
$110k per year
...000 CAD, commensurate with experience. About the Team: The Data & Analytics team is moving from a legacy reporting model to a... ...pipelines, enforcing rigorous data quality standards, and creating engineering patterns that let analytics, product, engineering, and AI...SuggestedFull time- ...and supported to be your best - both personally and professionally. How You’ll Make an Impact As a Senior Technical Analyst, Data Engineering and Business Intelligence, at Fidelity Investments Canada, you will focus on building, automating and scaling internal data...Work at officeFlexible hours
$85 - $89 per hour
Duration: 12 month contract + possible extensionsData Engineer to support a large enterprise transformation focused on building data pipelines, integrating data, and migrating data workloads from on-premises environments to AWS.This person should be technically strong in Python...Contract workManual labor$108k - $135k per year
...the opportunity to thrive.Lyft is looking for experienced software engineers from a scope of disciplines. We are growing our team with people... ...an engineer at Lyft, you'll collaborate with teams like product, data science, analytics, and operations on code that empower us to...Hourly payWork at officeFlexible hours3 days per week- ...our journey is only achievable by having a great team who shares ideas, tries new things, and learns as we go. Who you are:As a Data Engineer at Semios, you will design, build, and maintain scalable, reliable cloud-based data systems that transform raw data into trusted,...Work at office
- ...ingestion, dbt for transformation, and AWS-native services (S3, Glue, Athena, Bedrock) for storage, compute, and AI enablement. The Data Engineering Specialist works inside this stack, embedded in the Data Platform team.What we're looking for. A hands-on data engineer fluent...Casual work
- Data Engineer (Python, SQL, pipelines de données), lab IA et données, Montréal (télétravail) Poste permanent chez Abbeal : concevoir et faire tourner les pipelines de données de plusieurs projets clients au sein d'un lab IA. Python, SQL, ETL/ELT, cloud. Télétravail au Québec...Permanent employmentRemote work
$90k - $120k per year
Data Engineer Department: Data & EngineeringEmployment Type: Full TimeLocation: CanadaCompensation: CA$90,000 - CA$120,000 /... ...Advertising category and #42 across all of Canada, we are the growth engine behind some of North America's most ambitious home improvement...Full timeInternshipWork at officeRemote workHome office$100k - $145k per year
Core engineering · Full-time · Remote-first · Canada or USData pipelines, data quality & measurement dataAbout the role Every installed Energy Router measures what happens at its site, all day. That data is how we show results to customers and utilities, and how we decide...Full timeRemote work$110.5k - $143k per year
...depend on physical operations to harness Internet of Things (IoT) data to develop actionable insights and improve their operations. At... ...build for the long term. About the role:Samsara is seeking a Data Engineer to join our Data team, comprising both Data Scientists, Data...Long term contractFull timeInternshipRemote workRelocation packageFlexible hours$100k - $130k per year
...by placing patients at the center of the record release process, data moves more ethically, easily and securely throughout the care journey... ...for millions more patients across North America.As a Data Engineer, you will help build and maintain the data infrastructure that powers...InternshipManual laborRemote work$89.4k - $119.3k per year
Data Engineer### Data EngineerApply: Hybrid: Canada-Vaughan: Full time: Posted Today: 20189442Cardinal Health Canada, with over 1,300 employees nationwide, is an essential link in the Canadian healthcare supply chain, providing over 70,000 products to healthcare...Full timeInternshipWork at office- Nous recherchons un(e) Ingénieur(e) de données de niveau intermédiaire à senior pour concevoir, développer et maintenir des solutions de données robustes, performantes et évolutives. La personne travaillera en collaboration avec les équipes de données, d'architecture, ...
$95k - $120k per year
...with a large, complex product catalog. Accurate, well-structured data is the single biggest lever on our business - it shapes what customers... ...we fulfill their orders. The Role We're looking for a Data Engineer to own the flow of product data from source through to our...Relocation$120k - $135k per year
...leader in fundraising intelligence, Kindsight leverages real-time data and AI to help thousands of organizations around the world... ...fundraising. Position Summary: We are seeking a hands-on Data Engineer to build and maintain the data platform behind Kindsight's customer...- Iris's direct client, one of the Top 5 Bank in Canada, is looking to hire a Data Engineer for a long-term opportunity in Toronto, ON (Hybrid Position) .Our client is a Canadian multinational financial services company and the largest bank in Canada by market capitalization...Long term contractWorldwideFlexible hours3 days per week
- ...The Data Engineer will be responsible for developing and maintaining scalable data solutions, with a primary focus on Snowflake and SQL. This role requires strong analytical abilities, hands‑on data engineering expertise, and the capability to work independently. The...
$100k - $130k per year
...machine learning models.Develop applications leveraging LLMs, NLP, and Generative AI technologies.Collaborate with business users, data engineers, and architects to gather requirements and recommend AI-driven solutions.Develop and maintain data pipelines and model deployment...Long term contract- ...Strong hands-on experience in Python programming, including Pandas, NumPy, and data processing libraries. Strong experience with PySpark for distributed data processing and large-scale data transformation. Extensive knowledge of SQL , including complex queries,...Internship
- ...and responsibilities Design, develop, and optimize ETL and ELT data pipelines for structured and unstructured data; Integrate data... ...; Collaborate with data scientists, artificial intelligence engineers, and business teams to deliver reliable and structured data; Develop...
- ...high-value sales intelligence. Leading infrastructure vendors, engineering firms, and construction companies use the platform to identify and... .... The platform integrates seamlessly with CRMs, ERPs, and data lakes, embedding actionable insights directly into sales workflows...Work at officeImmediate start3 days per week
- ...relationships and leverage broader Bank relationships, systems and knowledge.Leads the design and implementation of the Tangerine data engineering strategy and platform, advising senior leadership and executing on the vision with senior architects and the development team....Permanent employmentFlexible hours
- Livingston moves goods across a complex, high-velocity supply chain, and data is at the heart of how we plan, route, and optimize that movement. We're looking for a Senior Data Engineer to design, build, and scale the data infrastructure that powers logistics operations, and...
- ...by our mission to accelerate success for our people, clients, and communities.Toronto, ON, HybridAbout the role As Director, Data Engineering within our Global Technology & Data Team, you'll play a pivotal role in shaping and executing Colliers' enterprise data engineering...Long term contractFull timeInternshipFlexible hours
- ## Job Description# Databricks Data EngineerApply**Job#: 3057559****Job Description:****Databricks Data Engineer****Overview:**Apex Systems is seeking a Databricks Data Engineer in Toronto, ON to support a large-scale data migration and centralization initiative into an enterprise...Hourly payContract workManual labor
- ...Location: Toronto, ON Job ID#: RQ11486 Duration: 6 Months Role Overview We are seeking an experienced Cloud Data Engineer to design,build, optimize, and support enterprise-scale cloud data solutions. Thesuccessful candidate will play a key role in developing...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
- junior data engineer Winnipeg, MB

