Free Historical Blockchain Extraction with Cryo + Merkle Reth Nodes
IntroductionHistorical blockchain data poses challenges for analysis. Despite its general accessibility, obtaining and analyzing such data has been historically hindered by paywalls and restrictions imposed by node service providers. Setting up a personal archive node is also a non-trivial task, introducing extra steps before data analysis becomes feasible. By leveraging Cryo to extract historical data and utilizing the free Merkle RPC with archive node support, researchers can now easily acc...
Cross-Chain NFT Marketplace MEV Strategy with Artemis: A Technical Commentary
"A strategy implementing atomic, cross-market NFT arbitrage between Seaport and Sudoswap. At a high level, we listen to a stream of new seaport orders, and compute whether we can atomically fulfill the order and sell the NFT into a sudoswap pool while making a profit." Paradigm recently released Artemis: An Open-Sourced MEV Bot Framework with a cross-market NFT arbitrage strategy implementation included. This is a brief technical commentary focusing on how the initial strategy is setup and ho...
Fetching Uniswap Historical Swap Data With Python and Subgrounds
IntroductionSubgraphs provide a highly curated source of data that can be used for historical data analytics compared to archive nodes. While historically used primarily to power frontend dashboards with recent data, subgraphs are similar to archive nodes because they contain all historical data for a protocols set of contracts. We query historical Uniswap swap data from two subgraphs on The Graphs decentralized network with Subgrounds:streamingfast univ3univ2Use these links to find a list of...
<100 subscribers
DataStreams a Subgraph query utility package that allows users to execute complex Subgraph queries. It provides extended functionality on top of The Graph data access python package Subgrounds. The main benefit is that now anyone can query Subgraph data, save it to their local storage as csv files, and perform data analytics immediately. DataStreams creates a reproducible data pipeline creation process in a transparent, lightweight manner. No database needed!
The main package in DataStreams is the Streamer class. Streamer streamlines the Subgraph query process in Python, exposing key information such as the queryable Subgraph schemas and filter clauses. In v1.0.0, functionality includes:
DRY Subgraph Query Code - reuse code to reduce complexity of Subgraph queries
Parallelized Subgraph Queries - Leverage the standard Python package concurrent to unlock concurrency at the Subgraph query level
Query the Chainlink Subgraph node for multiple token prices over a customized ranged period. Example notebook found here
Query the Cowswap Subgraph node for four specific schemas with parallelization support. Example notebook found here
DataStreams a Subgraph query utility package that allows users to execute complex Subgraph queries. It provides extended functionality on top of The Graph data access python package Subgrounds. The main benefit is that now anyone can query Subgraph data, save it to their local storage as csv files, and perform data analytics immediately. DataStreams creates a reproducible data pipeline creation process in a transparent, lightweight manner. No database needed!
The main package in DataStreams is the Streamer class. Streamer streamlines the Subgraph query process in Python, exposing key information such as the queryable Subgraph schemas and filter clauses. In v1.0.0, functionality includes:
DRY Subgraph Query Code - reuse code to reduce complexity of Subgraph queries
Parallelized Subgraph Queries - Leverage the standard Python package concurrent to unlock concurrency at the Subgraph query level
Query the Chainlink Subgraph node for multiple token prices over a customized ranged period. Example notebook found here
Query the Cowswap Subgraph node for four specific schemas with parallelization support. Example notebook found here
Free Historical Blockchain Extraction with Cryo + Merkle Reth Nodes
IntroductionHistorical blockchain data poses challenges for analysis. Despite its general accessibility, obtaining and analyzing such data has been historically hindered by paywalls and restrictions imposed by node service providers. Setting up a personal archive node is also a non-trivial task, introducing extra steps before data analysis becomes feasible. By leveraging Cryo to extract historical data and utilizing the free Merkle RPC with archive node support, researchers can now easily acc...
Cross-Chain NFT Marketplace MEV Strategy with Artemis: A Technical Commentary
"A strategy implementing atomic, cross-market NFT arbitrage between Seaport and Sudoswap. At a high level, we listen to a stream of new seaport orders, and compute whether we can atomically fulfill the order and sell the NFT into a sudoswap pool while making a profit." Paradigm recently released Artemis: An Open-Sourced MEV Bot Framework with a cross-market NFT arbitrage strategy implementation included. This is a brief technical commentary focusing on how the initial strategy is setup and ho...
Fetching Uniswap Historical Swap Data With Python and Subgrounds
IntroductionSubgraphs provide a highly curated source of data that can be used for historical data analytics compared to archive nodes. While historically used primarily to power frontend dashboards with recent data, subgraphs are similar to archive nodes because they contain all historical data for a protocols set of contracts. We query historical Uniswap swap data from two subgraphs on The Graphs decentralized network with Subgrounds:streamingfast univ3univ2Use these links to find a list of...
Share Dialog
Share Dialog
No comments yet