Tools for exporting Blockchain data to CSV or JSON
Project description
Ortege ETL
Ortege ETL lets you convert blockchain data into convenient formats like CSVs and stream the data into Kafka.
We've merged a few different codebases into a singular codebase to make it easier for developers to use one tool for all their data analytics needs. We'd like to thank all the great work done from these libraries which we've leveraged extensively: EthereumETL BitcoinETL
Create Wheel
python setup.py bdist_wheel
Quickstart
Install Ortege ETL:
We will eventually setup OrtegeETL through PyPi but for now, please clone the repository locally and run it from the command line.
Currently we support the following chains:
- EVM
- Bitcoin
- Stacks
EVM
Export blocks and transactions
ortegeetlevm export_blocks_and_transactions --start-block 0 --end-block 500000 \
--blocks-output blocks.csv --transactions-output transactions.csv \
--provider-uri https://mainnet.infura.io/v3/7aef3f0cd1f64408b163814b22cc643c
Export ERC20 and ERC721 transfers
ortegeetl evm export_token_transfers --start-block 0 --end-block 500000 \
--provider-uri file://$HOME/Library/Ethereum/geth.ipc --output token_transfers.csv
Export traces
ortegeetl evm export_traces --start-block 0 --end-block 500000 \
--provider-uri file://$HOME/Library/Ethereum/parity.ipc --output traces.csv
Stream blocks, transactions, logs, token_transfers continually to console
ortegeetl evm stream --start-block 500000 -e block,transaction,log,token_transfer --log-file log.txt \
--provider-uri https://mainnet.infura.io/v3/7aef3f0cd1f64408b163814b22cc643c
Bitcoin
Export blocks and transactions
ortegeetl btc export_blocks_and_transactions --start-block 0 --end-block 500000 \
--provider-uri http://user:pass@localhost:8332 --chain bitcoin \
--blocks-output blocks.json --transactions-output transactions.json
Stream blockchain data continually to console
ortegeetl btc stream -p http://user:pass@localhost:8332 --start-block 500000
Stacks
Soroban
Coming soon
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file ortegeetl-2.0.3.tar.gz.
File metadata
- Download URL: ortegeetl-2.0.3.tar.gz
- Upload date:
- Size: 377.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.12.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
5ae47003bb1487bb2ffb0b324acb214c894ed518cd943b9b520e6fd357f15cd0
|
|
| MD5 |
f2db4b3bd6683d5b7da2022e38254bd0
|
|
| BLAKE2b-256 |
6212ef1b0d5d5d9ff36c80ac712d1124683b12debe5ec756b54c0fb4df99d5c4
|
File details
Details for the file ortegeetl-2.0.3-py3-none-any.whl.
File metadata
- Download URL: ortegeetl-2.0.3-py3-none-any.whl
- Upload date:
- Size: 554.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.12.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
cc00c1414c732b5091eca05da302f67fb41d39e92690f89ad604ce4fa0a20d5f
|
|
| MD5 |
581bb885306f7ff156712da911e34d39
|
|
| BLAKE2b-256 |
73889048b9c19b87f2a18c4a0d3081b954ed3ce4bcda90b1440f9cdbf77b9fe0
|