Skip to main content

Tools for exporting Blockchain data to CSV or JSON

Project description

Ortege ETL

Discord

Ortege ETL lets you convert blockchain data into convenient formats like CSVs and stream the data into Kafka.

We've merged a few different codebases into a singular codebase to make it easier for developers to use one tool for all their data analytics needs. We'd like to thank all the great work done from these libraries which we've leveraged extensively: EthereumETL BitcoinETL

Create Wheel

python setup.py bdist_wheel

Quickstart

Install Ortege ETL:

We will eventually setup OrtegeETL through PyPi but for now, please clone the repository locally and run it from the command line.

Currently we support the following chains:

  • EVM
  • Bitcoin
  • Stacks

EVM

Export blocks and transactions

ortegeetlevm export_blocks_and_transactions --start-block 0 --end-block 500000 \
--blocks-output blocks.csv --transactions-output transactions.csv \
--provider-uri https://mainnet.infura.io/v3/7aef3f0cd1f64408b163814b22cc643c

Export ERC20 and ERC721 transfers

ortegeetl evm export_token_transfers --start-block 0 --end-block 500000 \
--provider-uri file://$HOME/Library/Ethereum/geth.ipc --output token_transfers.csv

Export traces

ortegeetl evm export_traces --start-block 0 --end-block 500000 \
--provider-uri file://$HOME/Library/Ethereum/parity.ipc --output traces.csv

Stream blocks, transactions, logs, token_transfers continually to console

ortegeetl evm stream --start-block 500000 -e block,transaction,log,token_transfer --log-file log.txt \
--provider-uri https://mainnet.infura.io/v3/7aef3f0cd1f64408b163814b22cc643c

Bitcoin

Export blocks and transactions

ortegeetl btc export_blocks_and_transactions --start-block 0 --end-block 500000 \
--provider-uri http://user:pass@localhost:8332 --chain bitcoin \
 --blocks-output blocks.json --transactions-output transactions.json

Stream blockchain data continually to console

ortegeetl btc stream -p http://user:pass@localhost:8332 --start-block 500000

Stacks

Soroban

Coming soon

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ortegeetl-2.0.1-py3-none-any.whl (553.9 kB view details)

Uploaded Python 3

File details

Details for the file ortegeetl-2.0.1-py3-none-any.whl.

File metadata

  • Download URL: ortegeetl-2.0.1-py3-none-any.whl
  • Upload date:
  • Size: 553.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.6

File hashes

Hashes for ortegeetl-2.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 175a3d3de8d0465f8ca613a265b37c96f9ed992f77e97a766307861800a16dda
MD5 7f61feceedc6cfd421fb7811300e1e73
BLAKE2b-256 cd8b21c39f470c3d12ca4807891e953f147ed87ce6c54af58564132e353948a0

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page