Skip to main content

Tools for exporting Blockchain data to CSV or JSON

Project description

Ortege ETL

Discord

Ortege ETL lets you convert blockchain data into convenient formats like CSVs and stream the data into Kafka.

We've merged a few different codebases into a singular codebase to make it easier for developers to use one tool for all their data analytics needs. We'd like to thank all the great work done from these libraries which we've leveraged extensively: EthereumETL BitcoinETL

Create Wheel

python setup.py bdist_wheel

Quickstart

Install Ortege ETL:

We will eventually setup OrtegeETL through PyPi but for now, please clone the repository locally and run it from the command line.

Currently we support the following chains:

  • EVM
  • Bitcoin
  • Stacks

EVM

Export blocks and transactions

ortegeetlevm export_blocks_and_transactions --start-block 0 --end-block 500000 \
--blocks-output blocks.csv --transactions-output transactions.csv \
--provider-uri https://mainnet.infura.io/v3/7aef3f0cd1f64408b163814b22cc643c

Export ERC20 and ERC721 transfers

ortegeetl evm export_token_transfers --start-block 0 --end-block 500000 \
--provider-uri file://$HOME/Library/Ethereum/geth.ipc --output token_transfers.csv

Export traces

ortegeetl evm export_traces --start-block 0 --end-block 500000 \
--provider-uri file://$HOME/Library/Ethereum/parity.ipc --output traces.csv

Stream blocks, transactions, logs, token_transfers continually to console

ortegeetl evm stream --start-block 500000 -e block,transaction,log,token_transfer --log-file log.txt \
--provider-uri https://mainnet.infura.io/v3/7aef3f0cd1f64408b163814b22cc643c

Bitcoin

Export blocks and transactions

ortegeetl btc export_blocks_and_transactions --start-block 0 --end-block 500000 \
--provider-uri http://user:pass@localhost:8332 --chain bitcoin \
 --blocks-output blocks.json --transactions-output transactions.json

Stream blockchain data continually to console

ortegeetl btc stream -p http://user:pass@localhost:8332 --start-block 500000

Stacks

Soroban

Coming soon

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ortegeetl-2.0.2-py3-none-any.whl (554.1 kB view details)

Uploaded Python 3

File details

Details for the file ortegeetl-2.0.2-py3-none-any.whl.

File metadata

  • Download URL: ortegeetl-2.0.2-py3-none-any.whl
  • Upload date:
  • Size: 554.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.6

File hashes

Hashes for ortegeetl-2.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 019aa1a13d5c7824901b28dc1ac20c84edb6689a64c89346cfcb84e65621b8b1
MD5 30a04cc38bb47ebd311c1dca6ff40e87
BLAKE2b-256 fcbb305e37aae9c5b39d62a04ab01a74ac39f70f4aa769491de9cb2339d51ac1

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page