Skip to main content

Tools for exporting Blockchain data to CSV or JSON

Project description

Ortege ETL

Discord

Ortege ETL lets you convert blockchain data into convenient formats like CSVs and stream the data into Kafka.

We've merged a few different codebases into a singular codebase to make it easier for developers to use one tool for all their data analytics needs. We'd like to thank all the great work done from these libraries which we've leveraged extensively: EthereumETL BitcoinETL

Create Wheel

python setup.py bdist_wheel

Quickstart

Install Ortege ETL:

We will eventually setup OrtegeETL through PyPi but for now, please clone the repository locally and run it from the command line.

Currently we support the following chains:

  • EVM
  • Bitcoin
  • Stacks

EVM

Export blocks and transactions

ortegeetlevm export_blocks_and_transactions --start-block 0 --end-block 500000 \
--blocks-output blocks.csv --transactions-output transactions.csv \
--provider-uri https://mainnet.infura.io/v3/7aef3f0cd1f64408b163814b22cc643c

Export ERC20 and ERC721 transfers

ortegeetl evm export_token_transfers --start-block 0 --end-block 500000 \
--provider-uri file://$HOME/Library/Ethereum/geth.ipc --output token_transfers.csv

Export traces

ortegeetl evm export_traces --start-block 0 --end-block 500000 \
--provider-uri file://$HOME/Library/Ethereum/parity.ipc --output traces.csv

Stream blocks, transactions, logs, token_transfers continually to console

ortegeetl evm stream --start-block 500000 -e block,transaction,log,token_transfer --log-file log.txt \
--provider-uri https://mainnet.infura.io/v3/7aef3f0cd1f64408b163814b22cc643c

Bitcoin

Export blocks and transactions

ortegeetl btc export_blocks_and_transactions --start-block 0 --end-block 500000 \
--provider-uri http://user:pass@localhost:8332 --chain bitcoin \
 --blocks-output blocks.json --transactions-output transactions.json

Stream blockchain data continually to console

ortegeetl btc stream -p http://user:pass@localhost:8332 --start-block 500000

Stacks

Soroban

Coming soon

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ortegeetl-2.0.3.tar.gz (377.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ortegeetl-2.0.3-py3-none-any.whl (554.2 kB view details)

Uploaded Python 3

File details

Details for the file ortegeetl-2.0.3.tar.gz.

File metadata

  • Download URL: ortegeetl-2.0.3.tar.gz
  • Upload date:
  • Size: 377.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.6

File hashes

Hashes for ortegeetl-2.0.3.tar.gz
Algorithm Hash digest
SHA256 5ae47003bb1487bb2ffb0b324acb214c894ed518cd943b9b520e6fd357f15cd0
MD5 f2db4b3bd6683d5b7da2022e38254bd0
BLAKE2b-256 6212ef1b0d5d5d9ff36c80ac712d1124683b12debe5ec756b54c0fb4df99d5c4

See more details on using hashes here.

File details

Details for the file ortegeetl-2.0.3-py3-none-any.whl.

File metadata

  • Download URL: ortegeetl-2.0.3-py3-none-any.whl
  • Upload date:
  • Size: 554.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.6

File hashes

Hashes for ortegeetl-2.0.3-py3-none-any.whl
Algorithm Hash digest
SHA256 cc00c1414c732b5091eca05da302f67fb41d39e92690f89ad604ce4fa0a20d5f
MD5 581bb885306f7ff156712da911e34d39
BLAKE2b-256 73889048b9c19b87f2a18c4a0d3081b954ed3ce4bcda90b1440f9cdbf77b9fe0

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page