Skip to main content

Tools for exporting Celo blockchain data to CSV or JSON

Project description

Celo ETL

Build Status Discord

Celo ETL lets you convert blockchain data into convenient formats like CSVs and relational databases.

Celo ETL is a fork of

Quickstart

Install Celo ETL:

pip3 install celo-etl

Export blocks and transactions (Schema, Reference):

> celoetl export_blocks_and_transactions --start-block 0 --end-block 100000 \
--provider-uri https://alfajores-forno.celo-testnet.org --blocks-output blocks.csv --transactions-output transactions.csv

For the latest version, check out the repo and call

> pip3 install -e . 
> python3 celoetl.py

Running Tests

> pip3 install -e .[dev,streaming]
> export ETHEREUM_ETL_RUN_SLOW_TESTS=True
> pytest -vv

Running Tox Tests

> pip3 install tox
> tox

Running in Docker

  1. Install Docker https://docs.docker.com/install/

  2. Build a docker image

     > docker build -t celo-etl:latest .
     > docker image ls
    
  3. Run a container out of the image

     > docker run -v $HOME/output:/celo-etl/output celo-etl:latest export_all -s 0 -e 100000 -b 50000 -p https://alfajores-forno.celo-testnet.org
    

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

celo-etl-0.0.2.tar.gz (321.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

celo_etl-0.0.2-py3-none-any.whl (451.1 kB view details)

Uploaded Python 3

File details

Details for the file celo-etl-0.0.2.tar.gz.

File metadata

  • Download URL: celo-etl-0.0.2.tar.gz
  • Upload date:
  • Size: 321.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.44.1 CPython/3.7.5

File hashes

Hashes for celo-etl-0.0.2.tar.gz
Algorithm Hash digest
SHA256 82b89d25b19c2d47490189374bee527f21fd7a74dbe818dd6c97ca45f8f8f96c
MD5 aa46d1ddbfead06c648d3c2519e9fc5f
BLAKE2b-256 5a86224999d183872b728ee9a7ee076491915693ff48e03472f26e1e00dbe063

See more details on using hashes here.

File details

Details for the file celo_etl-0.0.2-py3-none-any.whl.

File metadata

  • Download URL: celo_etl-0.0.2-py3-none-any.whl
  • Upload date:
  • Size: 451.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.45.0 CPython/3.8.2

File hashes

Hashes for celo_etl-0.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 0c8d1d4f557deae92f886538eab88b1cbe3cf0e1ed76fe76b00ef173abcc297b
MD5 50e25bfdb966f6afcbe1513f296a0e23
BLAKE2b-256 68d9e8e550cbfd8f525f3b44692f032c06edd8f43edee71634455b26b18d2cd9

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page