Skip to main content

Chia Network data ETL for Nebula Graph

Project description

nebula-chia

How To Use

ChaiBatchConvertor

Step 0, Installation

nebula-chia could be installed either via pip or from this git repo itself.

Install via pip

python3 -m pip install nebula-chia

Install from the github repo

git clone git@github.com:wey-gu/nebula-chia.git
cd nebula-chia
python3 setup.py install

Note:

Nebula-chia depends on chia-blockchain, the easiest way is to call it from the venv inside the Chia Network repo.

Step 1, Convert Chia as CSV files

ChiaBatchConvertor is used to convert Chia Block Chain data into CSV files, which could then be used for nebula-importer

$ python3 -m pip install nebula-chia
$ python

# block_record_limit = 0 means unlimited
# coin_record_limit = 0 means unlimited
from nebulachia.convertor import ChiaBatchConvertor
c = ChaiBatchConvertor(block_record_limit=0, coin_record_limit=0, write_batch_size=10000)
c.convert_block_record()
c.convert_coin_record()
exit()

$ ls -lth

-rw-r--r--   1 weyl  staff   173M May 19 13:01 coin_record.csv
-rw-r--r--   1 weyl  staff    77M May 19 12:59 block_record.csv
...

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nebula-chia-0.2.tar.gz (3.8 kB view hashes)

Uploaded Source

Built Distribution

nebula_chia-0.2-py3-none-any.whl (7.8 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page