Chia Network data ETL for Nebula Graph
Project description
nebula-chia
How To Use
ChaiBatchConvertor
Step 0, Installation
nebula-chia could be installed either via pip or from this git repo itself.
Install via pip
python3 -m pip install nebula-chia
Install from the github repo
git clone git@github.com:wey-gu/nebula-chia.git
cd nebula-chia
python3 setup.py install
Note:
Nebula-chia depends on
chia-blockchain, the easiest way is to call it from the venv inside the Chia Network repo.
Install Chia Netowrk refers to https://github.com/Chia-Network/chia-blockchain/wiki/INSTALL
Activate venv like:
cd chia-blockchain . ./activate
Step 1, Convert Chia as CSV files
ChiaBatchConvertor is used to convert Chia Block Chain data into CSV files, which could then be used for nebula-importer
$ python3 -m pip install nebula-chia
$ python
# block_record_limit = 0 means unlimited
# coin_record_limit = 0 means unlimited
from nebulachia.convertor import ChiaBatchConvertor
c = ChaiBatchConvertor(block_record_limit=0, coin_record_limit=0, write_batch_size=10000)
c.convert_block_record()
c.convert_coin_record()
exit()
$ ls -lth
-rw-r--r-- 1 weyl staff 173M May 19 13:01 coin_record.csv
-rw-r--r-- 1 weyl staff 77M May 19 12:59 block_record.csv
...
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file nebula-chia-0.2.tar.gz.
File metadata
- Download URL: nebula-chia-0.2.tar.gz
- Upload date:
- Size: 3.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.9.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
0957ed9e774901bf9435f31a4d1ddeefa407643637aebb652b677896be2b7317
|
|
| MD5 |
3dea9926f87f7c917a6beac245aa5d5f
|
|
| BLAKE2b-256 |
ded7dea3cd9a1650dee068655f554476ba67f2f6ddc348416db3d80bf41cac53
|
File details
Details for the file nebula_chia-0.2-py3-none-any.whl.
File metadata
- Download URL: nebula_chia-0.2-py3-none-any.whl
- Upload date:
- Size: 7.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.9.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
59e6fa79e527dd7573626740851608262512b58c928bebadabac9bfd3312b013
|
|
| MD5 |
4ee809251240958d04a3f8ca73df62ce
|
|
| BLAKE2b-256 |
fbad825b47ef6159a15c69154556fedfb6165ca48a061610c872e857ddf3576e
|