gokart file downloader
Project description
Thunderbolt
Thunderbolt is data manager for gokart.
[1] Auto loading gokart task logs
[2] Check task params using pandas
[3] Download data from python
Usage
install
pip install thunderbolt
Example
If you specify TASK_WORKSPACE_DIRECTORY
, thunderbolt reads the log.
So making tasks pandas.DataFrame, and load dumped data.
This is also possible from S3.
Example:
from thunderbolt import Thunderbolt
tb = Thunderbolt(os.environ['TASK_WORKSPACE_DIRECTORY'])
print(tb.load(task_id=0))
Please look here too: https://github.com/m3dev/thunderbolt/blob/master/examples/example.ipynb
Thanks
gokart
: https://github.com/m3dev/gokart
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
thunderbolt-0.0.2.tar.gz
(9.4 kB
view hashes)
Built Distribution
Close
Hashes for thunderbolt-0.0.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8bf3a4b34ead19a04810c7f6974acbba6c52346c88dbf38f07a2b2277afc927d |
|
MD5 | 35d0b64b06a513d366713d82f795e4e5 |
|
BLAKE2b-256 | 24fb237319b4acb365b4658cedc00cc57bfcdfcff9e9da6d6f3699f065c02c5f |