gokart file downloader
Project description
Thunderbolt
Thunderbolt is data manager for gokart.
[1] Auto loading gokart task logs
[2] Check task params using pandas
[3] Download data from python
Usage
install
pip install thunderbolt
Example
If you specify TASK_WORKSPACE_DIRECTORY
, thunderbolt reads the log.
So making tasks pandas.DataFrame, and load dumped data.
This is also possible from S3.
Example:
from thunderbolt import Thunderbolt
tb = Thunderbolt(os.environ['TASK_WORKSPACE_DIRECTORY'])
print(tb.load(task_id=0))
Please look here too: https://github.com/m3dev/thunderbolt/blob/master/examples/example.ipynb
Thanks
gokart
: https://github.com/m3dev/gokart
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
thunderbolt-0.0.1.tar.gz
(3.3 kB
view hashes)
Built Distribution
Close
Hashes for thunderbolt-0.0.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2a8f8c707e51f09ce50f5582bd1def3952812c191e4fc0372bf974dc3c8ccf7a |
|
MD5 | a44931f43175902839a69663d8a2078e |
|
BLAKE2b-256 | f0823a84797d2bdb885047c4cf715989b1637153d4016013bb77ee5eb3fc15e6 |