gokart file downloader
Project description
Thunderbolt
Thunderbolt is data manager for gokart.
[1] Auto loading gokart task logs
[2] Check task params using pandas
[3] Download data from python
Usage
install
pip install thunderbolt
Example
If you specify TASK_WORKSPACE_DIRECTORY
, thunderbolt reads the log.
So making tasks pandas.DataFrame, and load dumped data.
This is also possible from S3 or GCS. (s3://, gs://)
Example:
from thunderbolt import Thunderbolt
tb = Thunderbolt(PATH_TO_WORKSPACE_DIRECTORY)
print(tb.get_task_df()) # check task_id
print(tb.load(task_id=0))
Please look here too: https://github.com/m3dev/thunderbolt/blob/master/examples/example.ipynb
Thanks
gokart
: https://github.com/m3dev/gokart
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
thunderbolt-0.0.17.tar.gz
(11.0 kB
view hashes)