gokart file downloader
Project description
Thunderbolt
Thunderbolt is data manager for gokart.
[1] Auto loading gokart task logs
[2] Check task params using pandas
[3] Download data from python
Usage
install
pip install thunderbolt
Example
If you specify TASK_WORKSPACE_DIRECTORY
, thunderbolt reads the log.
So making tasks pandas.DataFrame, and load dumped data.
This is also possible from S3 or GCS. (s3://, gs://)
Example:
from thunderbolt import Thunderbolt
tb = Thunderbolt(PATH_TO_WORKSPACE_DIRECTORY)
print(tb.get_task_df()) # check task_id
print(tb.load(task_id=0))
Please look here too: https://github.com/m3dev/thunderbolt/blob/master/examples/example.ipynb
Thanks
gokart
: https://github.com/m3dev/gokart
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
thunderbolt-0.0.12.tar.gz
(11.0 kB
view hashes)
Built Distribution
Close
Hashes for thunderbolt-0.0.12-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 13040890c17dc6b76569192130fc40b7e4d75f07ebd6546a2698afbc84e214db |
|
MD5 | 83c9e6591747c704190344457a4b270a |
|
BLAKE2b-256 | 184c0da8a8c619e4ec2ad8252ae40c1f8a339477c6b2f4170be994d32f6ae02a |