minio wrapper to perform task like pandas dataframe upload, download
Project description
Awesome Object Store
A library that extends minio python client to perform more complex task like read/write pandas DataFrame, json file, ...etc
Feature
- list_buckets: list all buckets.
- list_objects: list object under a prefix.
- put_as_json: put a dict as json file on s3.
- exists: check if an object exist on s3.
- remove_dir: remove a directory on s3.
- upload_df: Upload df as csv to s3.
- get_json: Get as dict from a json file on s3.
- get_df: Get a dataframe from a csv object on s3.
- remove_objects: Remove objects.
- download: Downloads data of an object to file.
Development
run unit test
- getting service account credential:
- visit google cloud console
- go to project 8ndpoint-datalake-dev -> Security -> Secret Manager -> awesome-object-store-unit-test
- action -> view secret value
- store the value in tests/service-account.json
- run ./run_test.sh
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for awesome-object-store-2.0.2.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8ef6c7ec0df09bbe57e8b80e8dabd0fc9cb53e0dc4846bd0f20dd5be59d46240 |
|
MD5 | 145183606639ad957563374dcd04293c |
|
BLAKE2b-256 | c085533688aa279d5a62d0c6c6f6bd9d5c48b103d0d793dee0d7f640093a1590 |
Close
Hashes for awesome_object_store-2.0.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c48e50d224efc5e7f9281b3acb3ff4ceb87cf2b6b110b20de0775d31a1bb0e38 |
|
MD5 | 91af3ddcb5afe5b0ab0475662e51c0e5 |
|
BLAKE2b-256 | 60d6616d0b201558dd3a8185095ffc4ba86f1eda19a8eea1e5377e48c9cba84b |