minio wrapper to perform task like pandas dataframe upload, download
Project description
Awesome Minio
A library that extends minio python client to perform more complex task like read/write pandas DataFrame, json file, ...etc
Feature
- list_buckets: list all buckets.
- list_objects: list object under a prefix.
- put_as_json: put a dict as json file on s3.
- exists: check if an object exist on s3.
- remove_dir: remove a directory on s3.
- upload_df: Upload df as csv to s3.
- get_json: Get as dict from a json file on s3.
- get_df: Get a dataframe from a csv object on s3.
- remove_objects: Remove objects.
- download: Downloads data of an object to file.
Development
run unit test
- getting service account credential: 1.visit google cloud console 2.go to project 8ndpoint-datalake-dev -> Security -> Secret Manager -> awesome-object-store-unit-test 3.action -> view secret value 4.store the value in tests/service-account.json
- run ./run_test.sh
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for awesome-object-store-1.0.0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5f97cc2d57741c408871ab5c896cbc94fb24e457bf60beb3cdd220f5c218e7af |
|
MD5 | 30b10605cc21ac9c919ac3c74cdaca19 |
|
BLAKE2b-256 | 120bdf4556cff11971d0b2dfa3b1bc9a26f05ae56bb97747577f40f2c846ebdb |
Close
Hashes for awesome_object_store-1.0.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7f1a9bb28d5c8e6498d9c2d3ee27c84b853a239aef791977154bd32f3273a917 |
|
MD5 | 40dc5ce15ed9b794c9c071a83d95d1fb |
|
BLAKE2b-256 | 0f0c9df99f1318c93b3efbd50043dd132b6c6d93c5d385316f6a4e3c1836a272 |