minio wrapper to perform task like pandas dataframe upload, download
Project description
Awesome Object Store
A library that extends minio python client to perform more complex task like read/write pandas DataFrame, json file, ...etc
Feature
- list_buckets: list all buckets.
- list_objects: list object under a prefix.
- put_as_json: put a dict as json file on s3.
- exists: check if an object exist on s3.
- remove_dir: remove a directory on s3.
- upload_df: Upload df as csv to s3.
- get_json: Get as dict from a json file on s3.
- get_df: Get a dataframe from a csv object on s3.
- remove_objects: Remove objects.
- download: Downloads data of an object to file.
Development
run unit test
- getting service account credential:
- visit google cloud console
- go to project 8ndpoint-datalake-dev -> Security -> Secret Manager -> awesome-object-store-unit-test
- action -> view secret value
- store the value in tests/service-account.json
- run ./run_test.sh
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for awesome-object-store-2.1.0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | de7b582e4866b242f5f0c60ecbab34950adb9236a8525c7b1a740fe330e6578b |
|
MD5 | 61a1d5ee2ee2f0794af20fb1aee92266 |
|
BLAKE2b-256 | bfbb7a911fd5cfeedc810b353c6967e7479a2d48cde8c8a70d3f935b7be183f1 |
Close
Hashes for awesome_object_store-2.1.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ca062c47fc00cae945ebd4049aae242654969798b5064da5a6ec3159d591d11c |
|
MD5 | c02a0a4cae345515ab4b4ad79ed71164 |
|
BLAKE2b-256 | 3509606149f3a59e4e0b690b5e12558ba2345f6dfcd26da48c7000b39068a3af |