minio wrapper to perform task like pandas dataframe upload, download
Project description
Awesome Object Store
A library that extends minio python client to perform more complex task like read/write pandas DataFrame, json file, ...etc
Feature
- list_buckets: list all buckets.
- list_objects: list object under a prefix.
- put_as_json: put a dict as json file on s3.
- exists: check if an object exist on s3.
- remove_dir: remove a directory on s3.
- upload_df: Upload df as csv to s3.
- get_json: Get as dict from a json file on s3.
- get_df: Get a dataframe from a csv object on s3.
- remove_objects: Remove objects.
- download: Downloads data of an object to file.
Development
run unit test
- getting service account credential:
- visit google cloud console
- go to project 8ndpoint-datalake-dev -> Security -> Secret Manager -> awesome-object-store-unit-test
- action -> view secret value
- store the value in tests/service-account.json
- run ./run_test.sh
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for awesome-object-store-2.1.3.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5f260a60f0dea7422f0f8b6d8f8c608fdd51a8c5e243902d3f612dbba5daf58c |
|
MD5 | 7c202bec7c9a135930c996df7e530771 |
|
BLAKE2b-256 | d138718999591b77c0fc05e75a2f6b4b8c2c3bc0141b28e48ad1bc147fcb0aa6 |
Close
Hashes for awesome_object_store-2.1.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6ff0100d683542851f3554b6c00794cabeaf2909e68f30eb9997e925ec2dc9e0 |
|
MD5 | 0d48c752243b9e6b4fb37adadaed83fa |
|
BLAKE2b-256 | 111f62c1321bcfa623d92d0bcb31569f86b5f5c692e2357ebdeea04bbe1a2512 |