Python module to download all the objects in an S3 bucket.
Project description
Versions Supported
Language Stats
Repo Stats
Activity
Build Status
S3 Download
Python module to download all the objects in an S3 bucket.
Install from pypi
pip install s3-downloader
Usage
Using multi-threading
from s3.dumper import Downloader
if __name__ == '__main__':
Downloader(bucket_name='MY_BUCKET_NAME').run_in_parallel()
Without using multi-threading
from s3.dumper import Downloader
if __name__ == '__main__':
Downloader(bucket_name='MY_BUCKET_NAME').run()
Coding Standards
Docstring format: Google
Styling conventions: PEP 8
Clean code with pre-commit hooks: flake8
and
isort
Linting
PreCommit
will ensure linting, and the doc creation are run on every commit.
Requirement
pip install --no-cache --upgrade sphinx pre-commit recommonmark
Usage
pre-commit run --all-files
Pypi Package
https://pypi.org/project/s3-downloader/
Runbook
https://thevickypedia.github.io/s3-downloader/
License & copyright
© Vignesh Sivanandha Rao
Licensed under the MIT License
Change Log
0.0.5 (04/17/2022)
- Add OOP section for easy usage
- Update docs
0.0.4 (04/17/2022)
- Implement multi-threading for performance
0.0.3 (04/17/2022)
- Base script to download s3 objects
0.0.2 (04/17/2022)
- Setup pypi package and sphinx docs
- Add all requirements
0.0.1 (04/17/2022)
- Initial commit
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for s3_downloader-0.0.5-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e3e05e81321e9b85d7680357b8cd2feee697d9aef8bb1ed9b12b8231d7a859a4 |
|
MD5 | c388021aeb8012bc3c0c337c26515446 |
|
BLAKE2b-256 | ca32b627ba262ba46626810d5d796e575e9d94fc6cf532cd1b567b2d7d593412 |