Versions Supported
Language Stats
Repo Stats
Activity
Build Status
S3 Download
Python module to download objects in an S3 bucket.
Installation
pip install s3-downloader
Usage
Download objects in parallel
import s3
if __name__ == '__main__':
wrapper = s3.Downloader(bucket_name='BUCKET_NAME')
wrapper.run_in_parallel(threads=10) # Defaults to 5
Download objects in sequence
import s3
if __name__ == '__main__':
wrapper = s3.Downloader(bucket_name='BUCKET_NAME')
wrapper.run()
Mandatory arg
- bucket_name - Name of the s3 bucket.
Optional kwargs
- prefix - Prefix to filter the objects based on their path. Defaults to
None - logger - Bring your own custom pre-configured logger. Defaults to on-screen logging.
- download_dir - Name/path of the directory where the objects have to be stored.
Defaults to
bucket_nameat current working directory. - region_name - AWS region name. Defaults to the env var
AWS_DEFAULT_REGION - profile_name - AWS profile name. Defaults to the env var
PROFILE_NAME - aws_access_key_id - AWS access key ID. Defaults to the env var
AWS_ACCESS_KEY_ID - aws_secret_access_key - AWS secret access key. Defaults to the env var
AWS_SECRET_ACCESS_KEY
AWS values are loaded from env vars or the default config at
~/.aws/config/~/.aws/credentials
Coding Standards
Docstring format: Google
Styling conventions: PEP 8
Clean code with pre-commit hooks: flake8 and
isort
Release Notes
Requirement
python -m pip install gitverse
Usage
gitverse-release reverse -f release_notes.rst -t 'Release Notes'
Linting
pre-commit will ensure linting, run pytest, generate runbook & release notes, and validate hyperlinks in ALL
markdown files (including Wiki pages)
Requirement
pip install sphinx==5.1.1 pre-commit recommonmark
Usage
pre-commit run --all-files
Pypi Package
https://pypi.org/project/s3-downloader/
License & copyright
© Vignesh Rao
Licensed under the MIT License
Metadata
Release files for s3-downloader 1.0.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| s3_downloader-1.0.1-py3-none-any.whl | Python 3 | none | any | Details for s3_downloader-1.0.1-py3-none-any.whl |
Release files / s3_downloader-1.0.1-py3-none-any.whl
| Download URL | s3_downloader-1.0.1-py3-none-any.whl |
|---|---|
| Size | 10.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
822af7c62bd42008cc231262a2e1109b7a07df1559e6a80aa42af8b6e951e77e
|
|
BLAKE2b-256 checksum How to use checksums |
fda53968cfebad10290a4dea84879e6e86a581b92d346e85e2d0fddeef823c8a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.11.13
|
Security for s3-downloader 1.0.1
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.