A utility to sync data to/from AWS S3
Project description
# aws_s3sync
## Installation
`pip install aws_s3sync`
## Execution
#### Pre-requisites
Setup the following environment variables
* **AWS_ACCESS_KEY_ID**
* **AWS_SECRET_ACCESS_KEY**
#### Commands
`sync_to_s3`
`sync_from_s3`
#### Arguments
```
-h, --help show this help message and exit
-b BUCKET, --bucket BUCKET
Upload: Selects the S3 bucket to upload data to.
Download: Selects the S3 bucket to download data from
-f FILE_PATH, --file_path FILE_PATH
Upload: Path of the file to be uploaded. Download:
Path to download file to
-k KEY, --key KEY Key of the object. Same as file_path is undefined for
upload
-m {auto,sync,single-part-upload}, --mode {auto,sync,single-part-upload}
Mode of upload/download
--chunk_size CHUNK_SIZE
Size of chunk in multipart upload in MB
--multipart_threshold MULTIPART_THRESHOLD
Minimum size in MB to upload using multipart
```
##### Mode
* `auto` : Upload: Single-part upload or multi-part upload will be chosen based on the file being smaller/larger than `multipart_threshold`
* `sync` : Upload/downloand file to/from S3 only if the local/remote file have different signatures. Checked based on ETag/MD5
* `single-part-upload` : Force single-part upload. Applicable only for files of size larger than `multipart_threshold`
## Installation
`pip install aws_s3sync`
## Execution
#### Pre-requisites
Setup the following environment variables
* **AWS_ACCESS_KEY_ID**
* **AWS_SECRET_ACCESS_KEY**
#### Commands
`sync_to_s3`
`sync_from_s3`
#### Arguments
```
-h, --help show this help message and exit
-b BUCKET, --bucket BUCKET
Upload: Selects the S3 bucket to upload data to.
Download: Selects the S3 bucket to download data from
-f FILE_PATH, --file_path FILE_PATH
Upload: Path of the file to be uploaded. Download:
Path to download file to
-k KEY, --key KEY Key of the object. Same as file_path is undefined for
upload
-m {auto,sync,single-part-upload}, --mode {auto,sync,single-part-upload}
Mode of upload/download
--chunk_size CHUNK_SIZE
Size of chunk in multipart upload in MB
--multipart_threshold MULTIPART_THRESHOLD
Minimum size in MB to upload using multipart
```
##### Mode
* `auto` : Upload: Single-part upload or multi-part upload will be chosen based on the file being smaller/larger than `multipart_threshold`
* `sync` : Upload/downloand file to/from S3 only if the local/remote file have different signatures. Checked based on ETag/MD5
* `single-part-upload` : Force single-part upload. Applicable only for files of size larger than `multipart_threshold`
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
aws_s3sync-1.0.1.tar.gz
(4.4 kB
view details)
Built Distribution
File details
Details for the file aws_s3sync-1.0.1.tar.gz
.
File metadata
- Download URL: aws_s3sync-1.0.1.tar.gz
- Upload date:
- Size: 4.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1fa3204e695c9a0ae84471c6a45b665b3978e551a4c8c41565474d95fe92e757 |
|
MD5 | fa216065e8b74f2b99cabe1c5f8c446b |
|
BLAKE2b-256 | f55de3c966e038737cb50d8ae60f767ad7b27a4f3d2478864949e6351ead9712 |
File details
Details for the file aws_s3sync-1.0.1-py2-none-any.whl
.
File metadata
- Download URL: aws_s3sync-1.0.1-py2-none-any.whl
- Upload date:
- Size: 5.8 kB
- Tags: Python 2
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | cb5172eb165ab6171b4acdbfff36ffb778f8e86ab503c47fbec563e3d917909f |
|
MD5 | 2c6f18c8e21a925612cd429871d28071 |
|
BLAKE2b-256 | 527da82974af9bccdae79a769b9ec1420c36e021f2a6d576959bbaae1366826f |