A utility to sync data to/from AWS S3
Project description
# aws_s3sync
## Installation
`pip install aws_s3sync`
## Execution
#### Pre-requisites
Setup the following environment variables
* **AWS_ACCESS_KEY_ID**
* **AWS_SECRET_ACCESS_KEY**
#### Commands
`sync_to_s3`
`sync_from_s3`
#### Arguments
```
-h, --help show this help message and exit
-b BUCKET, --bucket BUCKET
Upload: Selects the S3 bucket to upload data to.
Download: Selects the S3 bucket to download data from
-f FILE_PATH, --file_path FILE_PATH
Upload: Path of the file to be uploaded. Download:
Path to download file to
-k KEY, --key KEY Key of the object. Same as file_path is undefined for
upload
-m {auto,sync,single-part-upload}, --mode {auto,sync,single-part-upload}
Mode of upload/download
--chunk_size CHUNK_SIZE
Size of chunk in multipart upload in MB
--multipart_threshold MULTIPART_THRESHOLD
Minimum size in MB to upload using multipart
```
##### Mode
* `auto` : Upload: Single-part upload or multi-part upload will be chosen based on the file being smaller/larger than `multipart_threshold`
* `sync` : Upload/downloand file to/from S3 only if the local/remote file have different signatures. Checked based on ETag/MD5
* `single-part-upload` : Force single-part upload. Applicable only for files of size larger than `multipart_threshold`
## Installation
`pip install aws_s3sync`
## Execution
#### Pre-requisites
Setup the following environment variables
* **AWS_ACCESS_KEY_ID**
* **AWS_SECRET_ACCESS_KEY**
#### Commands
`sync_to_s3`
`sync_from_s3`
#### Arguments
```
-h, --help show this help message and exit
-b BUCKET, --bucket BUCKET
Upload: Selects the S3 bucket to upload data to.
Download: Selects the S3 bucket to download data from
-f FILE_PATH, --file_path FILE_PATH
Upload: Path of the file to be uploaded. Download:
Path to download file to
-k KEY, --key KEY Key of the object. Same as file_path is undefined for
upload
-m {auto,sync,single-part-upload}, --mode {auto,sync,single-part-upload}
Mode of upload/download
--chunk_size CHUNK_SIZE
Size of chunk in multipart upload in MB
--multipart_threshold MULTIPART_THRESHOLD
Minimum size in MB to upload using multipart
```
##### Mode
* `auto` : Upload: Single-part upload or multi-part upload will be chosen based on the file being smaller/larger than `multipart_threshold`
* `sync` : Upload/downloand file to/from S3 only if the local/remote file have different signatures. Checked based on ETag/MD5
* `single-part-upload` : Force single-part upload. Applicable only for files of size larger than `multipart_threshold`
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
aws_s3sync-1.0.1.tar.gz
(4.4 kB
view hashes)
Built Distribution
Close
Hashes for aws_s3sync-1.0.1-py2-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | cb5172eb165ab6171b4acdbfff36ffb778f8e86ab503c47fbec563e3d917909f |
|
MD5 | 2c6f18c8e21a925612cd429871d28071 |
|
BLAKE2b-256 | 527da82974af9bccdae79a769b9ec1420c36e021f2a6d576959bbaae1366826f |