Skip to main content

A utility to sync data to/from AWS S3

Project description

# aws_s3sync

## Installation

`pip install aws_s3sync`

## Execution

#### Pre-requisites

Setup the following environment variables

* **AWS_ACCESS_KEY_ID**
* **AWS_SECRET_ACCESS_KEY**

#### Commands

`sync_to_s3`

`sync_from_s3`

#### Arguments

```
-h, --help show this help message and exit
-b BUCKET, --bucket BUCKET
Upload: Selects the S3 bucket to upload data to.
Download: Selects the S3 bucket to download data from
-f FILE_PATH, --file_path FILE_PATH
Upload: Path of the file to be uploaded. Download:
Path to download file to
-k KEY, --key KEY Key of the object. Same as file_path is undefined for
upload
-m {auto,sync,single-part-upload}, --mode {auto,sync,single-part-upload}
Mode of upload/download
--chunk_size CHUNK_SIZE
Size of chunk in multipart upload in MB
--multipart_threshold MULTIPART_THRESHOLD
Minimum size in MB to upload using multipart
```

##### Mode

* `auto` : Upload: Single-part upload or multi-part upload will be chosen based on the file being smaller/larger than `multipart_threshold`
* `sync` : Upload/downloand file to/from S3 only if the local/remote file have different signatures. Checked based on ETag/MD5
* `single-part-upload` : Force single-part upload. Applicable only for files of size larger than `multipart_threshold`

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
aws_s3sync-1.0.1-py2-none-any.whl (5.8 kB) Copy SHA256 hash SHA256 Wheel py2
aws_s3sync-1.0.1.tar.gz (4.4 kB) Copy SHA256 hash SHA256 Source None

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page