Skip to main content

A utility to sync data to/from AWS S3

Project description

# aws_s3sync

## Installation

`pip install aws_s3sync`

## Execution

#### Pre-requisites

Setup the following environment variables

* **AWS_ACCESS_KEY_ID**
* **AWS_SECRET_ACCESS_KEY**

#### Commands

`sync_to_s3`

`sync_from_s3`

#### Arguments

```
-h, --help show this help message and exit
-b BUCKET, --bucket BUCKET
Upload: Selects the S3 bucket to upload data to.
Download: Selects the S3 bucket to download data from
-f FILE_PATH, --file_path FILE_PATH
Upload: Path of the file to be uploaded. Download:
Path to download file to
-k KEY, --key KEY Key of the object. Same as file_path is undefined for
upload
-m {auto,sync,single-part-upload}, --mode {auto,sync,single-part-upload}
Mode of upload/download
--chunk_size CHUNK_SIZE
Size of chunk in multipart upload in MB
--multipart_threshold MULTIPART_THRESHOLD
Minimum size in MB to upload using multipart
```

##### Mode

* `auto` : Upload: Single-part upload or multi-part upload will be chosen based on the file being smaller/larger than `multipart_threshold`
* `sync` : Upload/downloand file to/from S3 only if the local/remote file have different signatures. Checked based on ETag/MD5
* `single-part-upload` : Force single-part upload. Applicable only for files of size larger than `multipart_threshold`

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

aws_s3sync-1.0.1.tar.gz (4.4 kB view details)

Uploaded Source

Built Distribution

aws_s3sync-1.0.1-py2-none-any.whl (5.8 kB view details)

Uploaded Python 2

File details

Details for the file aws_s3sync-1.0.1.tar.gz.

File metadata

  • Download URL: aws_s3sync-1.0.1.tar.gz
  • Upload date:
  • Size: 4.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for aws_s3sync-1.0.1.tar.gz
Algorithm Hash digest
SHA256 1fa3204e695c9a0ae84471c6a45b665b3978e551a4c8c41565474d95fe92e757
MD5 fa216065e8b74f2b99cabe1c5f8c446b
BLAKE2b-256 f55de3c966e038737cb50d8ae60f767ad7b27a4f3d2478864949e6351ead9712

See more details on using hashes here.

File details

Details for the file aws_s3sync-1.0.1-py2-none-any.whl.

File metadata

File hashes

Hashes for aws_s3sync-1.0.1-py2-none-any.whl
Algorithm Hash digest
SHA256 cb5172eb165ab6171b4acdbfff36ffb778f8e86ab503c47fbec563e3d917909f
MD5 2c6f18c8e21a925612cd429871d28071
BLAKE2b-256 527da82974af9bccdae79a769b9ec1420c36e021f2a6d576959bbaae1366826f

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page