oarepo-s3-cli

OARepo command-line upload client

global options

• -e, --endpoint <url> OARepo HTTPS endpoint e.g. https://repo.example.org (required)
• -t, --token <string> upload auth token obtained from OARepo (required, can be alternatively specified in env.variable "TOKEN")
• -d, debug (default: False)
• -q, quiet (default: False)
• -n, --noninteractive (default: False)
• --help

commands

• upload ... upload file
• resume ... resume interrupted upload
• abort ... abort upload
• check ... match sha256sum of local and uploaded file
• revoke ... revoke supplied access token

upload command options

• -f, --file <filepath> file(s) for upload (repeatable, required)
• -k, --key <name> object key in S3 (default: basename of file)
• -p, --parallel <integer> (default: CPU count)

resume command options

• -k, --key <name> object key in S3 (default: basename of file)
• -u, --uploadId <string> uploadId returned from upload (required)
• -f, --file <filepath> file for upload (required)
• -p, --parallel <integer> number of parallel upload streams (default: CPU count)

abort command options

• -k, --key <name> object key in S3 (default: basename of file)
• -u, --uploadId <string> uploadId returned from upload (required)

check command options

• -f, --file <filepath> uploaded file for check (required)
• -k, --key <name> object key of uploaded file in S3 (default: basename of file)

revoke command options

none

.. Copyright (C) 2021 CESNET.

OARepo-S3-CLI is free software; you can redistribute it and/or
modify it under the terms of the MIT License; see LICENSE file for more
details.

Changes

Version 0.1.0 (released TBD)

• Initial public release.

Version 0.1.1

• noninteractive mode added, resume call moved

Version 0.1.2

• setuptools ver.limited
• README.md
• check command impl.
• revoke command impl.
• error messages changed

Version 0.1.3

• CLI entry point added
• exception handling changed

Version 0.1.4

• added support for nr-test variant

Version 0.1.5

• impl. --version option

Version 0.1.6

• mon.timeout processing fixed
• timer impl.

Version 0.1.7

• check cmd optimized (chunk 8192, blake2b)

Version 0.1.8

• check cmd paralelized

Version 0.1.9

• nocheck flag impl.
• etag multipart checksums supp.
• presign req. grouping impl.
• presign req. divided into batches

Version 0.1.10

• changed chunk_size calculation + max_parts 10240