Skip to main content

SCP/SFTP helper for openZIM uploads to our dropbox

Project description

uploader

Dedicated container/script to upload files to openzim/kiwix warehouses and S3

Files are uploaded via SFTP (pubkey authentication) or SCP using OpenSSH.

Usage

  • Specify file to upload with --file.
  • Mount the RSA private key onto /etc/ssh/keys/id_rsa or use --private_key
  • Use an scp:// or sftp:// URI to specify target.
  • Specify a full path (with filename) to upload to a specific name or end with a / for uploading inside a folder
docker run \
    -v ~/.ssh/id_rsa:/etc/ssh/keys/id_rsa:ro \
    -v /path/:/path:rw \
    openzim/uploader \
    uploader \
    --file /path/my_file.zim \
    --upload-uri sftp://uploader@warehouse.farm.openzim.org/zim/ \
    --move \
    --delete

Parameters

  • --username: if your URI has no username, you can specify it here.
  • --move: upload to a temporary filename (<fname>.tmp) and rename it upon completion. Note that SCP is not able to do it so it uploads an <fname>.complete file upon completion instead.
  • --delete: delete source file once uploaded successfuly.
  • --compress: enable transfer compression.
  • --bandwidth: enable bandwidth limit. Set it in Kbps.
  • --cipher: change default cipher (aes128-ctr).
  • --resume: resume partially uploaded file (SFTP only)

Python

PyPI version shields.io

pip3 install openzim_uploader[all]
openzim-uploader --help

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

openzim_uploader-1.0.tar.gz (8.9 kB view details)

Uploaded Source

Built Distribution

openzim_uploader-1.0-py3-none-any.whl (8.9 kB view details)

Uploaded Python 3

File details

Details for the file openzim_uploader-1.0.tar.gz.

File metadata

  • Download URL: openzim_uploader-1.0.tar.gz
  • Upload date:
  • Size: 8.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.10.5

File hashes

Hashes for openzim_uploader-1.0.tar.gz
Algorithm Hash digest
SHA256 c487a4d6e6fb734ff30109a1010932f7fe3e60679370c92f632bf7265559401a
MD5 d14380e9aa910c55dabc0335fed927bd
BLAKE2b-256 b95c0a8b1f2e121861ea7fac24326c7d2a0fa1c593d3f102915bd7d5a25f98eb

See more details on using hashes here.

File details

Details for the file openzim_uploader-1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for openzim_uploader-1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 00e3e5e2a858db2b43ed98f0533de302d413b568a4b410cadc854a20f098d060
MD5 e293269dec0a935fe2dfcc3a785111ba
BLAKE2b-256 4ac6234927743042ea4a86f665d1712b3ee994a568bf9ad6b82104fb39e8f051

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page