Skip to main content

Script for depositing the data into EMPIAR using EMPIAR API

Project description

https://badge.fury.io/py/empiar-depositor.svg PyPI - Python Version https://travis-ci.org/emdb-empiar/empiar-depositor.svg?branch=dev https://coveralls.io/repos/github/emdb-empiar/empiar-depositor/badge.svg?branch=dev

Command line tool for depositing data into Electron Microscopy Public Image Archive.

How to use

Please follow these steps:

1. Create a JSON file according to the schema. An example of such a file.

2. Download and install ascp tool and/or install globus-cli (supported version 1.7.0) with

pip install globus-cli==1.7.0

Globus can be used as a separate upload option or as a fallback if Aspera fails.

3. Set the environmental variable for EMPIAR transfer password to the one that EMPIAR team has provided you with. Please note that this is not the API token from 1) and is a separate password from the one that you create when registering EMPIAR user.

  • On Linux and Mac OS X execute

    export EMPIAR_TRANSFER_PASS=<empiar_transfer_password>
  • On Windows execute

    set EMPIAR_TRANSFER_PASS=<empiar_transfer_password>
  1. Run the script as:

    empiar-depositor [-h] [-a ASCP] [-g GLOBUS] [-f] [-e ENTRY_THUMBNAIL] [-r ENTRY_ID ENTRY_DIR] [-i] [-v] EMPIAR_TOKEN JSON_INPUT DATA

Positional arguments:

EMPIAR_TOKEN

EMPIAR API token. You can generate it at https://empiar.org/deposition/api_token. Alternatively, instead of the token you can use your EMPIAR username and provide your password with -p optional argument (see below for more information).

JSON_INPUT

The location of the JSON with EMPIAR deposition information.

DATA

The location of the data that you would like to upload to EMPIAR. It should contain directories that correspond to the image set directories specified in the JSON file.

Optional arguments:

-h, --help

Show help message and exit

-p PASSWORD, --password PASSWORD

Use basic authentication (username + password) instead of token authentication. If no password is provided for this argument, then the user is prompted for a password.

-a ASCP, --ascp ASCP

The location of the ascp executable. By default it is installed in ~/.aspera/connect/bin directory on Linux machines, in ~/Applications/Aspera\ Connect.app/Contents/Resources directory on Macs and in C:\Users\<username>\AppData\Local\Programs\Aspera\Aspera Connect\bin on Windows.

-g GLOBUS, --globus GLOBUS

Use Globus if Aspera is not specified or Aspera transfer fails. Requirement: globus-cli installed and an endpoint created. Specify your unique user identifier (UUID) as the input parameter.

-f, --globus-force-login

Force login to Globus. Login even if the globus-cli already has valid login credentials. Any existing credentials will be removed from local storage and globally revoked.

-e ENTRY_THUMBNAIL, --entry-thumbnail ENTRY_THUMBNAIL

Thumbnail image that will represent your deposition on EMPIAR pages. Minimum size is 400 x 400, preferred format is png. If none is provided, then the image from the related EMDB entry will be used.

-r ENTRY_ID ENTRY_DIR, --resume ENTRY_ID ENTRY_DIR

Resume Aspera upload or re-deposit an entry. The entry has to be successfully created as specifying EMPIAR entry ID and entry directory is required. All entry metadata will be replaced with the one provided in the JSON file. Aspera transfer will continue from where it stopped.

-gu USERNAME_RIGHTS, --grant-rights-usernames USERNAME_RIGHTS

-ge EMAIL_RIGHTS, --grant-rights-emails EMAIL_RIGHTS

-gu ORCID_RIGHTS, --grant-rights-usernames ORCID_RIGHTS

Grant rights based on usernames, emails or ORCiDs. USERNAME_RIGHTS, EMAIL_RIGHTS and ORCID_RIGHTS are comma separated lists of usernames, emails, ORCiDs and rights in format username:rights, email:rights and orcid:rights. Rights can be 1 - Owner, 2 - View only, 3 - View and Edit, 4 - View, Edit and Submit. There can be only one deposition owner.

-i, --ignore-certificate

Activate this flag to skip the verification of SSL certificate.

-v, --version

Show program’s version number and exit

Examples:

empiar-depositor -a ~/Applications/Aspera\ Connect.app/Contents/Resources/ascp 0123456789 ~/Documents/empiar_deposition_1.json ~/Downloads/micrographs
empiar-depositor -a ~/Applications/Aspera\ Connect.app/Contents/Resources/ascp 0123456789 ~/Documents/empiar_deposition_1.json ~/Downloads/micrographs -gu johndoe:1,jamessmith:3
empiar-depositor -a ~/Applications/Aspera\ Connect.app/Contents/Resources/ascp 0123456789 ~/Documents/empiar_deposition_1.json ~/Downloads/micrographs -gu johndoe:4,jamessmith:1 -ge jeremycarpenter@email.com:3 -go 0000-0000-0000-0001:2,0000-0000-1000-0002:4
empiar-depositor -r 10 ABC123 -e ~/Downloads/dep_thumb.png 0123456789 -g 01234567-89a-bcde-fghi-jklmnopqrstu ~/Documents/empiar_deposition_1.json ~/Downloads/micrographs
empiar-depositor -a ~/Applications/Aspera\ Connect.app/Contents/Resources/ascp my_empiar_user -p my_empiar_password ~/Documents/empiar_deposition_1.json ~/Downloads/micrographs

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

empiar-depositor-1.6b26.tar.gz (147.0 kB view details)

Uploaded Source

Built Distribution

empiar_depositor-1.6b26-py3-none-any.whl (152.9 kB view details)

Uploaded Python 3

File details

Details for the file empiar-depositor-1.6b26.tar.gz.

File metadata

  • Download URL: empiar-depositor-1.6b26.tar.gz
  • Upload date:
  • Size: 147.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/3.10.0 pkginfo/1.5.0.1 requests/2.20.0 requests-toolbelt/0.9.1 tqdm/4.38.0 CPython/3.7.3

File hashes

Hashes for empiar-depositor-1.6b26.tar.gz
Algorithm Hash digest
SHA256 0d8b1487028f6d00e2f14f40838e77f52a8c19f8860379fa2a4c09551c22a713
MD5 cd38b08acca09d0beffebba1fdc2e9eb
BLAKE2b-256 b99f7231a70c8788c94be5d5af54c9631eff6f8f1e7ad8ce3f81704ab7a6b8d8

See more details on using hashes here.

File details

Details for the file empiar_depositor-1.6b26-py3-none-any.whl.

File metadata

  • Download URL: empiar_depositor-1.6b26-py3-none-any.whl
  • Upload date:
  • Size: 152.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/3.10.0 pkginfo/1.5.0.1 requests/2.20.0 requests-toolbelt/0.9.1 tqdm/4.38.0 CPython/3.7.3

File hashes

Hashes for empiar_depositor-1.6b26-py3-none-any.whl
Algorithm Hash digest
SHA256 66db4afe965ca76280e61f230b36d59f66ca1a8cc6caed7eec5df42f4cb82e96
MD5 8bf4090c2342fad6d241e444f6147c3c
BLAKE2b-256 11faabf59c8e2d3df6a9c37b3ae591480f6ac6e62aba4c3847c819b27bda348f

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page