Skip to main content

A utility for archiving osf storage projects at archive.org

Project description

# osf-pigeon

A utility for archiving OSF data to archive.org

Purpose

This utility takes a publicly available OSF registration guid as a parameter and using that info alone it will transfer that registration, file data, metadata et all to Internet Archive.

Install

Simply install the package using python’s package manager pip with bash:

pip3 install osf_pigeon

To use for local development just remember to install the developer requirements using:

pip3 install -r dev.txt

Use

Simply import the module and enter a guid with credentials:

from osf_pigeon import pigeon

pigeon(
   'guid0',
   datacite_username='test_datacite_username',
   datacite_password='test_datacite_password',
   datacite_prefix='test_datacite_prefix',
   ia_access_key='test_datacite_password',
   ia_secret_key='test_datacite_password',
)

That’s it!

Assuming the registration is fully public and the DOI has been minted properly at datacite.

## Running for development

#### Tests

Running tests are easy enough just:

pip3 install -r dev.txt
python3 -m pytest .

#### Linting

Optional, but recommended: To set up pre-commit hooks (will run formatters and linters on staged files):

pip install pre-commit
pre-commit install --allow-missing-config

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

osf_pigeon-0.0.2.tar.gz (2.9 kB view details)

Uploaded Source

Built Distribution

osf_pigeon-0.0.2-py3-none-any.whl (4.5 kB view details)

Uploaded Python 3

File details

Details for the file osf_pigeon-0.0.2.tar.gz.

File metadata

  • Download URL: osf_pigeon-0.0.2.tar.gz
  • Upload date:
  • Size: 2.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/49.2.0 requests-toolbelt/0.9.1 tqdm/4.47.0 CPython/3.7.4

File hashes

Hashes for osf_pigeon-0.0.2.tar.gz
Algorithm Hash digest
SHA256 78d7ef60204276e99248c32f93f419039473419ddb901251c78684f13c34805d
MD5 2fcf9a5b4961e331d8ea34c4494559b9
BLAKE2b-256 2a0bba78119f4c5d4126267e9499b67dfcd48879e9e6ec27a55ace86ed006885

See more details on using hashes here.

File details

Details for the file osf_pigeon-0.0.2-py3-none-any.whl.

File metadata

  • Download URL: osf_pigeon-0.0.2-py3-none-any.whl
  • Upload date:
  • Size: 4.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/49.2.0 requests-toolbelt/0.9.1 tqdm/4.47.0 CPython/3.7.4

File hashes

Hashes for osf_pigeon-0.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 3d1815b29da00d0947bec0f91022a505cfb381ed714a0f6408940321f1782a0e
MD5 ce9a185d8d266e6e1eff0bdaec4b4e70
BLAKE2b-256 a506482eb9febc8b1ac3e184697844329c883d5be8fd0949c4509ccee4862293

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page