Skip to main content

A small helper package to transfer files via pyFIRECREST api

Project description

Introduction

Helper for using CSCS's pyfireCREST

Under construction!

Quick start

python3 -m pip install --trusted-host pypi.org --trusted-host pypi.python.org --trusted-host files.pythonhosted.org pyfirecrest_helper

  • You need a client id and a client secret to use the API. These can be obtained from CSCS here: https://oidc-dashboard-prod.cscs.ch/ This can be put in a file called secrets.json file that will look something like this (replace the client_id and client_secret with the information you have obtained from the CSCS site):
{
    "client_id" : "firecrest-jgustavs-mycomputer",
    "client_secret": "qpfKkEaHCwwmeC0vmysecretforfirecrest",
    "token_uri" : "https://auth.cscs.ch/auth/realms/firecrest-clients/protocol/openid-connect/token"
}

give the location of your certs

export REQUESTS_CA_BUNDLE=/usr/local/share/ca-certificates/BIT_Proxy_Root_CA_01.crt pyfirecrest_helper --list -a daint -t /store/2go/go30/JAG_test/ pyfirecrest_helper --download -a daint -s /store/2go/go30/JAG_test/20211212_121543.jpg pyfirecrest_helper --upload -a daint -s ./requirements.txt -t /store/2go/go30/JAG_test/

Installing:

Getting Started with script

  • Have python 3 installed on your system. If not installed please go here: https://www.python.org/downloads
    • py -m pip install --trusted-host pypi.org --trusted-host pypi.python.org --trusted-host files.pythonhosted.org --upgrade pip
    • py -m pip install --trusted-host pypi.org --trusted-host pypi.python.org --trusted-host files.pythonhosted.org pipx pyenv
    • py -m venv testing_fireCREST_JAG
    • .\env\Scripts\activate
  • Clone this repository: git clone https://juliagustavsenagroscope@dev.azure.com/juliagustavsenagroscope/Allegra_Pilot/_git/pyfirecrest_helper s
  • py setup.py install
  • You need a client id and a client secret to use the API. These can be obtained from CSCS here: https://oidc-dashboard-prod.cscs.ch/ This can be put in a file called secrets.json file that will look something like this (replace the client_id and client_secret with the information you have obtained from the CSCS site):
{
    "client_id" : "firecrest-jgustavs-mycomputer",
    "client_secret": "qpfKkEaHCwwmeC0vmysecretforfirecrest",
    "token_uri" : "https://auth.cscs.ch/auth/realms/firecrest-clients/protocol/openid-connect/token"
}

The secrets.json file should live in the same directory as the source code.

Helpful installation if issues with requests,etc. export REQUESTS_CA_BUNDLE=/usr/local/share/ca-certificates/BIT_Proxy_Root_CA_01.crt equivalent on windows?

  • Deactivate the virtual env with deactivate

Examples

python3 pyfirecrest_helper.py --list -a daint -t /store/2go/go30/JAG_test/

python3 pyfirecrest_helper.py --download -a daint -s /store/2go/go30/JAG_test/20211212_121543.jpg

python3 pyfirecrest_helper.py --upload -a daint -s ./requirements.txt -t /store/2go/go30/JAG_test/

Windows testing

py -m pip install --trusted-host pypi.org --trusted-host pypi.python.org --trusted-host files.pythonhosted.org pipx pyenv certifi py -m pip install --trusted-host pypi.org --trusted-host pypi.python.org --trusted-host files.pythonhosted.org certifi py -c "import certifi ; print(certifi.where())" #C:\Users\F80862788\AppData\Local\Programs\Python\Python311\Lib\site-packages\certifi\cacert.pem

or try to get it to trust the certificaters

py -m pip install --trusted-host pypi.org --trusted-host pypi.python.org --trusted-host files.pythonhosted.org pip_system_certs

then try...isntalling

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pyfirecrest_helper-0.0.1.tar.gz (10.2 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pyfirecrest_helper-0.0.1-py3-none-any.whl (5.0 MB view details)

Uploaded Python 3

File details

Details for the file pyfirecrest_helper-0.0.1.tar.gz.

File metadata

  • Download URL: pyfirecrest_helper-0.0.1.tar.gz
  • Upload date:
  • Size: 10.2 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.8.10

File hashes

Hashes for pyfirecrest_helper-0.0.1.tar.gz
Algorithm Hash digest
SHA256 40df67c26e9975c06e06c2f02a73f73bcac51e5ec77426375a1839beacd41166
MD5 9d343eee27b1d3e0d0afc8a4fed5ca4c
BLAKE2b-256 c660467cf9338ae751e8caf00fd9c1d14a082b7213bd1e178dd04bdc2ccf957e

See more details on using hashes here.

File details

Details for the file pyfirecrest_helper-0.0.1-py3-none-any.whl.

File metadata

File hashes

Hashes for pyfirecrest_helper-0.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 2fb386f072738d2046a95f8c66ae6d08ae9a7330cd0fab23b2a436b8f66af9d5
MD5 876c2a655bb8a86113c3f09b1668cf5b
BLAKE2b-256 aab31ca1764f34e993d74efc16282d195faaef7795772a28428c75a806f864ea

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page