A small helper package to transfer files via pyFIRECREST api
Project description
Introduction
Helper for using CSCS's pyfireCREST
Under construction!
Quick start
python3 -m pip install --trusted-host pypi.org --trusted-host pypi.python.org --trusted-host files.pythonhosted.org pyfirecrest_helper
- You need a client id and a client secret to use the API. These can be obtained from CSCS here: https://oidc-dashboard-prod.cscs.ch/ This can be put in a file called
secrets.jsonfile that will look something like this (replace the client_id and client_secret with the information you have obtained from the CSCS site):
{
"client_id" : "firecrest-jgustavs-mycomputer",
"client_secret": "qpfKkEaHCwwmeC0vmysecretforfirecrest",
"token_uri" : "https://auth.cscs.ch/auth/realms/firecrest-clients/protocol/openid-connect/token"
}
give the location of your certs
export REQUESTS_CA_BUNDLE=/usr/local/share/ca-certificates/BIT_Proxy_Root_CA_01.crt pyfirecrest_helper --list -a daint -t /store/2go/go30/JAG_test/ pyfirecrest_helper --download -a daint -s /store/2go/go30/JAG_test/20211212_121543.jpg pyfirecrest_helper --upload -a daint -s ./requirements.txt -t /store/2go/go30/JAG_test/
Installing:
Getting Started with script
- Have python 3 installed on your system. If not installed please go here: https://www.python.org/downloads
- py -m pip install --trusted-host pypi.org --trusted-host pypi.python.org --trusted-host files.pythonhosted.org --upgrade pip
- py -m pip install --trusted-host pypi.org --trusted-host pypi.python.org --trusted-host files.pythonhosted.org pipx pyenv
- py -m venv testing_fireCREST_JAG
- .\env\Scripts\activate
- Clone this repository:
git clone https://juliagustavsenagroscope@dev.azure.com/juliagustavsenagroscope/Allegra_Pilot/_git/pyfirecrest_helpers - py setup.py install
- You need a client id and a client secret to use the API. These can be obtained from CSCS here: https://oidc-dashboard-prod.cscs.ch/ This can be put in a file called
secrets.jsonfile that will look something like this (replace the client_id and client_secret with the information you have obtained from the CSCS site):
{
"client_id" : "firecrest-jgustavs-mycomputer",
"client_secret": "qpfKkEaHCwwmeC0vmysecretforfirecrest",
"token_uri" : "https://auth.cscs.ch/auth/realms/firecrest-clients/protocol/openid-connect/token"
}
The secrets.json file should live in the same directory as the source code.
Helpful installation if issues with requests,etc. export REQUESTS_CA_BUNDLE=/usr/local/share/ca-certificates/BIT_Proxy_Root_CA_01.crt equivalent on windows?
- Deactivate the virtual env with
deactivate
Examples
python3 pyfirecrest_helper.py --list -a daint -t /store/2go/go30/JAG_test/
python3 pyfirecrest_helper.py --download -a daint -s /store/2go/go30/JAG_test/20211212_121543.jpg
python3 pyfirecrest_helper.py --upload -a daint -s ./requirements.txt -t /store/2go/go30/JAG_test/
Windows testing
py -m pip install --trusted-host pypi.org --trusted-host pypi.python.org --trusted-host files.pythonhosted.org pipx pyenv certifi py -m pip install --trusted-host pypi.org --trusted-host pypi.python.org --trusted-host files.pythonhosted.org certifi py -c "import certifi ; print(certifi.where())" #C:\Users\F80862788\AppData\Local\Programs\Python\Python311\Lib\site-packages\certifi\cacert.pem
or try to get it to trust the certificaters
py -m pip install --trusted-host pypi.org --trusted-host pypi.python.org --trusted-host files.pythonhosted.org pip_system_certs
then try...isntalling
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file pyfirecrest_helper-0.0.1.tar.gz.
File metadata
- Download URL: pyfirecrest_helper-0.0.1.tar.gz
- Upload date:
- Size: 10.2 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.8.10
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
40df67c26e9975c06e06c2f02a73f73bcac51e5ec77426375a1839beacd41166
|
|
| MD5 |
9d343eee27b1d3e0d0afc8a4fed5ca4c
|
|
| BLAKE2b-256 |
c660467cf9338ae751e8caf00fd9c1d14a082b7213bd1e178dd04bdc2ccf957e
|
File details
Details for the file pyfirecrest_helper-0.0.1-py3-none-any.whl.
File metadata
- Download URL: pyfirecrest_helper-0.0.1-py3-none-any.whl
- Upload date:
- Size: 5.0 MB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.8.10
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2fb386f072738d2046a95f8c66ae6d08ae9a7330cd0fab23b2a436b8f66af9d5
|
|
| MD5 |
876c2a655bb8a86113c3f09b1668cf5b
|
|
| BLAKE2b-256 |
aab31ca1764f34e993d74efc16282d195faaef7795772a28428c75a806f864ea
|