Skip to main content

Jülich Monitoring and Control

Project description

Installation | Execution | Security | Plugins | Further documentation | Getting help | Acknowledgments |

JuMonC

JuMonC stands for "Jülich monitoring and control" and allows easier access to monitor running simulations and provides data using a REST-API.


Installation

JuMonC can be installed using pip:

pip install JuMonC

This also creates an entry point, allowing to start JuMonC with just the command JuMonC

Runtime dependencies

Optional runtime dependencies

Extras

JuMonC allows installation with extras for the optional dependencies. Some of them need installed software on the system, that is not part of the PyPi installation, so that still has to be provided. It still makes the setup easier. Currently the following options for the extras are avaiable:

  • PAPI: For use of PAPI
  • NVLM: For use of NVML
  • GPU: For use of GPU functionality, for now only adds the use of NVML
  • psutil: For use of psutil
  • SSL: Only needed when using adhoc certificates
  • Full: All of the above dependencies provided at once
  • Devel: Includes the ful ldependencies and installs all tools neeeded for CI as well, to allow local tests

These extras can be used like this:

pip install JuMonC[psutil,SSL]

Execution

JuMonC needs to be started parallel to your running simulation and needs one mpi process on each node your simulation is using. The actual REST-API will only be avaiable on node 0 and then communicate internaly using mpi.

It can be started by running srun -n <#nodes> --ntasks-per-node=1 JuMonC & Because we want to run JuMonC in parallel with other srun jobs, it is important to reduce the allocated resources (especially the implicit), so other jobs can start as well.

  • --mem-per-cpu 1000M : reduce memeory for JuMonC
  • -G0 : do not allocate GPUs for JuMonC
  • --exact : do not over allocate

Depending on your usecase --oversubscribe or --overlap may be usefull as well.

By default, this will start the REST-API on port 12121 on rank 0 of this allocation. The port can be changed by providing -p=<port>. Depending on the firewall rules of the system you are using, it might be necessary to use a ssh-tunnel to forward this endpoint of the API to somewhere else where you can access it.

Security

Authorization

Security is always a concern, and to block unauthorized access of this API there is a scope based token authorization included. This means each action requires authorization, with different tokens having a different scope of allowed actions. The tokens included by default and printed to stdout on startup are hierarchical, therefore every token includes the authorized functions of all lower tokens:

  1. see_links
  2. retrieve_data
  3. compute_data
  4. retrieve_simulation_data
  5. compute_simulation_data
  6. full

There are two options to prove your authorization, either cookie based by providing the token once in the login function (e.g. /login?token=12345678) or providing it by every API call as an additional parameter (e.g. /v1/network?token=12345678).

Encryption

JuMonC offers two different modes to use encryption for accessing the REST-API. One uses adhoc generated certificates, the other one allows you to supply your own certificates.

  1. adhoc certificates:
  • depending on the used software to acces JuMonC you will get a warning or by default (e.g. Mozilla firefox) a complete blocking of the connection (e.g. curl) that you need to accept or override. This is due to the certificates not having any chain of trust to already trusted certificates.
  • you need to have pyopenssl avaiable to use adhoc certificates
  • used with --SSL_ENABLED
  1. Providing certificates
  • You can generate your own self-singed certificates using for example openssl req -x509 -newkey rsa:4096 -nodes -out cert.pem -keyout key.pem -days 365
    • This leads to the same warings as the adhoc certificates, but allows a manual control of the signed certificate
  • using this methods needs three arguments, one for enabeling SSL --SSL_ENABLED and one each for the certificate and the key --SSL_CERT=/path/to/cert.pem --SSL_KEY=/path/to/key.pem. The paths can either be absolute paths or relatic paths from the current working directory.

Plugins

JuMonC's functionality can be extended by plugins. To see about the development of your own plugins visit the LogParser plugin as an example, or see the plugin development documentation.

Currently avaiable plugins for JuMonC:

Further documentation

Getting help

Open an issue

Acknowledgments

Horizon Europe JuMonC has been developed as part of the CoEC project, the CoEC project has received funding from the European Union’s Horizon 2020 research and innovation programm under grant agreement No 952181.

CoEC Logo Horizon Europe

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

JuMonC-0.9.1.tar.gz (42.1 kB view details)

Uploaded Source

Built Distribution

JuMonC-0.9.1-py3-none-any.whl (65.4 kB view details)

Uploaded Python 3

File details

Details for the file JuMonC-0.9.1.tar.gz.

File metadata

  • Download URL: JuMonC-0.9.1.tar.gz
  • Upload date:
  • Size: 42.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.10.6

File hashes

Hashes for JuMonC-0.9.1.tar.gz
Algorithm Hash digest
SHA256 454c6190dd6b3a435f70521c65cb91e02a13906e2029518b5278d7afc2850157
MD5 13a94225bfdbffa5b444ea752329fe3a
BLAKE2b-256 1bc7da903ed01c51a3789a51a3d94f51dd21fbf281f7998c44daed7ecd384940

See more details on using hashes here.

File details

Details for the file JuMonC-0.9.1-py3-none-any.whl.

File metadata

  • Download URL: JuMonC-0.9.1-py3-none-any.whl
  • Upload date:
  • Size: 65.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.10.6

File hashes

Hashes for JuMonC-0.9.1-py3-none-any.whl
Algorithm Hash digest
SHA256 d86174766dc6fc63d1d1687b385ebf642b7f3b3c2fc8338fcdfb5082bd409863
MD5 9f4ad34779500dd61d9df9bf1c5083d0
BLAKE2b-256 cf15f09bd3b86a0d5658138a983c2c737c162439a8f95f7165a0bb3f3672c1d3

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page