Skip to main content

Scripts for cluster management in CSLE

Project description

csle-cluster

This library contains scripts and programs for cluster management in CSLE.

PyPI version PyPI - Downloads

Re-generate gRPC files

To re-generate the gRPC files, run:

python -m grpc_tools.protoc -I./protos/ --python_out=./src/csle_cluster/. --grpc_python_out=./src/csle_cluster/cluster_manager/. ./protos/cluster_manager.proto --mypy_out=./src/csle_cluster/cluster_manager/.

Requirements

  • Python 3.8+
  • csle-base
  • csle-common
  • csle-collector
  • gym-csle-stopping-game
  • gym-csle-apt-game
  • gym-csle-cyborg
  • gym-csle-intrusion-response-game
  • gym-csle-tolerance
  • csle-ryu
  • grpcio (for the cluster API)
  • grpcio-tools (for the cluster API)

Development Requirements

  • Python 3.8+
  • flake8 (for linting)
  • flake8-rst-docstrings (for linting docstrings)
  • tox (for automated testing)
  • pytest (for unit tests)
  • pytest-cov (for unit test coverage)
  • mypy (for static typing)
  • mypy-extensions (for static typing)
  • mypy-protobuf (for static typing)
  • types-PyYaml (for static typing)
  • types-paramiko (for static typing)
  • types-protobuf (for static typing)
  • types-requests (for static typing)
  • types-urllib3 (for static typing)
  • sphinx (for API documentation)
  • sphinxcontrib-napoleon (for API documentation)
  • sphinx-rtd-theme (for API documentation)

Installation

# install from pip
pip install csle-cluster==<version>
# local install from source
$ pip install -e csle-cluster
# or (equivalently):
make install
# force upgrade deps
$ pip install -e csle-cluster --upgrade
# git clone and install from source
git clone https://github.com/Kim-Hammar/csle
cd csle/simulation-system/libs/csle-cluster
pip3 install -e .
# Install development dependencies
$ pip install -r requirements_dev.txt

Development tools

Install all development tools at once:

make install_dev

or

pip install -r requirements_dev.txt

API documentation

This section contains instructions for generating API documentation using sphinx.

Latest Documentation

The latest documentation is available at https://kim-hammar.github.io/csle//docs/csle-cluster

Generate API Documentation

First make sure that the CSLE_HOME environment variable is set:

echo $CSLE_HOME

Then generate the documentation with the commands:

cd docs
sphinx-apidoc -f -o source/ ../src/csle_cluster/
make html

To update the official documentation at https://kim-hammar.github.io/csle/, copy the generated HTML files to the documentation folder:

cp -r build/html ../../../../docs/_docs/csle-cluster

To run all documentation commands at once, use the command:

make docs

Static code analysis

To run the Python linter, execute the following command:

flake8 .
# or (equivalently):
make lint

To run the mypy type checker, execute the following command:

mypy .
# or (equivalently):
make types

Unit tests

To run the unit tests, execute the following command:

pytest
# or (equivalently):
make unit_tests

To run tests of a specific test suite, execute the following command:

pytest -k "ClassName"

To generate a coverage report, execute the following command:

pytest --cov=csle_cluster

Run tests and code analysis in different python environments

To run tests and code analysis in different python environemnts, execute the following command:

tox
# or (equivalently):
make tests

Create a new release and publish to PyPi

First build the package by executing:

python3 -m build
# or (equivalently)
make build

After running the command above, the built package is available at ./dist.

Push the built package to PyPi by running:

python3 -m twine upload dist/*
# or (equivalently)
make push

To run all commands for the release at once, execute:

make release

Author & Maintainer

Kim Hammar kimham@kth.se

Copyright and license

LICENSE

Creative Commons

(C) 2020-2026, Kim Hammar

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

csle_cluster-0.9.46.tar.gz (177.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

csle_cluster-0.9.46-py3-none-any.whl (145.0 kB view details)

Uploaded Python 3

File details

Details for the file csle_cluster-0.9.46.tar.gz.

File metadata

  • Download URL: csle_cluster-0.9.46.tar.gz
  • Upload date:
  • Size: 177.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.11

File hashes

Hashes for csle_cluster-0.9.46.tar.gz
Algorithm Hash digest
SHA256 8c1bed542476a645d686ec9e6e4dd8a3d7474fe9f2f0726db55db698a7dca1bd
MD5 79fa9a00ea87b6ea1405f05a08f606aa
BLAKE2b-256 44d5c1b75ea350f723bb7022b72b27963dff0a0cac3c2fc91443e35de3eb0cfd

See more details on using hashes here.

File details

Details for the file csle_cluster-0.9.46-py3-none-any.whl.

File metadata

  • Download URL: csle_cluster-0.9.46-py3-none-any.whl
  • Upload date:
  • Size: 145.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.11

File hashes

Hashes for csle_cluster-0.9.46-py3-none-any.whl
Algorithm Hash digest
SHA256 6830b11dd4c599253031e2e3642417a1c747c5fe40e2c3f59407b412ce6be680
MD5 2e71e0dee64529c1ef53fc249a5b7136
BLAKE2b-256 610a8e4afcf8d44f812fee295f9ae0fe2785401f2cac18670ef84bfca43cc5dd

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page