Skip to main content

Scripts for cluster management in CSLE

Project description

csle-cluster

This library contains scripts and programs for cluster management in CSLE.

PyPI version PyPI - Downloads

Re-generate gRPC files

To re-generate the gRPC files, run:

python -m grpc_tools.protoc -I./protos/ --python_out=./src/csle_cluster/. --grpc_python_out=./src/csle_cluster/cluster_manager/. ./protos/cluster_manager.proto --mypy_out=./src/csle_cluster/cluster_manager/.

Requirements

  • Python 3.8+
  • csle-base
  • csle-common
  • csle-collector
  • gym-csle-stopping-game
  • gym-csle-apt-game
  • gym-csle-cyborg
  • gym-csle-intrusion-response-game
  • gym-csle-tolerance
  • csle-ryu
  • grpcio (for the cluster API)
  • grpcio-tools (for the cluster API)

Development Requirements

  • Python 3.8+
  • flake8 (for linting)
  • flake8-rst-docstrings (for linting docstrings)
  • tox (for automated testing)
  • pytest (for unit tests)
  • pytest-cov (for unit test coverage)
  • mypy (for static typing)
  • mypy-extensions (for static typing)
  • mypy-protobuf (for static typing)
  • types-PyYaml (for static typing)
  • types-paramiko (for static typing)
  • types-protobuf (for static typing)
  • types-requests (for static typing)
  • types-urllib3 (for static typing)
  • sphinx (for API documentation)
  • sphinxcontrib-napoleon (for API documentation)
  • sphinx-rtd-theme (for API documentation)

Installation

# install from pip
pip install csle-cluster==<version>
# local install from source
$ pip install -e csle-cluster
# or (equivalently):
make install
# force upgrade deps
$ pip install -e csle-cluster --upgrade
# git clone and install from source
git clone https://github.com/Kim-Hammar/csle
cd csle/simulation-system/libs/csle-cluster
pip3 install -e .
# Install development dependencies
$ pip install -r requirements_dev.txt

Development tools

Install all development tools at once:

make install_dev

or

pip install -r requirements_dev.txt

API documentation

This section contains instructions for generating API documentation using sphinx.

Latest Documentation

The latest documentation is available at https://kim-hammar.github.io/csle//docs/csle-cluster

Generate API Documentation

First make sure that the CSLE_HOME environment variable is set:

echo $CSLE_HOME

Then generate the documentation with the commands:

cd docs
sphinx-apidoc -f -o source/ ../src/csle_cluster/
make html

To update the official documentation at https://kim-hammar.github.io/csle/, copy the generated HTML files to the documentation folder:

cp -r build/html ../../../../docs/_docs/csle-cluster

To run all documentation commands at once, use the command:

make docs

Static code analysis

To run the Python linter, execute the following command:

flake8 .
# or (equivalently):
make lint

To run the mypy type checker, execute the following command:

mypy .
# or (equivalently):
make types

Unit tests

To run the unit tests, execute the following command:

pytest
# or (equivalently):
make unit_tests

To run tests of a specific test suite, execute the following command:

pytest -k "ClassName"

To generate a coverage report, execute the following command:

pytest --cov=csle_cluster

Run tests and code analysis in different python environments

To run tests and code analysis in different python environemnts, execute the following command:

tox
# or (equivalently):
make tests

Create a new release and publish to PyPi

First build the package by executing:

python3 -m build
# or (equivalently)
make build

After running the command above, the built package is available at ./dist.

Push the built package to PyPi by running:

python3 -m twine upload dist/*
# or (equivalently)
make push

To run all commands for the release at once, execute:

make release

Author & Maintainer

Kim Hammar kimham@kth.se

Copyright and license

LICENSE

Creative Commons

(C) 2020-2026, Kim Hammar

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

csle_cluster-0.10.0.tar.gz (177.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

csle_cluster-0.10.0-py3-none-any.whl (145.0 kB view details)

Uploaded Python 3

File details

Details for the file csle_cluster-0.10.0.tar.gz.

File metadata

  • Download URL: csle_cluster-0.10.0.tar.gz
  • Upload date:
  • Size: 177.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.11

File hashes

Hashes for csle_cluster-0.10.0.tar.gz
Algorithm Hash digest
SHA256 af7714fe0a05a3fd5c4d79c39da16ce054002499ea82e29dbc660e5dbecff07b
MD5 2a98a389c1dab9768da365ea805354d2
BLAKE2b-256 fdb09f73b4b3116605eabe75ccfd255051b283bfd1e410df0cbc981eb8ec9a52

See more details on using hashes here.

File details

Details for the file csle_cluster-0.10.0-py3-none-any.whl.

File metadata

  • Download URL: csle_cluster-0.10.0-py3-none-any.whl
  • Upload date:
  • Size: 145.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.11

File hashes

Hashes for csle_cluster-0.10.0-py3-none-any.whl
Algorithm Hash digest
SHA256 b4d5c5a008c0bd25f3b352b3ef0bbc3dbb3402ea63a5c840561991665c99ba52
MD5 9ffdfa915b0f3e675818ab46b55044da
BLAKE2b-256 3f03cd569c9d761a572edb14b751c213ce256fa38f128c813e8a3f4e0aa9a957

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page