Skip to main content

Scripts for cluster management in CSLE

Project description

csle-cluster

This library contains scripts and programs for cluster management in CSLE.

PyPI version PyPI - Downloads

Re-generate gRPC files

To re-generate the gRPC files, run:

python -m grpc_tools.protoc -I./protos/ --python_out=./src/csle_cluster/. --grpc_python_out=./src/csle_cluster/cluster_manager/. ./protos/cluster_manager.proto --mypy_out=./src/csle_cluster/cluster_manager/.

Requirements

  • Python 3.8+
  • csle-base
  • csle-common
  • csle-collector
  • gym-csle-stopping-game
  • gym-csle-apt-game
  • gym-csle-cyborg
  • gym-csle-intrusion-response-game
  • gym-csle-tolerance
  • csle-ryu
  • grpcio (for the cluster API)
  • grpcio-tools (for the cluster API)

Development Requirements

  • Python 3.8+
  • flake8 (for linting)
  • flake8-rst-docstrings (for linting docstrings)
  • tox (for automated testing)
  • pytest (for unit tests)
  • pytest-cov (for unit test coverage)
  • mypy (for static typing)
  • mypy-extensions (for static typing)
  • mypy-protobuf (for static typing)
  • types-PyYaml (for static typing)
  • types-paramiko (for static typing)
  • types-protobuf (for static typing)
  • types-requests (for static typing)
  • types-urllib3 (for static typing)
  • sphinx (for API documentation)
  • sphinxcontrib-napoleon (for API documentation)
  • sphinx-rtd-theme (for API documentation)

Installation

# install from pip
pip install csle-cluster==<version>
# local install from source
$ pip install -e csle-cluster
# or (equivalently):
make install
# force upgrade deps
$ pip install -e csle-cluster --upgrade
# git clone and install from source
git clone https://github.com/Kim-Hammar/csle
cd csle/simulation-system/libs/csle-cluster
pip3 install -e .
# Install development dependencies
$ pip install -r requirements_dev.txt

Development tools

Install all development tools at once:

make install_dev

or

pip install -r requirements_dev.txt

API documentation

This section contains instructions for generating API documentation using sphinx.

Latest Documentation

The latest documentation is available at https://kim-hammar.github.io/csle//docs/csle-cluster

Generate API Documentation

First make sure that the CSLE_HOME environment variable is set:

echo $CSLE_HOME

Then generate the documentation with the commands:

cd docs
sphinx-apidoc -f -o source/ ../src/csle_cluster/
make html

To update the official documentation at https://kim-hammar.github.io/csle/, copy the generated HTML files to the documentation folder:

cp -r build/html ../../../../docs/_docs/csle-cluster

To run all documentation commands at once, use the command:

make docs

Static code analysis

To run the Python linter, execute the following command:

flake8 .
# or (equivalently):
make lint

To run the mypy type checker, execute the following command:

mypy .
# or (equivalently):
make types

Unit tests

To run the unit tests, execute the following command:

pytest
# or (equivalently):
make unit_tests

To run tests of a specific test suite, execute the following command:

pytest -k "ClassName"

To generate a coverage report, execute the following command:

pytest --cov=csle_cluster

Run tests and code analysis in different python environments

To run tests and code analysis in different python environemnts, execute the following command:

tox
# or (equivalently):
make tests

Create a new release and publish to PyPi

First build the package by executing:

python3 -m build
# or (equivalently)
make build

After running the command above, the built package is available at ./dist.

Push the built package to PyPi by running:

python3 -m twine upload dist/*
# or (equivalently)
make push

To run all commands for the release at once, execute:

make release

Author & Maintainer

Kim Hammar kimham@kth.se

Copyright and license

LICENSE

Creative Commons

(C) 2020-2025, Kim Hammar

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

csle_cluster-0.9.45.tar.gz (173.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

csle_cluster-0.9.45-py3-none-any.whl (145.0 kB view details)

Uploaded Python 3

File details

Details for the file csle_cluster-0.9.45.tar.gz.

File metadata

  • Download URL: csle_cluster-0.9.45.tar.gz
  • Upload date:
  • Size: 173.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.11

File hashes

Hashes for csle_cluster-0.9.45.tar.gz
Algorithm Hash digest
SHA256 3616b1caf3283d1e71acfcfcebb9811370066e6383b3d18bf7f5cf2286745a1b
MD5 b6d5e7ceb72f10fb47f70c390b1de6ef
BLAKE2b-256 d11a3150279d04311c38be98aa439ec41a6984d5b18ffa54a778d3aad1950e1b

See more details on using hashes here.

File details

Details for the file csle_cluster-0.9.45-py3-none-any.whl.

File metadata

  • Download URL: csle_cluster-0.9.45-py3-none-any.whl
  • Upload date:
  • Size: 145.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.11

File hashes

Hashes for csle_cluster-0.9.45-py3-none-any.whl
Algorithm Hash digest
SHA256 25a434aa4124fed14c8b0eb6ff08b24790c551d3071ae933c326121091eb0ce4
MD5 f499678d519abc0d4e86ef77fdd3db4c
BLAKE2b-256 13275c8a81702ae176e7dd7ba4e116b7da64eaa8844992937c8c83387ea6e94b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page