Skip to main content

OpenAI gym reinforcement learning environment of a Dynkin (Optimal stopping) APT game in CSLE

Project description

gym-csle-apt-game

An OpenAI gym reinforcement learning environment that represents an APT game

PyPI version PyPI - Downloads

Requirements

  • Python 3.8+
  • csle-base
  • csle-common
  • csle-attacker
  • csle-defender
  • csle-collector
  • gymnasium for specifying the RL environment API

Development Requirements

  • Python 3.8+
  • flake8 (for linting)
  • flake8-rst-docstrings (for linting docstrings)
  • tox (for automated testing)
  • pytest (for unit tests)
  • pytest-cov (for unit test coverage)
  • pytest-mock (for mocking tests)
  • pytest-grpc (for grpc tests)
  • mypy (for static typing)
  • mypy-extensions (for static typing)
  • mypy-protobuf (for static typing)
  • types-PyYaml (for static typing)
  • types-paramiko (for static typing)
  • types-protobuf (for static typing)
  • types-requests (for static typing)
  • types-urllib3 (for static typing)
  • sphinx (for API documentation)
  • sphinxcontrib-napoleon (for API documentation)
  • sphinx-rtd-theme (for API documentation)

Installation

# install from pip
pip install gym-csle-apt-game==<version>
# local install from source
$ pip install -e gym-csle-apt-game
# or (equivalently):
make install
# force upgrade deps
$ pip install -e gym-csle-apt-game --upgrade
# git clone and install from source
git clone https://github.com/Kim-Hammar/csle
cd csle/simulation-system/libs/gym-csle-apt-game
pip3 install -e .
# Install development dependencies
$ pip install -r requirements_dev.txt

Development tools

Install all development tools at once:

make install_dev

or

pip install -r requirements_dev.txt

API documentation

This section contains instructions for generating API documentation using sphinx.

Latest Documentation

The latest documentation is available at https://kim-hammar.github.io/csle//docs/gym-csle-apt-game

Generate API Documentation

First make sure that the CSLE_HOME environment variable is set:

echo $CSLE_HOME

Then generate the documentation with the commands:

cd docs
sphinx-apidoc -f -o source/ ../src/gym_csle_apt_game/
make html

To update the official documentation at https://kim-hammar.github.io/csle/, copy the generated HTML files to the documentation folder:

cp -r build/html ../../../../docs/_docs/gym-csle-apt-game

To run all documentation commands at once, use the command:

make docs

Static code analysis

To run the Python linter, execute the following command:

flake8 .
# or (equivalently):
make lint

To run the mypy type checker, execute the following command:

mypy .
# or (equivalently):
make types

Unit tests

To run the unit tests, execute the following command:

pytest
# or (equivalently):
make unit_tests

To run tests of a specific test suite, execute the following command:

pytest -k "ClassName"

To generate a coverage report, execute the following command:

pytest --cov=gym_csle_apt_game

Run tests and code analysis in different python environments

To run tests and code analysis in different python environemnts, execute the following command:

tox
# or (equivalently):
make tests

Create a new release and publish to PyPi

First build the package by executing:

python3 -m build
# or (equivalently)
make build

After running the command above, the built package is available at ./dist.

Push the built package to PyPi by running:

python3 -m twine upload dist/*
# or (equivalently)
make push

To run all commands for the release at once, execute:

make release

Author & Maintainer

Kim Hammar kimham@kth.se

Copyright and license

LICENSE

Creative Commons

(C) 2020-2026, Kim Hammar

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

gym_csle_apt_game-0.9.46.tar.gz (34.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

gym_csle_apt_game-0.9.46-py3-none-any.whl (28.4 kB view details)

Uploaded Python 3

File details

Details for the file gym_csle_apt_game-0.9.46.tar.gz.

File metadata

  • Download URL: gym_csle_apt_game-0.9.46.tar.gz
  • Upload date:
  • Size: 34.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.11

File hashes

Hashes for gym_csle_apt_game-0.9.46.tar.gz
Algorithm Hash digest
SHA256 92599618ced52a75a28f23d31cf6311adf78f1523e4ff3fca775326be849248f
MD5 ecd31aef26645454ff3b9c45cb952ec9
BLAKE2b-256 a66637ffb3b273966caaf97599f775fb03b3b7a2e051ec80806e1d597274c875

See more details on using hashes here.

File details

Details for the file gym_csle_apt_game-0.9.46-py3-none-any.whl.

File metadata

File hashes

Hashes for gym_csle_apt_game-0.9.46-py3-none-any.whl
Algorithm Hash digest
SHA256 3654337e77008d9abb9c7d5656465515fe4aafbb60fe11124b651e3f12390deb
MD5 6a0536a094075ab6585fbbbaeab84c9a
BLAKE2b-256 8d0366dc12b3fd62c6ed5ae4d064c0f99c7693eee4a636a4768630228075367c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page