Skip to main content

rlmodule

Flexible reinforcement learning models instantiators library

Function approximators simple, but still strong. RNN - GRU - LSTM / SAC

Now it only supports skrl, but is intended to be library agnostic - in later expansion

try other algos shared separate model

How to run

Install rlmodule from local code

  • Make sure you are in base rlmodule dict.

  • Start virtual env.

python3 -m venv venv
source venv/bin/activate
  • Install library from local code
pip install -e .

Note: sometimes installation may fail, if there is a run/ dir present, you may need to remove it (TODO: fix)

rm -rf runs

Deep policies: LayerNorm and Residual MLPs

rlmodule supports per-layer LayerNorm on MlpCfg and a SimBa-style residual MLP (ResidualMlpCfg). These work for both separated and shared architectures, with independent per-head granularity via the new OutputLayerCfg.head field. See docs/layer_norm_and_residual.md for motivation, references, and copy-pasteable cfg snippets.

Run chosen example

python3 rlmodule/skrl/torch/examples/gymnasium/pendulum_ppo_mlp_separate_model.py

Optional: observe run results in Tensorboard

tensorboard --logdir=runs/

Update new version to PIP

Change version name in pyproject.toml

pip install build twine
rm -rf runs
python -m build
twine upload dist/*

Metadata

Release files for rlmodule 0.2.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for rlmodule 0.2.0
File Size Uploaded
rlmodule-0.2.0.tar.gz 85.2 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for rlmodule 0.2.0
File Interpreter ABI Platform
rlmodule-0.2.0-py3-none-any.whl Python 3 none any Details

Total release size: 164.7 kB

Release files / rlmodule-0.2.0.tar.gz

Download URL rlmodule-0.2.0.tar.gz
Size 85.2 kB
Tags Source
SHA-256 checksum
How to use checksums
44dd53a05622ff66a93b9255d3241bb6b3a32c7716663636bdc364cb91694be4
BLAKE2b-256 checksum
How to use checksums
7175435b4e035cfc3b0026b109553dccbc4ff9c42ec015ce4ed3e5c10d08745f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 8, 2026.

Transparency log

Release files / rlmodule-0.2.0-py3-none-any.whl

Download URL rlmodule-0.2.0-py3-none-any.whl
Size 79.5 kB
Tags Python 3
SHA-256 checksum
How to use checksums
58d216ffd0f647be3dd1bd84335ddef702b61ed3c6d8fa00458544c12b318b5c
BLAKE2b-256 checksum
How to use checksums
7ce093b957d736aac79556bf36ba5f0310bbe33574c53c44b335f97aff9e0b89
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 8, 2026.

Transparency log

Release history Release notifications | RSS feed

This release

0.2.0 This release

2 release files

0.1.7

2 release files

0.1.6

2 release files

0.1.5

2 release files

0.1.0

2 release files

0.0.5

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page