pymdps is a Python package for working with Markov Decision Processes (MDPs) and
Project description
Partially Observable Markov Decision Processes (POMDPs). It is meant to be fast, understandable, and easy to use.
Keywords: MDP,POMDP,Markov Decision Processes,AI,Reinforcement Learning Maintainer-email: Duncan Eddy <duncan.eddy@gmail.com> Requires-Python: >=3.9 Description-Content-Type: text/x-rst; charset=UTF-8 Project-URL: Documentation, https://duncaneddy.github.io/pymdps/ Project-URL: Repository, https://github.com/duncaneddy/pymdps Project-URL: Issues, https://github.com/duncaneddy/pymdps/pulls
Documentation: https://duncaneddy.github.io/pymdps
Rust Library Reference: https://docs.rs/crate/pymdps/latest
Source Code: https://github.com/duncaneddy/pymdps
PyMDPs
PyMDPs is a Python library for working with Markov Decision Processes (MDPs) and other related models like Partially Observable MDPs (POMDPs). It is designed to be easy to use and flexible, with a focus on providing a clean and intuitive API for defining and solving MDPs.
Features
Simple API: PyMDPs provides a simple and intuitive API for defining MDPs and solving them using a variety of algorithms.
Modular Design: PyMDPs is designed to be modular and extensible, making it easy to add new algorithms and features.
Well-Documented: PyMDPs comes with comprehensive documentation and examples to help you get started quickly.
Open Source: PyMDPs is open source and released under the MIT license, so you are free to use it for any purpose.
Getting Started
For an introduction to PyMDPs and a guide on how to get started, check out the [Getting Started](getting_started/index.md) page.
To quickly install PyMDPs, you can use pip:
pip install pymdps
The full documentation for PyMDPs is available at https://duncaneddy.github.io/pymdps. The documentation includes a detailed API reference, examples, and tutorials to help you get started.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distributions
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file pymdps-0.1.3.tar.gz.
File metadata
- Download URL: pymdps-0.1.3.tar.gz
- Upload date:
- Size: 7.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.0.1 CPython/3.12.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
129cc873159043e5adbe75e3e26eef1e180b4c6fd91504885c2ea64371bf72fa
|
|
| MD5 |
56fd386c4bebfebcba4ae45805d196eb
|
|
| BLAKE2b-256 |
dd321641e37b7294be9de607ad440029b1e81babf64508a2fe79a7f164312f6b
|
Provenance
The following attestation bundles were made for pymdps-0.1.3.tar.gz:
Publisher:
release.yml on duncaneddy/pymdps
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
pymdps-0.1.3.tar.gz -
Subject digest:
129cc873159043e5adbe75e3e26eef1e180b4c6fd91504885c2ea64371bf72fa - Sigstore transparency entry: 157785847
- Sigstore integration time:
-
Permalink:
duncaneddy/pymdps@9bb3ba2d3b51959d0f3b8244347218b6660578ef -
Branch / Tag:
refs/tags/0.1.3 - Owner: https://github.com/duncaneddy
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@9bb3ba2d3b51959d0f3b8244347218b6660578ef -
Trigger Event:
release
-
Statement type:
File details
Details for the file pymdps-0.1.3-cp313-cp313-manylinux_2_34_x86_64.whl.
File metadata
- Download URL: pymdps-0.1.3-cp313-cp313-manylinux_2_34_x86_64.whl
- Upload date:
- Size: 231.2 kB
- Tags: CPython 3.13, manylinux: glibc 2.34+ x86-64
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.0.1 CPython/3.12.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
8d417b3dc9343333bc21f7b7d501d4b2ee147eb6298516175b5ad8cf2f731677
|
|
| MD5 |
f712a7ddfd86b256ecd708ae65627a87
|
|
| BLAKE2b-256 |
c22440675f263654f5d7f5fd3a4b98287bd57c61a89b1f6567fe837b1f5d56ed
|
Provenance
The following attestation bundles were made for pymdps-0.1.3-cp313-cp313-manylinux_2_34_x86_64.whl:
Publisher:
release.yml on duncaneddy/pymdps
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
pymdps-0.1.3-cp313-cp313-manylinux_2_34_x86_64.whl -
Subject digest:
8d417b3dc9343333bc21f7b7d501d4b2ee147eb6298516175b5ad8cf2f731677 - Sigstore transparency entry: 157785862
- Sigstore integration time:
-
Permalink:
duncaneddy/pymdps@9bb3ba2d3b51959d0f3b8244347218b6660578ef -
Branch / Tag:
refs/tags/0.1.3 - Owner: https://github.com/duncaneddy
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@9bb3ba2d3b51959d0f3b8244347218b6660578ef -
Trigger Event:
release
-
Statement type:
File details
Details for the file pymdps-0.1.3-cp313-cp313-macosx_11_0_arm64.whl.
File metadata
- Download URL: pymdps-0.1.3-cp313-cp313-macosx_11_0_arm64.whl
- Upload date:
- Size: 206.1 kB
- Tags: CPython 3.13, macOS 11.0+ ARM64
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.0.1 CPython/3.12.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
03ed5f6d16b296918ef823e6eb4159295d4ee95841445e7e75fa43825b646a8c
|
|
| MD5 |
0f45f8c18cb88ce34131eb0653cbb6ba
|
|
| BLAKE2b-256 |
6fa6cec5093025c5d781d3b169b42a0a65c5df6745ae46f7578958ceaf534149
|
Provenance
The following attestation bundles were made for pymdps-0.1.3-cp313-cp313-macosx_11_0_arm64.whl:
Publisher:
release.yml on duncaneddy/pymdps
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
pymdps-0.1.3-cp313-cp313-macosx_11_0_arm64.whl -
Subject digest:
03ed5f6d16b296918ef823e6eb4159295d4ee95841445e7e75fa43825b646a8c - Sigstore transparency entry: 157785865
- Sigstore integration time:
-
Permalink:
duncaneddy/pymdps@9bb3ba2d3b51959d0f3b8244347218b6660578ef -
Branch / Tag:
refs/tags/0.1.3 - Owner: https://github.com/duncaneddy
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@9bb3ba2d3b51959d0f3b8244347218b6660578ef -
Trigger Event:
release
-
Statement type:
File details
Details for the file pymdps-0.1.3-cp312-cp312-manylinux_2_34_x86_64.whl.
File metadata
- Download URL: pymdps-0.1.3-cp312-cp312-manylinux_2_34_x86_64.whl
- Upload date:
- Size: 231.2 kB
- Tags: CPython 3.12, manylinux: glibc 2.34+ x86-64
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.0.1 CPython/3.12.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
59fea8ae81d34c7f3fd9a94e98494ec1af412c2e3d737577d4947047b59a0641
|
|
| MD5 |
7a7dace2c3b8a7b48b94688f8e608a9f
|
|
| BLAKE2b-256 |
8c371d32e13070fcf0a03c30868f66ef7fec42e55dd7b4de0a2d4f30f1b6b128
|
Provenance
The following attestation bundles were made for pymdps-0.1.3-cp312-cp312-manylinux_2_34_x86_64.whl:
Publisher:
release.yml on duncaneddy/pymdps
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
pymdps-0.1.3-cp312-cp312-manylinux_2_34_x86_64.whl -
Subject digest:
59fea8ae81d34c7f3fd9a94e98494ec1af412c2e3d737577d4947047b59a0641 - Sigstore transparency entry: 157785860
- Sigstore integration time:
-
Permalink:
duncaneddy/pymdps@9bb3ba2d3b51959d0f3b8244347218b6660578ef -
Branch / Tag:
refs/tags/0.1.3 - Owner: https://github.com/duncaneddy
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@9bb3ba2d3b51959d0f3b8244347218b6660578ef -
Trigger Event:
release
-
Statement type:
File details
Details for the file pymdps-0.1.3-cp312-cp312-macosx_11_0_arm64.whl.
File metadata
- Download URL: pymdps-0.1.3-cp312-cp312-macosx_11_0_arm64.whl
- Upload date:
- Size: 206.1 kB
- Tags: CPython 3.12, macOS 11.0+ ARM64
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.0.1 CPython/3.12.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
09f3bd30940ffa8d5d0baffbbf65979ebf33d949756621243dfff8af248b74ae
|
|
| MD5 |
31bb65b465d2472b8973fe97ec731855
|
|
| BLAKE2b-256 |
205b4df9f70466170de120c06bf0612a2855643e6af65ae79bbed3639293248b
|
Provenance
The following attestation bundles were made for pymdps-0.1.3-cp312-cp312-macosx_11_0_arm64.whl:
Publisher:
release.yml on duncaneddy/pymdps
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
pymdps-0.1.3-cp312-cp312-macosx_11_0_arm64.whl -
Subject digest:
09f3bd30940ffa8d5d0baffbbf65979ebf33d949756621243dfff8af248b74ae - Sigstore transparency entry: 157785850
- Sigstore integration time:
-
Permalink:
duncaneddy/pymdps@9bb3ba2d3b51959d0f3b8244347218b6660578ef -
Branch / Tag:
refs/tags/0.1.3 - Owner: https://github.com/duncaneddy
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@9bb3ba2d3b51959d0f3b8244347218b6660578ef -
Trigger Event:
release
-
Statement type:
File details
Details for the file pymdps-0.1.3-cp311-cp311-manylinux_2_34_x86_64.whl.
File metadata
- Download URL: pymdps-0.1.3-cp311-cp311-manylinux_2_34_x86_64.whl
- Upload date:
- Size: 233.2 kB
- Tags: CPython 3.11, manylinux: glibc 2.34+ x86-64
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.0.1 CPython/3.12.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
77678085741d1147039775ab1ffb75554797aee190e8d4863181a5b4cabc96cc
|
|
| MD5 |
92da50c54867da796a0423b07c8f3ba9
|
|
| BLAKE2b-256 |
d7d4334b2c5fb7ae9c65859b49a2ccaf576c6bb1893d2fdfd4b00e3c77ce585e
|
Provenance
The following attestation bundles were made for pymdps-0.1.3-cp311-cp311-manylinux_2_34_x86_64.whl:
Publisher:
release.yml on duncaneddy/pymdps
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
pymdps-0.1.3-cp311-cp311-manylinux_2_34_x86_64.whl -
Subject digest:
77678085741d1147039775ab1ffb75554797aee190e8d4863181a5b4cabc96cc - Sigstore transparency entry: 157785863
- Sigstore integration time:
-
Permalink:
duncaneddy/pymdps@9bb3ba2d3b51959d0f3b8244347218b6660578ef -
Branch / Tag:
refs/tags/0.1.3 - Owner: https://github.com/duncaneddy
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@9bb3ba2d3b51959d0f3b8244347218b6660578ef -
Trigger Event:
release
-
Statement type:
File details
Details for the file pymdps-0.1.3-cp311-cp311-macosx_11_0_arm64.whl.
File metadata
- Download URL: pymdps-0.1.3-cp311-cp311-macosx_11_0_arm64.whl
- Upload date:
- Size: 207.5 kB
- Tags: CPython 3.11, macOS 11.0+ ARM64
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.0.1 CPython/3.12.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
23bc2f94d672a8e28f3359c987dd15ae37cc6f232b23da61e8d6b581a226f876
|
|
| MD5 |
a0080aecd389f6baf68f6819d889cb34
|
|
| BLAKE2b-256 |
a811047a0285ab1e2e9c36cc79ac61b7b8a5024532020aa6394b7b4708d6d88b
|
Provenance
The following attestation bundles were made for pymdps-0.1.3-cp311-cp311-macosx_11_0_arm64.whl:
Publisher:
release.yml on duncaneddy/pymdps
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
pymdps-0.1.3-cp311-cp311-macosx_11_0_arm64.whl -
Subject digest:
23bc2f94d672a8e28f3359c987dd15ae37cc6f232b23da61e8d6b581a226f876 - Sigstore transparency entry: 157785858
- Sigstore integration time:
-
Permalink:
duncaneddy/pymdps@9bb3ba2d3b51959d0f3b8244347218b6660578ef -
Branch / Tag:
refs/tags/0.1.3 - Owner: https://github.com/duncaneddy
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@9bb3ba2d3b51959d0f3b8244347218b6660578ef -
Trigger Event:
release
-
Statement type:
File details
Details for the file pymdps-0.1.3-cp310-cp310-manylinux_2_34_x86_64.whl.
File metadata
- Download URL: pymdps-0.1.3-cp310-cp310-manylinux_2_34_x86_64.whl
- Upload date:
- Size: 233.5 kB
- Tags: CPython 3.10, manylinux: glibc 2.34+ x86-64
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.0.1 CPython/3.12.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
27c82d87e95ccf70b97ef9d281ed44c193d92ce32d41427386a0b925809e472a
|
|
| MD5 |
871a497557dcdaed542e1998e553ce68
|
|
| BLAKE2b-256 |
5d77d73d4492f475d4105cdfffcf5ad0eed9e050816392683c10b4a4cb1570c8
|
Provenance
The following attestation bundles were made for pymdps-0.1.3-cp310-cp310-manylinux_2_34_x86_64.whl:
Publisher:
release.yml on duncaneddy/pymdps
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
pymdps-0.1.3-cp310-cp310-manylinux_2_34_x86_64.whl -
Subject digest:
27c82d87e95ccf70b97ef9d281ed44c193d92ce32d41427386a0b925809e472a - Sigstore transparency entry: 157785857
- Sigstore integration time:
-
Permalink:
duncaneddy/pymdps@9bb3ba2d3b51959d0f3b8244347218b6660578ef -
Branch / Tag:
refs/tags/0.1.3 - Owner: https://github.com/duncaneddy
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@9bb3ba2d3b51959d0f3b8244347218b6660578ef -
Trigger Event:
release
-
Statement type:
File details
Details for the file pymdps-0.1.3-cp310-cp310-macosx_11_0_arm64.whl.
File metadata
- Download URL: pymdps-0.1.3-cp310-cp310-macosx_11_0_arm64.whl
- Upload date:
- Size: 207.9 kB
- Tags: CPython 3.10, macOS 11.0+ ARM64
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.0.1 CPython/3.12.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c61d6bed9da01d8e9e574dd42b4f078835dbdecfed2ecb4480e6b910f81f6b9d
|
|
| MD5 |
e9d0a8868252ee3694eac8a67499c4eb
|
|
| BLAKE2b-256 |
6d46b208aea876a910855fcc3eec485065fe0ea30f4fcb6e8d0146ffedd2f6a8
|
Provenance
The following attestation bundles were made for pymdps-0.1.3-cp310-cp310-macosx_11_0_arm64.whl:
Publisher:
release.yml on duncaneddy/pymdps
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
pymdps-0.1.3-cp310-cp310-macosx_11_0_arm64.whl -
Subject digest:
c61d6bed9da01d8e9e574dd42b4f078835dbdecfed2ecb4480e6b910f81f6b9d - Sigstore transparency entry: 157785853
- Sigstore integration time:
-
Permalink:
duncaneddy/pymdps@9bb3ba2d3b51959d0f3b8244347218b6660578ef -
Branch / Tag:
refs/tags/0.1.3 - Owner: https://github.com/duncaneddy
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@9bb3ba2d3b51959d0f3b8244347218b6660578ef -
Trigger Event:
release
-
Statement type:
File details
Details for the file pymdps-0.1.3-cp39-cp39-manylinux_2_34_x86_64.whl.
File metadata
- Download URL: pymdps-0.1.3-cp39-cp39-manylinux_2_34_x86_64.whl
- Upload date:
- Size: 233.8 kB
- Tags: CPython 3.9, manylinux: glibc 2.34+ x86-64
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.0.1 CPython/3.12.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
32c7996dd662f0f03292b5475fc42f1fc4758876a9561215484b65b6c1b45589
|
|
| MD5 |
ca7a34046149a3a9dc38d9efd74b3485
|
|
| BLAKE2b-256 |
efa95f1fc275453259e991300f55c6b06e591846160f70bced43a03004f8d069
|
Provenance
The following attestation bundles were made for pymdps-0.1.3-cp39-cp39-manylinux_2_34_x86_64.whl:
Publisher:
release.yml on duncaneddy/pymdps
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
pymdps-0.1.3-cp39-cp39-manylinux_2_34_x86_64.whl -
Subject digest:
32c7996dd662f0f03292b5475fc42f1fc4758876a9561215484b65b6c1b45589 - Sigstore transparency entry: 157785855
- Sigstore integration time:
-
Permalink:
duncaneddy/pymdps@9bb3ba2d3b51959d0f3b8244347218b6660578ef -
Branch / Tag:
refs/tags/0.1.3 - Owner: https://github.com/duncaneddy
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@9bb3ba2d3b51959d0f3b8244347218b6660578ef -
Trigger Event:
release
-
Statement type:
File details
Details for the file pymdps-0.1.3-cp39-cp39-macosx_11_0_arm64.whl.
File metadata
- Download URL: pymdps-0.1.3-cp39-cp39-macosx_11_0_arm64.whl
- Upload date:
- Size: 208.2 kB
- Tags: CPython 3.9, macOS 11.0+ ARM64
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.0.1 CPython/3.12.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c077cf0f51fe8d8d7ccda744fd16804e12a6145598281ca38cdd8ed96d387078
|
|
| MD5 |
b0096be0ccebccb18f85c2ebb15a4393
|
|
| BLAKE2b-256 |
89e4aff036292245f759ca1a5f1d8bf5b46ba3b92dea320c982dd1128ebad262
|
Provenance
The following attestation bundles were made for pymdps-0.1.3-cp39-cp39-macosx_11_0_arm64.whl:
Publisher:
release.yml on duncaneddy/pymdps
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
pymdps-0.1.3-cp39-cp39-macosx_11_0_arm64.whl -
Subject digest:
c077cf0f51fe8d8d7ccda744fd16804e12a6145598281ca38cdd8ed96d387078 - Sigstore transparency entry: 157785856
- Sigstore integration time:
-
Permalink:
duncaneddy/pymdps@9bb3ba2d3b51959d0f3b8244347218b6660578ef -
Branch / Tag:
refs/tags/0.1.3 - Owner: https://github.com/duncaneddy
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yml@9bb3ba2d3b51959d0f3b8244347218b6660578ef -
Trigger Event:
release
-
Statement type: