pymdps

Partially Observable Markov Decision Processes (POMDPs). It is meant to be fast, understandable, and easy to use.

Keywords: MDP,POMDP,Markov Decision Processes,AI,Reinforcement Learning Maintainer-email: Duncan Eddy <duncan.eddy@gmail.com> Requires-Python: >=3.9 Description-Content-Type: text/x-rst; charset=UTF-8 Project-URL: Documentation, https://duncaneddy.github.io/pymdps/ Project-URL: Repository, https://github.com/duncaneddy/pymdps Project-URL: Issues, https://github.com/duncaneddy/pymdps/pulls

Documentation: https://duncaneddy.github.io/pymdps

Rust Library Reference: https://docs.rs/crate/pymdps/latest

Source Code: https://github.com/duncaneddy/pymdps

PyMDPs

PyMDPs is a Python library for working with Markov Decision Processes (MDPs) and other related models like Partially Observable MDPs (POMDPs). It is designed to be easy to use and flexible, with a focus on providing a clean and intuitive API for defining and solving MDPs.

Features

Simple API: PyMDPs provides a simple and intuitive API for defining MDPs and solving them using a variety of algorithms.
Modular Design: PyMDPs is designed to be modular and extensible, making it easy to add new algorithms and features.
Well-Documented: PyMDPs comes with comprehensive documentation and examples to help you get started quickly.
Open Source: PyMDPs is open source and released under the MIT license, so you are free to use it for any purpose.

Getting Started

For an introduction to PyMDPs and a guide on how to get started, check out the [Getting Started](getting_started/index.md) page.

To quickly install PyMDPs, you can use pip:

pip install pymdps

The full documentation for PyMDPs is available at https://duncaneddy.github.io/pymdps. The documentation includes a detailed API reference, examples, and tutorials to help you get started.

Metadata

Release files for pymdps 0.1.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pymdps 0.1.3
File	Size	Uploaded
pymdps-0.1.3.tar.gz	7.8 kB	Dec 27, 2024	Details

Built distributions (wheels)

Table of built distributions (wheels) for pymdps 0.1.3
File	Interpreter	ABI	Platform	Reset
pymdps-0.1.3-cp313-cp313-manylinux_2_34_x86_64.whl 231.2 kB Dec 27, 2024	CPython 3.13	CPython 3.13	Linux glibc 2.34+ x86-64	Details
pymdps-0.1.3-cp313-cp313-macosx_11_0_arm64.whl 206.1 kB Dec 27, 2024	CPython 3.13	CPython 3.13	macOS 11.0+ ARM64	Details
pymdps-0.1.3-cp312-cp312-manylinux_2_34_x86_64.whl 231.2 kB Dec 27, 2024	CPython 3.12	CPython 3.12	Linux glibc 2.34+ x86-64	Details
pymdps-0.1.3-cp312-cp312-macosx_11_0_arm64.whl 206.1 kB Dec 27, 2024	CPython 3.12	CPython 3.12	macOS 11.0+ ARM64	Details
pymdps-0.1.3-cp311-cp311-manylinux_2_34_x86_64.whl 233.2 kB Dec 27, 2024	CPython 3.11	CPython 3.11	Linux glibc 2.34+ x86-64	Details
pymdps-0.1.3-cp311-cp311-macosx_11_0_arm64.whl 207.5 kB Dec 27, 2024	CPython 3.11	CPython 3.11	macOS 11.0+ ARM64	Details
pymdps-0.1.3-cp310-cp310-manylinux_2_34_x86_64.whl 233.5 kB Dec 27, 2024	CPython 3.10	CPython 3.10	Linux glibc 2.34+ x86-64	Details
pymdps-0.1.3-cp310-cp310-macosx_11_0_arm64.whl 207.9 kB Dec 27, 2024	CPython 3.10	CPython 3.10	macOS 11.0+ ARM64	Details
pymdps-0.1.3-cp39-cp39-manylinux_2_34_x86_64.whl 233.8 kB Dec 27, 2024	CPython 3.9	CPython 3.9	Linux glibc 2.34+ x86-64	Details
pymdps-0.1.3-cp39-cp39-macosx_11_0_arm64.whl 208.2 kB Dec 27, 2024	CPython 3.9	CPython 3.9	macOS 11.0+ ARM64	Details

Total release size: 2.2 MB

Release files / pymdps-0.1.3.tar.gz

Download URL	pymdps-0.1.3.tar.gz
Size	7.8 kB
Tags	Source
SHA-256 checksum How to use checksums	`129cc873159043e5adbe75e3e26eef1e180b4c6fd91504885c2ea64371bf72fa`
BLAKE2b-256 checksum How to use checksums	`dd321641e37b7294be9de607ad440029b1e81babf64508a2fe79a7f164312f6b`
Upload date	Dec 27, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`twine/6.0.1 CPython/3.12.8`

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Identity

Publishing platform: GitHub Actions
Publishing repository: github.com/duncaneddy/pymdps
Publishing commit: github.com/duncaneddy/pymdps/tree/9bb3ba2d3b51959d0f3b8244347218b6660578ef

Workflow

Publishing configuration: github.com/duncaneddy/pymdps/blob/9bb3ba2d3b51959d0f3b8244347218b6660578ef/.github/workflows/release.yml
Publishing logs: github.com/duncaneddy/pymdps/actions/runs/12510768719/attempts/1

Artifact

Subject: pymdps-0.1.3.tar.gz
SHA-256 checksum: 129cc873159043e5adbe75e3e26eef1e180b4c6fd91504885c2ea64371bf72fa Verifying attestations

Release files / pymdps-0.1.3-cp313-cp313-manylinux_2_34_x86_64.whl

Download URL	pymdps-0.1.3-cp313-cp313-manylinux_2_34_x86_64.whl
Size	231.2 kB
Tags	CPython 3.13 Linux glibc 2.34+ x86-64
SHA-256 checksum How to use checksums	`8d417b3dc9343333bc21f7b7d501d4b2ee147eb6298516175b5ad8cf2f731677`
BLAKE2b-256 checksum How to use checksums	`c22440675f263654f5d7f5fd3a4b98287bd57c61a89b1f6567fe837b1f5d56ed`
Upload date	Dec 27, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`twine/6.0.1 CPython/3.12.8`

Provenance

Identity

Publishing platform: GitHub Actions
Publishing repository: github.com/duncaneddy/pymdps
Publishing commit: github.com/duncaneddy/pymdps/tree/9bb3ba2d3b51959d0f3b8244347218b6660578ef

Workflow

Publishing configuration: github.com/duncaneddy/pymdps/blob/9bb3ba2d3b51959d0f3b8244347218b6660578ef/.github/workflows/release.yml
Publishing logs: github.com/duncaneddy/pymdps/actions/runs/12510768719/attempts/1

Artifact

Subject: pymdps-0.1.3-cp313-cp313-manylinux_2_34_x86_64.whl
SHA-256 checksum: 8d417b3dc9343333bc21f7b7d501d4b2ee147eb6298516175b5ad8cf2f731677 Verifying attestations

Release files / pymdps-0.1.3-cp313-cp313-macosx_11_0_arm64.whl

Download URL	pymdps-0.1.3-cp313-cp313-macosx_11_0_arm64.whl
Size	206.1 kB
Tags	CPython 3.13 macOS 11.0+ ARM64
SHA-256 checksum How to use checksums	`03ed5f6d16b296918ef823e6eb4159295d4ee95841445e7e75fa43825b646a8c`
BLAKE2b-256 checksum How to use checksums	`6fa6cec5093025c5d781d3b169b42a0a65c5df6745ae46f7578958ceaf534149`
Upload date	Dec 27, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`twine/6.0.1 CPython/3.12.8`

Provenance

Identity

Publishing platform: GitHub Actions
Publishing repository: github.com/duncaneddy/pymdps
Publishing commit: github.com/duncaneddy/pymdps/tree/9bb3ba2d3b51959d0f3b8244347218b6660578ef

Workflow

Publishing configuration: github.com/duncaneddy/pymdps/blob/9bb3ba2d3b51959d0f3b8244347218b6660578ef/.github/workflows/release.yml
Publishing logs: github.com/duncaneddy/pymdps/actions/runs/12510768719/attempts/1

Artifact

Subject: pymdps-0.1.3-cp313-cp313-macosx_11_0_arm64.whl
SHA-256 checksum: 03ed5f6d16b296918ef823e6eb4159295d4ee95841445e7e75fa43825b646a8c Verifying attestations

Release files / pymdps-0.1.3-cp312-cp312-manylinux_2_34_x86_64.whl

Download URL	pymdps-0.1.3-cp312-cp312-manylinux_2_34_x86_64.whl
Size	231.2 kB
Tags	CPython 3.12 Linux glibc 2.34+ x86-64
SHA-256 checksum How to use checksums	`59fea8ae81d34c7f3fd9a94e98494ec1af412c2e3d737577d4947047b59a0641`
BLAKE2b-256 checksum How to use checksums	`8c371d32e13070fcf0a03c30868f66ef7fec42e55dd7b4de0a2d4f30f1b6b128`
Upload date	Dec 27, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`twine/6.0.1 CPython/3.12.8`

Provenance

Identity

Publishing platform: GitHub Actions
Publishing repository: github.com/duncaneddy/pymdps
Publishing commit: github.com/duncaneddy/pymdps/tree/9bb3ba2d3b51959d0f3b8244347218b6660578ef

Workflow

Publishing configuration: github.com/duncaneddy/pymdps/blob/9bb3ba2d3b51959d0f3b8244347218b6660578ef/.github/workflows/release.yml
Publishing logs: github.com/duncaneddy/pymdps/actions/runs/12510768719/attempts/1

Artifact

Subject: pymdps-0.1.3-cp312-cp312-manylinux_2_34_x86_64.whl
SHA-256 checksum: 59fea8ae81d34c7f3fd9a94e98494ec1af412c2e3d737577d4947047b59a0641 Verifying attestations

Release files / pymdps-0.1.3-cp312-cp312-macosx_11_0_arm64.whl

Download URL	pymdps-0.1.3-cp312-cp312-macosx_11_0_arm64.whl
Size	206.1 kB
Tags	CPython 3.12 macOS 11.0+ ARM64
SHA-256 checksum How to use checksums	`09f3bd30940ffa8d5d0baffbbf65979ebf33d949756621243dfff8af248b74ae`
BLAKE2b-256 checksum How to use checksums	`205b4df9f70466170de120c06bf0612a2855643e6af65ae79bbed3639293248b`
Upload date	Dec 27, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`twine/6.0.1 CPython/3.12.8`

Provenance

Identity

Publishing platform: GitHub Actions
Publishing repository: github.com/duncaneddy/pymdps
Publishing commit: github.com/duncaneddy/pymdps/tree/9bb3ba2d3b51959d0f3b8244347218b6660578ef

Workflow

Publishing configuration: github.com/duncaneddy/pymdps/blob/9bb3ba2d3b51959d0f3b8244347218b6660578ef/.github/workflows/release.yml
Publishing logs: github.com/duncaneddy/pymdps/actions/runs/12510768719/attempts/1

Artifact

Subject: pymdps-0.1.3-cp312-cp312-macosx_11_0_arm64.whl
SHA-256 checksum: 09f3bd30940ffa8d5d0baffbbf65979ebf33d949756621243dfff8af248b74ae Verifying attestations

Release files / pymdps-0.1.3-cp311-cp311-manylinux_2_34_x86_64.whl

Download URL	pymdps-0.1.3-cp311-cp311-manylinux_2_34_x86_64.whl
Size	233.2 kB
Tags	CPython 3.11 Linux glibc 2.34+ x86-64
SHA-256 checksum How to use checksums	`77678085741d1147039775ab1ffb75554797aee190e8d4863181a5b4cabc96cc`
BLAKE2b-256 checksum How to use checksums	`d7d4334b2c5fb7ae9c65859b49a2ccaf576c6bb1893d2fdfd4b00e3c77ce585e`
Upload date	Dec 27, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`twine/6.0.1 CPython/3.12.8`

Provenance

Identity

Publishing platform: GitHub Actions
Publishing repository: github.com/duncaneddy/pymdps
Publishing commit: github.com/duncaneddy/pymdps/tree/9bb3ba2d3b51959d0f3b8244347218b6660578ef

Workflow

Publishing configuration: github.com/duncaneddy/pymdps/blob/9bb3ba2d3b51959d0f3b8244347218b6660578ef/.github/workflows/release.yml
Publishing logs: github.com/duncaneddy/pymdps/actions/runs/12510768719/attempts/1

Artifact

Subject: pymdps-0.1.3-cp311-cp311-manylinux_2_34_x86_64.whl
SHA-256 checksum: 77678085741d1147039775ab1ffb75554797aee190e8d4863181a5b4cabc96cc Verifying attestations

Release files / pymdps-0.1.3-cp311-cp311-macosx_11_0_arm64.whl

Download URL	pymdps-0.1.3-cp311-cp311-macosx_11_0_arm64.whl
Size	207.5 kB
Tags	CPython 3.11 macOS 11.0+ ARM64
SHA-256 checksum How to use checksums	`23bc2f94d672a8e28f3359c987dd15ae37cc6f232b23da61e8d6b581a226f876`
BLAKE2b-256 checksum How to use checksums	`a811047a0285ab1e2e9c36cc79ac61b7b8a5024532020aa6394b7b4708d6d88b`
Upload date	Dec 27, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`twine/6.0.1 CPython/3.12.8`

Provenance

Identity

Publishing platform: GitHub Actions
Publishing repository: github.com/duncaneddy/pymdps
Publishing commit: github.com/duncaneddy/pymdps/tree/9bb3ba2d3b51959d0f3b8244347218b6660578ef

Workflow

Publishing configuration: github.com/duncaneddy/pymdps/blob/9bb3ba2d3b51959d0f3b8244347218b6660578ef/.github/workflows/release.yml
Publishing logs: github.com/duncaneddy/pymdps/actions/runs/12510768719/attempts/1

Artifact

Subject: pymdps-0.1.3-cp311-cp311-macosx_11_0_arm64.whl
SHA-256 checksum: 23bc2f94d672a8e28f3359c987dd15ae37cc6f232b23da61e8d6b581a226f876 Verifying attestations

Release files / pymdps-0.1.3-cp310-cp310-manylinux_2_34_x86_64.whl

Download URL	pymdps-0.1.3-cp310-cp310-manylinux_2_34_x86_64.whl
Size	233.5 kB
Tags	CPython 3.10 Linux glibc 2.34+ x86-64
SHA-256 checksum How to use checksums	`27c82d87e95ccf70b97ef9d281ed44c193d92ce32d41427386a0b925809e472a`
BLAKE2b-256 checksum How to use checksums	`5d77d73d4492f475d4105cdfffcf5ad0eed9e050816392683c10b4a4cb1570c8`
Upload date	Dec 27, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`twine/6.0.1 CPython/3.12.8`

Provenance

Identity

Publishing platform: GitHub Actions
Publishing repository: github.com/duncaneddy/pymdps
Publishing commit: github.com/duncaneddy/pymdps/tree/9bb3ba2d3b51959d0f3b8244347218b6660578ef

Workflow

Publishing configuration: github.com/duncaneddy/pymdps/blob/9bb3ba2d3b51959d0f3b8244347218b6660578ef/.github/workflows/release.yml
Publishing logs: github.com/duncaneddy/pymdps/actions/runs/12510768719/attempts/1

Artifact

Subject: pymdps-0.1.3-cp310-cp310-manylinux_2_34_x86_64.whl
SHA-256 checksum: 27c82d87e95ccf70b97ef9d281ed44c193d92ce32d41427386a0b925809e472a Verifying attestations

Release files / pymdps-0.1.3-cp310-cp310-macosx_11_0_arm64.whl

Download URL	pymdps-0.1.3-cp310-cp310-macosx_11_0_arm64.whl
Size	207.9 kB
Tags	CPython 3.10 macOS 11.0+ ARM64
SHA-256 checksum How to use checksums	`c61d6bed9da01d8e9e574dd42b4f078835dbdecfed2ecb4480e6b910f81f6b9d`
BLAKE2b-256 checksum How to use checksums	`6d46b208aea876a910855fcc3eec485065fe0ea30f4fcb6e8d0146ffedd2f6a8`
Upload date	Dec 27, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`twine/6.0.1 CPython/3.12.8`

Provenance

Identity

Publishing platform: GitHub Actions
Publishing repository: github.com/duncaneddy/pymdps
Publishing commit: github.com/duncaneddy/pymdps/tree/9bb3ba2d3b51959d0f3b8244347218b6660578ef

Workflow

Publishing configuration: github.com/duncaneddy/pymdps/blob/9bb3ba2d3b51959d0f3b8244347218b6660578ef/.github/workflows/release.yml
Publishing logs: github.com/duncaneddy/pymdps/actions/runs/12510768719/attempts/1

Artifact

Subject: pymdps-0.1.3-cp310-cp310-macosx_11_0_arm64.whl
SHA-256 checksum: c61d6bed9da01d8e9e574dd42b4f078835dbdecfed2ecb4480e6b910f81f6b9d Verifying attestations

Release files / pymdps-0.1.3-cp39-cp39-manylinux_2_34_x86_64.whl

Download URL	pymdps-0.1.3-cp39-cp39-manylinux_2_34_x86_64.whl
Size	233.8 kB
Tags	CPython 3.9 Linux glibc 2.34+ x86-64
SHA-256 checksum How to use checksums	`32c7996dd662f0f03292b5475fc42f1fc4758876a9561215484b65b6c1b45589`
BLAKE2b-256 checksum How to use checksums	`efa95f1fc275453259e991300f55c6b06e591846160f70bced43a03004f8d069`
Upload date	Dec 27, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`twine/6.0.1 CPython/3.12.8`

Provenance

Identity

Publishing platform: GitHub Actions
Publishing repository: github.com/duncaneddy/pymdps
Publishing commit: github.com/duncaneddy/pymdps/tree/9bb3ba2d3b51959d0f3b8244347218b6660578ef

Workflow

Publishing configuration: github.com/duncaneddy/pymdps/blob/9bb3ba2d3b51959d0f3b8244347218b6660578ef/.github/workflows/release.yml
Publishing logs: github.com/duncaneddy/pymdps/actions/runs/12510768719/attempts/1

Artifact

Subject: pymdps-0.1.3-cp39-cp39-manylinux_2_34_x86_64.whl
SHA-256 checksum: 32c7996dd662f0f03292b5475fc42f1fc4758876a9561215484b65b6c1b45589 Verifying attestations

Release files / pymdps-0.1.3-cp39-cp39-macosx_11_0_arm64.whl

Download URL	pymdps-0.1.3-cp39-cp39-macosx_11_0_arm64.whl
Size	208.2 kB
Tags	CPython 3.9 macOS 11.0+ ARM64
SHA-256 checksum How to use checksums	`c077cf0f51fe8d8d7ccda744fd16804e12a6145598281ca38cdd8ed96d387078`
BLAKE2b-256 checksum How to use checksums	`89e4aff036292245f759ca1a5f1d8bf5b46ba3b92dea320c982dd1128ebad262`
Upload date	Dec 27, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`twine/6.0.1 CPython/3.12.8`

Provenance

Identity

Publishing platform: GitHub Actions
Publishing repository: github.com/duncaneddy/pymdps
Publishing commit: github.com/duncaneddy/pymdps/tree/9bb3ba2d3b51959d0f3b8244347218b6660578ef

Workflow

Publishing configuration: github.com/duncaneddy/pymdps/blob/9bb3ba2d3b51959d0f3b8244347218b6660578ef/.github/workflows/release.yml
Publishing logs: github.com/duncaneddy/pymdps/actions/runs/12510768719/attempts/1

Artifact

Subject: pymdps-0.1.3-cp39-cp39-macosx_11_0_arm64.whl
SHA-256 checksum: c077cf0f51fe8d8d7ccda744fd16804e12a6145598281ca38cdd8ed96d387078 Verifying attestations

Release history Release notifications | RSS feed

This release

0.1.3 This release

Dec 27, 2024 11 release files

0.1.1

Dec 27, 2024 11 release files

0.1.0

Dec 27, 2024 5 release files

pymdps 0.1.3

PyMDPs

Features

Getting Started

Key dates

1 maintainer

License

Provides Extra

Classifiers

Metadata

Key dates

1 maintainer

License

Provides Extra

Classifiers

Release files for pymdps 0.1.3

Source distribution (sdist)

Built distributions (wheels)

Release files / pymdps-0.1.3.tar.gz

Provenance

PyPI Publish Attestation

Identity

Workflow

Artifact

Release files / pymdps-0.1.3-cp313-cp313-manylinux_2_34_x86_64.whl

Provenance

PyPI Publish Attestation

Identity

Workflow

Artifact

Release files / pymdps-0.1.3-cp313-cp313-macosx_11_0_arm64.whl

Provenance

PyPI Publish Attestation

Identity

Workflow

Artifact

Release files / pymdps-0.1.3-cp312-cp312-manylinux_2_34_x86_64.whl

Provenance

PyPI Publish Attestation

Identity

Workflow

Artifact

Release files / pymdps-0.1.3-cp312-cp312-macosx_11_0_arm64.whl

Provenance

PyPI Publish Attestation

Identity

Workflow

Artifact

Release files / pymdps-0.1.3-cp311-cp311-manylinux_2_34_x86_64.whl

Provenance

PyPI Publish Attestation

Identity

Workflow

Artifact

Release files / pymdps-0.1.3-cp311-cp311-macosx_11_0_arm64.whl

Provenance

PyPI Publish Attestation

Identity

Workflow

Artifact

Release files / pymdps-0.1.3-cp310-cp310-manylinux_2_34_x86_64.whl

Provenance

PyPI Publish Attestation

Identity

Workflow

Artifact

Release files / pymdps-0.1.3-cp310-cp310-macosx_11_0_arm64.whl

Provenance

PyPI Publish Attestation

Identity

Workflow

Artifact

Release files / pymdps-0.1.3-cp39-cp39-manylinux_2_34_x86_64.whl

Provenance

PyPI Publish Attestation

Identity

Workflow

Artifact

Release files / pymdps-0.1.3-cp39-cp39-macosx_11_0_arm64.whl

Provenance