Skip to main content

A lightweight library for defining navigation grid world

Project description

Navigation MDP

A bare-bones Python3 interface for specifying navigation mdp. Designed to provide more natural syntax to specify MDP while also providing some extensibility required for experimentation.

Markov Decision Process (MDP)

MDP is defined by states S, dynamics T, actions A, and rewards R. The design philosophy of this library is that each entity in the MDP is a separate object. State is the central entity. Everything else is optional, and can be defined and attached to the states as per the need.


To install current release with pip:

pip install navigation-mdp

To install from source:

python install


If you're curious what it can do:

1. View examples in the notebook

Navigation MDP

2. Play with it on Google Colab

Open In Colab

3. Play with it on MyBinder



For visualizations:


  • Thanks to Michael Littman, Lucas Lehnert, and David Abel for all the discussions which were very helpful in developing concepts.
  • State class is inspired from David Abel's Simple RL framework:

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for navigation-mdp, version 0.9
Filename, size File type Python version Upload date Hashes
Filename, size navigation_mdp-0.9-py3-none-any.whl (17.3 kB) File type Wheel Python version py3 Upload date Hashes View
Filename, size navigation_mdp-0.9.tar.gz (11.3 kB) File type Source Python version None Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring DigiCert DigiCert EV certificate Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page