Skip to main content

An easy-to-use reinforcement learning library for research and education

Project description

A Reinforcement Learning Library for Research and Education

pytest Documentation Status contributors Codacy codecov

Try it on Google Colab! Open In Colab


What is rlberry?

Writing reinforcement learning algorithms is fun! But after the fun, we have lots of boring things to implement: run our agents in parallel, average and plot results, optimize hyperparameters, compare to baselines, create tricky environments etc etc!

rlberry is a Python library that makes your life easier by doing all these things with a few lines of code, so that you can spend most of your time developing agents. rlberry also provides implementations of several RL agents, benchmark environments and many other useful tools.

Check our getting started section!

Getting started

In our documentation, you will find a quick tutorial to the library and instructions about how to install it.

Also, we provide a handful of notebooks on Google colab as examples to show you how to use rlberry:

Content Description Link
Introduction to rlberry How to create an agent, optimize its hyperparameters and compare to a baseline. Open In Colab
Evaluating and optimizing agents Train a REINFORCE agent and optimize its hyperparameters Open In Colab

Citing rlberry

If you use rlberry in scientific publications, we would appreciate citations using the following Bibtex entry:

@misc{rlberry,
    author = {Domingues, Omar Darwiche and Flet-Berliac, Yannis and Leurent, Edouard and M{\'e}nard, Pierre and Shang, Xuedong and Valko, Michal},
    doi = {10.5281/zenodo.5544540},
    month = {10},
    title = {{rlberry - A Reinforcement Learning Library for Research and Education}},
    url = {https://github.com/rlberry-py/rlberry},
    year = {2021}
}

Development notes

The modules listed below are experimental at the moment, that is, they are not thoroughly tested and are susceptible to evolve.

  • rlberry.network: Allows communication between between a server and client via sockets, and can be used to run agents remotely.

  • rlberry.agents.torch, rlberry.agents.jax, rlberry.exploration_tools.torch: Deep RL agents are currently not stable, and their main purpose now is to illustrate how to implement and run those algorithms with the rlberry interface (e.g., run several agents in parallel, optimize hyperparameters etc.). Other libraries, such as Stable Baselines provide reliable implementations of deep RL algorithms, and can be used with rlberry, as shown by this example.

Tests

$ pip install pytest
$ pip install pytest-cov
$ pip install -e .[jax_agents]
$ pip install -e .[torch_agents]
$ cd scripts
$ bash run_testscov.sh

and coverage report in cov_html/index.html.

Contributing

Want to contribute to rlberry? Please check our contribution guidelines. If you want to add any new agents or environments, do not hesitate to open an issue!

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

rlberry-0.2.1.tar.gz (139.6 kB view hashes)

Uploaded Source

Built Distribution

rlberry-0.2.1-py3-none-any.whl (207.7 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page