Skip to main content
Join the official 2019 Python Developers SurveyStart the survey!

A simple framework for distributed reinforcement learning in PyTorch.

Project description


rltorch provides a simple framework for reinforcement learning in PyTorch. You can easily implement distributed RL algorithms.


Install rltorch from source.

git clone
cd rltorch
pip install -e .

You can also install using PyPI.

pip install rltorch



You can implement Ape-X[1] agent like this example here.

python examples/atari/ \
[--env_id str(default MsPacmanNoFrameskip-v4)] \
[--num_actors int(default 4)] [--cuda (optional)] \
[--seed int(default 0)]

Soft Actor-Critic

You can implement Soft Actor-Critic[2, 3] agent like this example here. Note that you need a license and mujoco_py to be installed.

python examples/mujoco/ \
[--env_id str(default HalfCheetah-v2)] \
[--num_actors int(default 1)] \
[--cuda (optional)] [--seed int(default 0)]


You can implement SAC-Discrete[4] agent like this example here.

python examples/mujoco/ \
[--env_id str(default MsPacmanNoFrameskip-v4)] \
[--num_actors int(default 4)] \
[--cuda (optional)] [--seed int(default 0)]


[1] Horgan, Dan, et al. "Distributed prioritized experience replay." arXiv preprint arXiv:1803.00933 (2018).

[2] Haarnoja, Tuomas, et al. "Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor." arXiv preprint arXiv:1801.01290 (2018).

[3] Haarnoja, Tuomas, et al. "Soft actor-critic algorithms and applications." arXiv preprint arXiv:1812.05905 (2018).

[4] Christodoulou, Petros. "Soft Actor-Critic for Discrete Action Settings." arXiv preprint arXiv:1910.07207 (2019).

Project details

Release history Release notifications

This version


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for rltorch, version 0.1.0
Filename, size File type Python version Upload date Hashes
Filename, size rltorch-0.1.0-py2.py3-none-any.whl (30.6 kB) File type Wheel Python version py2.py3 Upload date Hashes View hashes
Filename, size rltorch-0.1.0.tar.gz (16.0 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page