Reinforcement learning agent implementations, intended for use with the Neodroid platform
Project description
Agent
This repository will host all initial machine learning efforts applying the Neodroid platform.
Neodroid is developed with support from Research Council of Norway Grant #262900. (https://www.forskningsradet.no/prosjektbanken/#/project/NFR/262900)
Contents Of This Readme
Algorithms
- REINFORCE (PG)
- DQN
- DDPG
- PPO
- TRPO, GA, EVO, IMITATION...
Algorithms Implemented
- Deep Q Learning (DQN) (Mnih et al. 2013)
- DQN with Fixed Q Targets (Mnih et al. 2013)
- Double DQN (DDQN) (Hado van Hasselt et al. 2015)
- DDQN with Prioritised Experience Replay (Schaul et al. 2016)
- Dueling DDQN (Wang et al. 2016)
- REINFORCE (Williams et al. 1992)
- Deep Deterministic Policy Gradients (DDPG) (Lillicrap et al. 2016 )
- Twin Delayed Deep Deterministic Policy Gradients (TD3) (Fujimoto et al. 2018)
- Soft Actor-Critic (SAC & SAC-Discrete) (Haarnoja et al. 2018)
- Asynchronous Advantage Actor Critic (A3C) (Mnih et al. 2016)
- Syncrhonous Advantage Actor Critic (A2C)
- Proximal Policy Optimisation (PPO) (Schulman et al. 2017)
- DQN with Hindsight Experience Replay (DQN-HER) (Andrychowicz et al. 2018)
- DDPG with Hindsight Experience Replay (DDPG-HER) (Andrychowicz et al. 2018 )
- Hierarchical-DQN (h-DQN) (Kulkarni et al. 2016)
- Stochastic NNs for Hierarchical Reinforcement Learning (SNN-HRL) (Florensa et al. 2017)
- Diversity Is All You Need (DIAYN) (Eyensbach et al. 2018)
Environments Implemented
- Bit Flipping Game (as described in Andrychowicz et al. 2018)
- Four Rooms Game (as described in Sutton et al. 1998)
- Long Corridor Game (as described in Kulkarni et al. 2016)
- Ant-{Maze, Push, Fall} (as desribed in Nachum et al. 2018 and their accompanying code)
Requirements
- pytorch
- tqdm
- Pillow
- numpy
- matplotlib
- torchvision
- torch
- Neodroid
- pynput
(Optional)
- visdom
- gym
To install these use the command:
pip3 install -r requirements.txt
Usage
Export python path to the repo root so we can use the utilities module
export PYTHONPATH=/path-to-repo/
For training a agent use:
python3 procedures/train_agent.py
For testing a trained agent use:
python3 procedures/test_agent.py
Results
Target Point Estimator
Using Depth, Segmentation And RGB images to estimate the location of target point in an environment.
REINFORCE (PG)
DQN
DDPG
PPO
GA, EVO, IMITATION...
Perfect Information Navigator
Has access to perfect location information about the obstructions and target in the environment, the objective is to navigate to the target with colliding with the obstructions.
REINFORCE (PG)
DQN
DDPG
PPO
GA, EVO, IMITATION...
Contributing
See guidelines for contributing here.
Licensing
This project is licensed under the Apache V2 License. See LICENSE for more information.
Citation
For citation you may use the following bibtex entry:
@misc{neodroid-agent,
author = {Heider, Christian},
title = {Neodroid Platform Agents},
year = {2018},
publisher = {GitHub},
journal = {GitHub repository},
howpublished = {\url{https://github.com/sintefneodroid/agent}},
}
Other Components Of the Neodroid Platform
Authors
- Christian Heider Nielsen - cnheider
Here other contributors to this project are listed.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
Hashes for NeodroidAgent-0.4.5-py36-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bc7db9668d5dd4aa3b63c7f3c12316b687126503309e626287bfe884cfae4eb4 |
|
MD5 | c57aa78ce2b2baa58c1b076d5adb0d1a |
|
BLAKE2b-256 | 95a78a4e84075c048ad324f52c38b77bbea244015cdec2eafb901574a8add331 |