NeodroidAgent 0.2.6

Reinforcement learning agent implementations, intended for use with the Neodroid platform

Agent

This repository will host all initial machine learning efforts applying the Neodroid platform.

---

Neodroid is developed with support from Research Council of Norway Grant #262900. (https://www.forskningsradet.no/prosjektbanken/#/project/NFR/262900)

---

Contents Of This Readme

• Algorithms
• Requirements
• Usage
• Results
  • Target Point Estimator
  • Perfect Information Navigator
• Contributing
• Other Components

Algorithms

• REINFORCE (PG)
• DQN
• DDPG
• PPO
• TRPO, GA, EVO, IMITATION...

Requirements

• pytorch
• tqdm
• Pillow
• numpy
• matplotlib
• torchvision
• torch
• Neodroid
• pynput

(Optional)

• visdom
• gym

To install these use the command:

pip3 install -r requirements.txt

Usage

Export python path to the repo root so we can use the utilities module

export PYTHONPATH=/path-to-repo/

For training a agent use:

python3 procedures/train_agent.py

For testing a trained agent use:

python3 procedures/test_agent.py

Results

Target Point Estimator

Using Depth, Segmentation And RGB images to estimate the location of target point in an environment.

REINFORCE (PG)

DQN

DDPG

PPO

GA, EVO, IMITATION...

Perfect Information Navigator

Has access to perfect location information about the obstructions and target in the environment, the objective is to navigate to the target with colliding with the obstructions.

REINFORCE (PG)

DQN

DDPG

PPO

GA, EVO, IMITATION...

Contributing

See guidelines for contributing here.

Licensing

This project is licensed under the Apache V2 License. See LICENSE for more information.

Citation

For citation you may use the following bibtex entry:

@misc{neodroid-agent,
  author = {Heider, Christian},
  title = {Neodroid Platform Agents},
  year = {2018},
  publisher = {GitHub},
  journal = {GitHub repository},
  howpublished = {\url{https://github.com/sintefneodroid/agent}},
}

Other Components Of the Neodroid Platform

• neo
• droid