Skip to main content

A custom RL environment with C++ backend and Gymnasium wrapper.

Project description

Hybrid Shoot Environment

This environment is designed as a sanity check for reinforcement learning with hybrid action spaces (discrete + continuous). It supports both Gymnasium (single agent with hybrid actions) and PettingZoo (multi-agent decomposition).

There are num_enemies enemies in a 2D space. The goal is to Jam and Shoot them.

Installation

pip install .

Gymnasium Usage

The Gymnasium environment presents a single agent with a Tuple action space.

from hybrid_shoot import HybridShootEnv

env = HybridShootEnv()
obs, info = env.reset()
# Action: (Jam_Target_Index, [Shoot_X, Shoot_Y])
action = (0, [0.5, 0.5]) 
obs, reward, done, truncated, info = env.step(action)

Action Space (Gymnasium)

A spaces.Tuple containing:

  1. Jam: Discrete(num_enemies) - Selects which enemy to jam.
  2. Shoot: Box(low=0, high=map_size, shape=(2,)) - [x, y] coordinates to shoot at.

PettingZoo Usage

The PettingZoo environment decomposes the task into two cooperating agents.

from hybrid_shoot import HybridShootPettingZooEnv

env = HybridShootPettingZooEnv()
observations, infos = env.reset()

Agents & Action Spaces (PettingZoo)

  1. jammer: Discrete(num_enemies) - Selects which enemy to jam.
  2. shooter: Box(low=0, high=map_size, shape=(2,)) - Selects the [x, y] coordinates.

Game Mechanics

Jamming: Stops the targeted enemy from dealing damage this turn. Shooting: Fires at location (x, y).

  • Standard Mode (independent_mode=False): An enemy must be jammed to be vulnerable to shooting. Shooting an unjammed enemy does nothing (or incurs a penalty).
  • Independent Mode (independent_mode=True): Jamming prevents damage, and Shooting kills enemies regardless of whether they are jammed.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hybrid_shoot-0.1.5.tar.gz (14.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

hybrid_shoot-0.1.5-cp312-cp312-win_amd64.whl (86.2 kB view details)

Uploaded CPython 3.12Windows x86-64

File details

Details for the file hybrid_shoot-0.1.5.tar.gz.

File metadata

  • Download URL: hybrid_shoot-0.1.5.tar.gz
  • Upload date:
  • Size: 14.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.6

File hashes

Hashes for hybrid_shoot-0.1.5.tar.gz
Algorithm Hash digest
SHA256 7a58aed838d0fe89c1df81bc7099b2d1c0e9e2a4a56b683ed028cc871c37395d
MD5 23e417403e60011e412f1c2d3ba44e06
BLAKE2b-256 abe6705a533c7e9ed1f6bbeffa193f3bc812b043df9460f6903ed3a1c503dacd

See more details on using hashes here.

File details

Details for the file hybrid_shoot-0.1.5-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for hybrid_shoot-0.1.5-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 098a56a75831d57097072e5cb3f388813cea33af068251046da08038bf8e2440
MD5 2966fa582f67303d599d84dd8b949b69
BLAKE2b-256 7cec3a8fed38c601d034e5254e8e4e40d45c5ce297f6cd4a0bbb84fa213019f1

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page