Skip to main content

A custom RL environment with C++ backend and Gymnasium wrapper.

Project description

Hybrid Shoot Environment

This environment is designed as a sanity check for reinforcement learning with hybrid action spaces (discrete + continuous). It supports both Gymnasium (single agent with hybrid actions) and PettingZoo (multi-agent decomposition).

There are num_enemies enemies in a 2D space. The goal is to Jam and Shoot them.

Installation

pip install .

Gymnasium Usage

The Gymnasium environment presents a single agent with a Tuple action space.

from hybrid_shoot import HybridShootEnv

env = HybridShootEnv()
obs, info = env.reset()
# Action: (Jam_Target_Index, [Shoot_X, Shoot_Y])
action = (0, [0.5, 0.5]) 
obs, reward, done, truncated, info = env.step(action)

Action Space (Gymnasium)

A spaces.Tuple containing:

  1. Jam: Discrete(num_enemies) - Selects which enemy to jam.
  2. Shoot: Box(low=0, high=map_size, shape=(2,)) - [x, y] coordinates to shoot at.

PettingZoo Usage

The PettingZoo environment decomposes the task into two cooperating agents.

from hybrid_shoot import HybridShootPettingZooEnv

env = HybridShootPettingZooEnv()
observations, infos = env.reset()

Agents & Action Spaces (PettingZoo)

  1. jammer: Discrete(num_enemies) - Selects which enemy to jam.
  2. shooter: Box(low=0, high=map_size, shape=(2,)) - Selects the [x, y] coordinates.

Game Mechanics

Jamming: Stops the targeted enemy from dealing damage this turn. Shooting: Fires at location (x, y).

  • Standard Mode (independent_mode=False): An enemy must be jammed to be vulnerable to shooting. Shooting an unjammed enemy does nothing (or incurs a penalty).
  • Independent Mode (independent_mode=True): Jamming prevents damage, and Shooting kills enemies regardless of whether they are jammed.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hybrid_shoot-0.1.6.tar.gz (14.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

hybrid_shoot-0.1.6-cp311-cp311-win_amd64.whl (85.2 kB view details)

Uploaded CPython 3.11Windows x86-64

File details

Details for the file hybrid_shoot-0.1.6.tar.gz.

File metadata

  • Download URL: hybrid_shoot-0.1.6.tar.gz
  • Upload date:
  • Size: 14.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.11.4

File hashes

Hashes for hybrid_shoot-0.1.6.tar.gz
Algorithm Hash digest
SHA256 58322a0cb9756d5dceb5897a338bee7cf77fd0aeaf472ed405d3d990e7213a96
MD5 40c1b91a6b008ac7adba7b34f1904875
BLAKE2b-256 8c0940a818de48f8f3ea438c7e154c0ec04786db959585ded110fc7eeb4c03a6

See more details on using hashes here.

File details

Details for the file hybrid_shoot-0.1.6-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for hybrid_shoot-0.1.6-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 95a46792cb2ed6142c86abe8a3b947986b73d3754448362a0cec2ea4da5fcdaf
MD5 8e945abc190c246696b1814ffb7a5abf
BLAKE2b-256 917ae590a3483f8be93bce9860cbe1efa4180e0f551b043e9603daac7b08a312

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page