Numeric PDDLGym

A framework for automatically translating Numeric PDDL domains with the Gymnasium API. This allows Numeric PDDL planning problems to be solved using standard RL algorithms (e.g., PPO via RLlib).

The environment converts states, actions, and goals from Numeric PDDL into fixed-size numeric vectors, enabling direct integration with deep RL libraries.

✨ Features

• Supports Numeric PDDL domains and problems
• Automatic grounding and vectorization of:
  • Predicates
  • Numeric fluents
  • Goal conditions
• Compatible with the Gymnasium API
• Designed for RLlib (Ray) integration
• Works with standard deep RL algorithms (e.g., PPO)

⚙️ Configuration

The environment is configured via a dictionary (env_config).

🚀 Installation

pip install numeric_pddl_gym

With RL (RLlib + Torch):

pip install numeric_pddl_gym[rl_agents]

▶️ Run Example

RL Agent

python rl_agents/ppo_pddl_rllib_agent.py

Planning Agent

See example for a planning-based agent in:

test/test_fixed_script_agent.py

⚠️ Limitations

1. Can't encode complex goal conditions.
2. Agents must be retrained if the problem has a different number of fluents, predicates, or goal conditions.
3. Currently does not support manual interaction with the environment.
4. Designed for fixed-structure problems (no variable-sized domains).
5. Enabling action applicability checking leads to slow runtime in large-scale problems.

📚 Citations

Coming soon