opfgym 1.0.0

Reinforcement Learning environments for learning the Optimal Power Flow

PyPi | Read the Docs | Github | mail

General

A set of benchmark environments to solve the Optimal Power Flow (OPF) problem with reinforcement learning (RL) algorithms. It is also easily possible to create custom OPF environments. All environments use the gymnasium API. The modelling of the power systems and the calculation of power flows happens with pandapower. The benchmark power grids and time-series data of loads and generators are taken from SimBench.

Documentation can be found on https://opf-gym.readthedocs.io/en/latest/.

If you want to use the benchmark environments or the general framework to build your own environments, please cite this repository (see CITATION.cff) and/or cite the following publication, where the framework is first mentioned (in an early stage): https://doi.org/10.1016/j.egyai.2024.100410

Environments

Currently, five OPF benchmark environments are available.

• EcoDispatch: Economic dispatch
• VoltageControl: Voltage Control with reactive power
• MaxRenewable: Maximize renewable feed-in
• QMarket: Reactive power market
• LoadShedding: Load shedding problem

Additionally, some example environments for more advanced features can be found in opfgym/examples.

Contribution

Any kind of contribution is welcome! Feel free to create issues or merge requests. Also, additional benchmark environment are highly appreciated. For example, the examples environments could be refined to difficult but solvable RL-OPF benchmarks. Here, it would be especially helpful to incorporate an OPF solver that is more capable than the very limited pandapower OPF. For example, it should be able to deal with multi-stage problems, discrete actuators like switches, and stochastic problems, which the pandapower OPF cannot. For questions, feedback, collaboration, etc., contact [e-mail].