An implementation of PINNs in PyTorch using Lightning and Hydra.
Project description
Description
Our package introduces Physics-Informed Neural Networks (PINNs) implemented using PyTorch. The standout feature is the incorporation of CUDA Graphs and JIT Compilers (TorchScript) for compiling models, resulting in significant performance gains up to 9x compared to the original TensorFlow v1 implementation.
Each subplot corresponds to a problem, with its iteration count displayed at the top. The logarithmic x-axis shows the speed-up factor w.r.t the original code in TensorFlow v1, and the y-axis illustrates the mean relative error.
For more information, please refer to our paper:
PINNs-Torch: Enhancing Speed and Usability of Physics-Informed Neural Networks with PyTorch. Reza Akbarian Bafghi, and Maziar Raissi. DLDE III, NeurIPS, 2023.
Installation
PINNs-Torch requires following dependencies to be installed:
- PyTorch >=2.0.0
- PyTorch Lightning >= 2.0.0
- Hydra >= 1.3
Then, you can install PINNs-Torch itself via [pip]:
pip install pinnstorch
If you intend to introduce new functionalities or make code modifications, we suggest duplicating the repository and setting up a local installation:
git clone https://github.com/rezaakb/pinnstorch
cd pinnstorch
# [OPTIONAL] create conda environment
conda create -n myenv python=3.9
conda activate myenv
# install package
pip install -e .
Quick start
Explore a variety of implemented examples within the examples folder. To run a specific code, such as the one for the Navier-Stokes PDE, you can use:
python examples/navier_stokes/train.py
You can train the model using a specified configuration, like the one found in examples/navier_stokes/configs/config.yaml. Parameters can be overridden directly from the command line. For instance:
python examples/navier_stokes/train.py trainer.max_epochs=20 n_train=3000
To utilize our package, there are two primary options:
- Implement your training structures using Hydra, as illustrated in our provided examples.
- Directly incorporate our package to solve your custom problem.
For a practical guide on directly using our package to solve the Schrödinger PDE in a continuous forward problem, refer to our tutorial here: tutorials/0-Schrodinger.ipynb.
Data
The data located on the server and will be downloaded automatically upon running each example.
Contributing
As this is the first version of our package, there might be scope for enhancements and bug fixes. We highly value community contributions. If you find any issues, missing features, or unusual behavior during your usage of this library, please feel free to open an issue or submit a pull request on GitHub. For any queries, suggestions, or feedback, please send them to Reza Akbarian Bafghi at reza.akbarianbafghi@colorado.edu.
License
Distributed under the terms of the [BSD-3] license, "pinnstorch" is free and open source software.
Resources
We employed this template to develop the package, drawing from its structure and design principles. For a deeper understanding, we recommend visiting their GitHub repository. We also recommend consulting the official documentation of Hydra and PyTorch Lightning for additional insights.
Citation
If you find this useful in your research, please consider citing:
@inproceedings{
bafghi2023pinnstorch,
title={{PINN}s-Torch: Enhancing Speed and Usability of Physics-Informed Neural Networks with PyTorch},
author={Reza Akbarian Bafghi and Maziar Raissi},
booktitle={The Symbiosis of Deep Learning and Differential Equations III},
year={2023},
url={https://openreview.net/forum?id=nl1ZzdHpab}
}
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.