Skip to main content

Transformers for modeling physical systems

Project description

Transformer PhysX

CircleCI Documentation Status Website liscense

Transformer PhysX is a Python packaged modeled after the Hugging Face repository designed for the use of transformers for modeling physical systems. Transformers have seen recent success in both natural language processing and vision fields but have yet to fully permute other machine learning areas. Originally proposed in Transformers for Modeling Physical Systems, this projects goal is to make these deep learning advances including self-attention and Koopman embeddings more accessible for the scientific machine learning community.

Website | Documentation |Getting Started (Coming Soon) | Data (Coming Soon)

Associated Papers

Transformers for Modeling Physical Systems [ ArXiV ]

Colab Quick Start

Embedding Model Transformer
Lorenz Open In Colab Open In Colab
Cylinder Flow - -
Gray-Scott - -
Rossler Coming Soon Coming Soon

Road Map

This is an on going project, hence many parts are not fully developed and will be added in the near future. If you have any particular questions or features you are interested in, please make a issue request so it can be prioritized! Thanks for understanding.

  • Add package to PyPi
  • Set up wheel versions
  • Add Rossler number example and collab notebook
  • Set up data repository
  • Additional Unit Testing for Better Code Coverage
  • Parallel Data training for transformer
  • Unsupervised pretraining physics

Additional Resources


Open an issue on the Github repository if you have any questions/concerns.


Find this useful or like this work? Cite us with:

    title={Transformers for Modeling Physical Systems},
    author={Geneva, Nicholas and Zabaras, Nicholas},
    journal={arXiv preprint arXiv:2010.03957},

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for trphysx, version 0.0.1
Filename, size File type Python version Upload date Hashes
Filename, size trphysx-0.0.1.tar.gz (47.2 kB) File type Source Python version None Upload date Hashes View
Filename, size trphysx-0.0.1-py3-none-any.whl (70.8 kB) File type Wheel Python version py3 Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page