llama-index-packs-secgpt 0.3.0

llama-index packs - secgpt pack

SecGPT Pack

SecGPT is an LLM-based system that secures the execution of LLM apps via isolation. The key idea behind SecGPT is to isolate the execution of apps and to allow interaction between apps and the system only through well-defined interfaces with user permission. SecGPT can defend against multiple types of attacks, including app compromise, data stealing, inadvertent data exposure, and uncontrolled system alteration. The architecture of SecGPT is shown in the figure below. Learn more about SecGPT in our paper.

We develop SecGPT using LlamaIndex, an open-source LLM framework. We use LlamaIndex because it supports several LLMs and apps and can be easily extended to include additional LLMs and apps. We implement SecGPT as a personal assistant chatbot, which the users can communicate with using text messages.

A comprehensive notebook guide is available here. In the meantime, you can explore its features by comparing the execution flows of SecGPT and VanillaGPT (a non-isolated LLM-based system defined here) in response to the same query.

SecGPT original GitHub repository link: https://github.com/llm-platform-security/SecGPT

If you build on this work, considering citing our paper:

Citation

@article{wu2024secgpt,
  title={{SecGPT: An Execution Isolation Architecture for LLM-Based Systems}},
  author={Wu, Yuhao and Roesner, Franziska and Kohno, Tadayoshi and Zhang, Ning and Iqbal, Umar},
  journal={arXiv preprint arXiv:2403.04960},
  year={2024},
}

Contribution and Support

We welcome contributions to the project, e.g., through pull requests to the original GitHub repo. Please also feel free to reach out to us if you have questions about the project and if you would like to contribute.

Research Team

Yuhao Wu (Washington University in St. Louis) Franziska Roesner (University of Washington) Tadayoshi Kohno (University of Washington) Ning Zhang (Washington University in St. Louis) Umar Iqbal (Washington University in St. Louis)