llm-apigateway 0.1.1

Debug your AI programs with ease through a web-based interface. Modify inputs and outputs, and leverage the power of custom Python filters.

中文 | English

# LLM API Gateway _✨ Debug your AI program through a web page, modify request information and send it to a designated upstream. Supports custom filtering programs to save your tokens under certain conditions. ✨_

## Quick Start ```bash pip install llm-apigateway apigateway ``` You can enable the local debugging environment with just two simple commands without any other requirements. ## Project Plan The project plans to use Python as the development language and release it as a pip package so that developers can install and use it easily. The project is still under development, and we hope you can give it a star to support the developers. ## Development Timeline - ~~Release pip package~~ - Set up a server compatible with the OpenAI API format - Implement functions to add upstreams and send to upstream interfaces - Implement functions to modify information and customize responses - Develop web UI - Add plugin functionality - Enable public deployment and access control - Multi-user support ### Development Log - Project initiated on 2025/02/26 ## Notice This project is open-source under the MIT license. **On this basis**, you must retain attribution and a link to this project at the bottom of the page. If you do not want to retain attribution or wish to use it for **commercial** purposes, you must first obtain authorization. The same applies to secondary projects based on this project. In accordance with the MIT license, users must undertake the risks and responsibilities of using this project at their own cost, and the developers of this open-source project are not involved.