PromptMage

simplifies the process of creating and managing LLM workflows as a self-hosted solution.

[!WARNING] This application is currently in alpha state and under active development. Please be aware that the API and features may change at any time.

About the Project

PromptMage is a python framework to simplify the development of complex, multi-step applications based on LLMs. It is designed to offer an intuitive interface that simplifies the process of creating and managing LLM workflows as a self-hosted solution. PromptMage facilitates prompt testing and comparison, and incorporates version control features to help users track the development of their prompts. Suitable for both small teams and large enterprises, PromptMage seeks to improve productivity and foster the practical use of LLM technology.

The approach with PromptMage is to provide a pragmatic solution that bridges the current gap in LLM workflow management. We aim to empower developers, researchers, and organizations by making LLM technology more accessible and manageable, thereby supporting the next wave of AI innovations.

Take the walkthrough to see what you can do with PromptMage.

Philosophy

• Integrate the prompt playground into your workflow for fast iteration
• Prompts as first-class citizens with version control and collaboration features
• Manual and automatic testing and validation of prompts
• Easy sharing of results with domain experts and stakeholders
• build-in, automatically created API with fastAPI for easy integration and deployment
• Type-hint everything for automatic inference and validation magic

Projects using PromptMage

• product-review-research: An AI webapp build with PromptMage to provide in-depth analysis for products by researching trustworthy online reviews.

Getting Started

Installation

To install promptmage, run the following command:

pip install promptmage 

Usage

To use promptmage, run the following command:

promptmage run <path-to-flow>

This will start the local promptmage server and run the flow at the given path. You can now access the promptmage interface at http://localhost:8000/gui/.

To run the remote backend server, run the following command:

promptmage serve --port 8021

To make it work with your promptmage script, you should add the following lines to your script:

from promptmage import PromptMage

mage = PromptMage(remote="http://localhost:8021")  # or the URL of your remote server

Have a look at the examples in the examples folder to see how to use promptmage in your application or workflow.

Use with Docker

You can find an usage example with docker here: Docker example.

Development

To develop PromptMage, check out the DEVELOPMENT.md file.

Contributing

We welcome contributions from the community!

If you're interested in improving PromptMage, you can contribute in the following ways:

• Reporting Bugs: Submit an issue in our repository, providing a detailed description of the problem and steps to reproduce it.
• Improve documentation: If you find any errors or have suggestions for improving the documentation, please submit an issue or a pull request.
• Fixing Bugs: Check out our list of open issues and submit a pull request to fix any bugs you find.
• Feature Requests: Have ideas on how to make PromptMage better? We'd love to hear from you! Please submit an issue, detailing your suggestions.
• Pull Requests: Contributions via pull requests are highly appreciated. Please ensure your code adheres to the coding standards of the project, and submit a pull request with a clear description of your changes.

To ensure a smooth contribution process, please follow these guidelines:

• create an issue before submitting a pull request to discuss the changes you'd like to make. This helps us ensure that your contribution aligns with the project's goals and prevents duplicate work.
• follow the coding standards of the project. Check the DEVELOPMENT.md file for more information.

Make sure to check if your issue or PR has already been fixed or implemented before opening a new one!

License

This project is licensed under the MIT License - see the LICENSE.md file for details. Original development by Tobias Sterbak. Copyright (C) 2024.

Contact

For any inquiries or further information, feel free to reach out at promptmage@tobiassterbak.com.

❤️ Acknowledgements

This project was supported by