gtk-llm-chat 2.2.2

A GTK graphical interface for chatting with large language models (LLMs)

GTK LLM Chat

A GTK graphical interface for chatting with Large Language Models (LLMs).

if you find this project useful.

Key Features

• Simple and easy-to-use graphical interface built with GTK
• Support for multiple conversations in independent windows
• Integration with python-llm for chatting with various LLM models
• Modern interface using libadwaita
• Support for real-time streaming responses
• Message history with automatic scrolling
• Markdown rendering of the responses
• Support for fragments: Include external content (files, URLs, or text snippets) in your prompts.
• Conversation Management: Rename and delete conversations.
• Applet Mode: Run a system tray applet for quick access to recent conversations.
• Model Selection: Choose from different LLM models.
• System Prompt: Set a custom system prompt for each conversation.
• Error Handling: Clear error messages displayed in the chat.
• Dynamic Input: The input area dynamically adjusts its height.
• Keyboard Shortcuts:
  • Enter: Send message.
  • Shift+Enter: New line in the input.
  • Ctrl+W: Delete the current conversation.

Installation

pipx install llm               # required by gtk-llm-chat
llm install gtk-llm-chat

You may want to manually copy the .desktop files to ~/.local/share/applications/ to make them available in your application menu.

Experimental Windows Version (NEW!)

Windows users can try our experimental version of the GTK LLM Chat app. This version is built using the MSYS2 environment and includes a precompiled GTK4 package.

While it is fully functional, there is no mechanism provided thru the GUI for adding plugins or API keys - and no system tray applet support either.

A welcome assistant is planned for the future, but for now, you can manually add your API keys to your keys.json file.

You will find the Windows version under "Releases" in the GitHub repository.

Dependencies

These are collected here for reference only, let me know if the list needs adjusting.

 # fedora: # sudo dnf install cairo-devel object-introspection-devel gtk4-devel pkgconf-pkg-config gcc redhat-rpm-config
 # debian: # sudo apt install python3-gi python3-gi-cairo gir1.2-gtk-4.0 libadwaita-1-0

System Requirements

• llm
• Python 3.8 or higher
• GTK 4.0
• libadwaita
• libayatana-appindicator

Usage

Run the application:

llm gtk-applet

or for an individual chat:

llm gtk-chat

With optional arguments:

llm gtk-chat --cid CONVERSATION_ID  # Continue a specific conversation
llm gtk-chat -s "System prompt"  # Set system prompt
llm gtk-chat -m model_name  # Select specific model
llm gtk-chat -c  # Continue last conversation

Development

To set up the development environment:

git clone https://github.com/icarito/gtk-llm-chat.git
cd gtk-llm-chat
python -m venv venv
source venv/bin/activate
pip install -e ".[dev]"

License

GPLv3 License - See LICENSE file for more details.