LLM Labeling UI is an open source project for large language model data labeling
Project description
LLM Labeling UI
About
WARNIN This project is for my personal use and is still under development. I am not responsible for any data loss that may occur during your use.
LLM Labeling UI is a project fork from Chatbot UI, and made the following modifications to make it more suitable for large language model data labeling tasks.
- The backend code is implemented in python, the frontend code is precompiled, so it can run without a nodejs environment
- The Chatbot UI uses localStorage to save data, with a size limit of 5MB, the LLM Labeling UI can load local data when starting the service, with no size limit
- Web interaction:
- You can view data in pages
- You can directly modify/delete model's response results
- A confirmation button has been added before deleting the conversation message
- Display the number of messages in the current dialogue, token length
- You can modify the system prompt during the dialogue
Quick Start
pip install llm-labeling-ui
1. Provide OpenAI API Key
You can provide openai api key before start server or configure it later in the web page.
export OPENAI_API_KEY=YOUR_KEY
export OPENAI_ORGANIZATION=YOUR_ORG
2. Start Server
llm-labeling-ui start --history-file chatbot-ui-v4-format-history.json --tokenizer meta-llama/Llama-2-7b
- Before the service starts, a
chatbot-ui-v4-format-history.sqlite
file will be created based onchatbot-ui-v4-format-history.json
. All your modifications on the page will be saved into the sqlite file. If thechatbot-ui-v4-format-history.sqlite
file already exists, it will be automatically read. --tokenizer
is used to display how many tokens the current conversation on the webpage contains. Please note that this is not the token consumed by calling the openai api.
3. Export data from sqlite
llm-labeling-ui export --db-path chatbot-ui-v4-format-history.sqlite
By default exported data will be generated in the same directory as `db_path``, and the file name will be added with a timestam.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for llm_labeling_ui-0.1.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 78656728c705638ebc59dc5d9f194a4654cf948251f809870e280badf1a9fe7b |
|
MD5 | 2c0efb609c30a4208a0206fef7d5d346 |
|
BLAKE2b-256 | ac80583fcef3e1329c9c31d0e4b01bcc8f45362771924ac77ecfbaef84614b23 |