datasette-llm-usage 0.2a0

Track usage of LLM tokens in a SQLite table

datasette-llm-usage

Track usage of LLM tokens in a SQLite table

Installation

Install this plugin in the same environment as Datasette.

datasette install datasette-llm-usage

Usage

This plugin tracks LLM token usage in Datasette via the datasette-llm llm_prompt_context hook. It creates two tables:

• llm_usage: Tracks token usage per request (model, purpose, actor, input/output tokens)
• llm_usage_prompt_log: Optionally logs full prompts and responses

Configuration

By default the tables are created in the internal database passed to Datasette using --internal internal.db. You can change that by setting the following in your Datasette plugin configuration:

{
    "plugins": {
        "datasette-llm-usage": {
            "database": "your_database_name"
        }
    }
}

To enable full prompt and response logging, set log_prompts to true:

{
    "plugins": {
        "datasette-llm-usage": {
            "log_prompts": true
        }
    }
}

Prompt testing tool

The plugin also provides a simple demo page at /-/llm-usage-simple-prompt which can be used to execute prompts for testing.

That page requires the user to have the llm-usage-simple-prompt permission.

Development

Clone this repo and run the tests:

cd datasette-llm-usage
uv run pytest