tsellm 0.1.0a14

Use LLMs in SQLite and DuckDB

tsellm: Use LLMs in SQLite and DuckDB

tsellm is the easiest way to access LLMs from SQLite or DuckDB.

pip install tsellm

cat <<EOF | tee >(sqlite3 prompts.sqlite3) | duckdb prompts.duckdb
CREATE TABLE prompts ( p TEXT);
INSERT INTO prompts VALUES('how are you?');
INSERT INTO prompts VALUES('is this real life?');
EOF

llm install llm-gpt4all

tsellm prompts.duckdb "select prompt(p, 'orca-mini-3b-gguf2-q4_0') from prompts"
tsellm prompts.sqlite3 "select prompt(p, 'orca-2-7b') from prompts"

Behind the scenes, tsellm is based on the beautiful llm library, so you can use any of its plugins:

Embeddings

llm install llm-sentence-transformers
llm sentence-transformers register all-MiniLM-L12-v2

tsellm prompts.sqlite3 "select embed(p, 'sentence-transformers/all-MiniLM-L12-v2')"

Embeddings for binary (BLOB) columns

wget https://tselai.com/img/flo.jpg
sqlite3 images.sqlite3 <<EOF
CREATE TABLE images(name TEXT, type TEXT, img BLOB);
INSERT INTO images(name,type,img) VALUES('flo','jpg',readfile('flo.jpg'));
EOF

llm install llm-clip

tsellm images.sqlite3 "select embed(img, 'clip') from images"

Multiple Prompts

With a single query you can easily access get prompt responses from different LLMs:

tsellm prompts.sqlite3 "
        select p,
        prompt(p, 'orca-2-7b'),
        prompt(p, 'orca-mini-3b-gguf2-q4_0'),
        embed(p, 'sentence-transformers/all-MiniLM-L12-v2') 
        from prompts"

Interactive Shell

If you don't provide an SQL query, you'll enter an interactive shell instead.

tsellm prompts.db

Installation

pip install tsellm

How

tsellm relies on the following facts:

• SQLite is bundled with the standard Python library (import sqlite3)
• Python 3.12 ships with a SQLite interactive shell
• one can create Python-written user-defined functions to be used in SQLite queries (see create_function)
• Simon Willison has gone through the process of creating the beautiful llm Python library and CLI

Development

pip install -e '.[test]'
pytest