Skip to main content

Bookworm - A LLM-powered bookmark search engine

Project description

bookworm 📖

main PyPI version

LLM-powered bookmark search engine

bookworm allows you to search your locally stored bookmarks using human language.

Install

python -m pip install bookworm_genai

Usage

export OPENAI_API_KEY=

# Run once and then anytime bookmarks across supported browsers changes
bookworm sync

# Sync bookmarks only from a specific browser
bookworm sync --browser-filter chrome

# Ask questions against the bookmark database
bookworm ask

# Ask questions against the bookmark database
# Specify the query when invoking the command
# If you omit this then you will be asked for a query when the tool is running
bookworm ask -q pandas

# Ask questions against the bookmark database and specify the number of results that should come back
bookworm ask -n 1

The sync process currently supports the following configurations:

Operating System Google Chrome Mozilla Firefox Brave Microsoft Edge
Linux
macOS
Windows

Processes

bookworm sync

python -m bookworm sync
graph LR

subgraph Bookmarks
    Chrome(Chrome Bookmarks)
    Brave(Brave Bookmarks)
    Firefox(Firefox Bookmarks)
end

Bookworm(bookworm sync)

EmbeddingsService(Embeddings Service e.g OpenAIEmbeddings)

VectorStore(Vector Store e.g DuckDB)

Chrome -->|load bookmarks|Bookworm
Brave -->|load bookmarks|Bookworm
Firefox -->|load bookmarks|Bookworm

Bookworm -->|vectorize bookmarks|EmbeddingsService-->|store embeddings|VectorStore

bookworm ask

python -m bookworm ask
graph LR

query
Bookworm(bookworm ask)

subgraph _
    LLM(LLM e.g OpenAI)
    VectorStore(Vector Store e.g DuckDB)
end

query -->|user queries for information|Bookworm

Bookworm -->|simularity search|VectorStore -->|send similar docs + user query|LLM
LLM -->|send back response|Bookworm

Developer Setup

# LLMs
export OPENAI_API_KEY=

# Langchain (optional, but useful for debugging)
export LANGCHAIN_API_KEY=
export LANGCHAIN_TRACING_V2=true
export LANGCHAIN_PROJECT=bookworm

# Misc (optional)
export LOGGING_LEVEL=INFO

Recommendations:

poetry env use 3.9 # or path to your 3.9 installation

poetry shell
poetry install

bookworm --help

Adding an Integration

As you can see from usage, bookworm supports various integrations but not all. If you find one that you want to support then a change is needed inside integrations.py.

You can see in that file there is a variable called browsers that follows this structure:

browsers = {
    "BROWSER": {
        "PLATFORM": {
            ...
        }
    }
}

So say you wanted to add Chrome support in Windows then you would go under the Chrome key and then add a win32 key which has all the details. You can refer to existing examples but generally the contents of those details are where to find the bookmarks on the user's system along with how to interpret them.

You can also find a full list of the document loaders supported here.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bookworm_genai-0.10.1b59.tar.gz (10.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

bookworm_genai-0.10.1b59-py3-none-any.whl (12.1 kB view details)

Uploaded Python 3

File details

Details for the file bookworm_genai-0.10.1b59.tar.gz.

File metadata

  • Download URL: bookworm_genai-0.10.1b59.tar.gz
  • Upload date:
  • Size: 10.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.5 CPython/3.12.3 Linux/6.8.0-1017-azure

File hashes

Hashes for bookworm_genai-0.10.1b59.tar.gz
Algorithm Hash digest
SHA256 cfa45e1e4fac19c13122b5f99deef171a34c67b975c1e1db672e84a5946007fd
MD5 2891cd67e29f70acaeb0e8a6631f959d
BLAKE2b-256 cddd027d466f0f4aa35e5e313aacd2cfbd0b30f2e22d06fe0cdb780faa0fd108

See more details on using hashes here.

File details

Details for the file bookworm_genai-0.10.1b59-py3-none-any.whl.

File metadata

  • Download URL: bookworm_genai-0.10.1b59-py3-none-any.whl
  • Upload date:
  • Size: 12.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.5 CPython/3.12.3 Linux/6.8.0-1017-azure

File hashes

Hashes for bookworm_genai-0.10.1b59-py3-none-any.whl
Algorithm Hash digest
SHA256 ea917044ef8e19a6c78220cc09323aa16f12c29b2e0fb3ea603f1ac82bf173f9
MD5 13ed5732e957b7afc804d3a1b29122d7
BLAKE2b-256 db7957dafca1dd7796c5dc33dbde0a57831a3ad06a8fee27748ebf6e2ff1490b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page