llm-clap 0.2

Generate embeddings for audio files using CLAP with llm

LLM plugin for embedding audio files (music, speech, sounds) and text using CLAP

Installation

Install this plugin in the same environment as LLM.

llm install llm-clap

Usage

Once you have installed an embedding model you can use it to embed text like this:

llm embed -m clap -c 'Hello world'

Or an audio file like this:

llm embed -m clap --binary -i AUDIO_1431.wav

Embeddings are more useful if you store them in a database - see the LLM documentation for details.

To embed every audio file in a folder and save them in a collection called "songs":

llm embed-multi songs -m clap --binary --files songs/ '*.wav'

You can then search for songs of specific things like this:

llm similar songs -c 'rap'

But you can also find songs/audio similar to a given audio file like this:

llm similar songs --binary -i MYSONG.wav