llcat 0.3.0

/usr/bin/cat for the LLM era

/usr/bin/cat for LLMs

llcat is an LLM program with very little ambition.

That's why it's awesome.

You can handle this!

llcat solves all your problems.

Yes. Every one.

It can also:

• Pipe things from stdin and/or be prompted on the command line.
• Store conversation history optionally, in a normal file.
• Do tool calling using the OpenAI spec. There's an example in this repository (and below).
• Use local or remote servers, authenticated or not.
• List models using -m without arguments. Specify a model with the argument.

Free Samples? Sure! It's Free Software.

• pipx install llcat
• uvx llcat

It's llcat, not llmcat. Let's keep it pronounceable.

Dependencies? Just the requests library.

Pretty unambitious. Pretty nice.

Examples

List the models on OpenRouter:

uvx llcat -s https://openrouter.ai/api -m

Go ahead, do that right now.

$ llcat -s https://openrouter.ai/api \
        -m meta-llama/llama-3.2-3b-instruct:free \
        -c /tmp/convo.txt \
        -k $(cat openrouter.key) \
        "What is the capital of France?"

$ llcat -s https://openrouter.ai/api \
        -m meta-llama/llama-3.2-3b-instruct:free \
        -c /tmp/convo.txt \
        -k $(cat openrouter.key) \
        "And what about Canada?"

Let's continue it locally

$ llcat -s http://192.168.1.21:8080 \
        -c /tmp/convo.txt \
        "And what about Japan?"

Pure sorcery.

Want to store state? Let's go!

$ source fancy.sh
...
$ llc "write a diss track where the knapsack problem hates on the towers of hanoi"

What goes in the ...?

You'll have to read the four lines of fancy.sh!

(Spoiler Alert: it sets environment variables and has a wrapper function)

The Tool Call To Rule Them All

This example, a very strange way to play mp3s, uses the sophisticated 21 line example_tool_program.py included in this repository.

It also uses DA`/50's pretty little streaming markdown renderer, streamdown.

Kablam! Alright a16z where's my $50 million?

The enterprise applications are limitless...

Boring Documentation

usage: llcat [-h] [-c CONVERSATION] [-m [MODEL]] [-k KEY] [-s SERVER]
                [-tf TOOL_FILE] [-tp TOOL_PROGRAM]
                [prompt ...]

positional arguments:
  prompt                Your prompt

options:
  -h, --help            show this help message and exit
  -c, --conversation CONVERSATION
                        Conversation history file
  -m, --model [MODEL]   Model to use (or list models if no value)
  -k, --key KEY         API key for authorization
  -s, --server SERVER   Server URL (e.g., http://::1:8080)
  -tf, --tool_file TOOL_FILE
                        JSON file with tool definitions
  -tp, --tool_program TOOL_PROGRAM
                        Program to execute tool calls