llcat 0.1.0

/usr/bin/cat for the LLM era

/usr/bin/cat for LLMs

llcat is an LLM program with very little ambition in life.

That's what makes it useful.

• Pipe things into it or prompt it on the command line.
• Conversation history is an optional file.
• Tool Calling is done by using the toolcalling OpenAI spec. There's a file and a progrma example
• Servers:
  • OPENAI_API_BASE and LLM_BASE_URL are supported along with -s for one off.
  • Authentication tokens are passed with -k. You can do $(< somefile) or whatever obfuscation you want, that's on you.
• Models are listed with the -m option and specified with it as well.

Here's some things you can do

• pipx install llcat
• uv tool run llcat

There's no requirements.txt? That's right.

Examples

We start with Openrouter

Listing the models on openrouter

llmcat -s https://openrouter.ai/api -m

You can run that, unauthenticated, no problem.

$ llcat -s https://openrouter.ai/api \
        -m meta-llama/llama-3.2-3b-instruct:free \
        -c /tmp/convo.txt \
        -k $(cat openrouter.key) \
        "What is the capital of France?"

$ llcat -s https://openrouter.ai/api \
        -m meta-llama/llama-3.2-3b-instruct:free \
        -c /tmp/convo.txt \
        -k $(cat openrouter.key) \
        "And what about Canada?"

Let's continue it locally

$ llcat -s http://192.168.1.21:8080 \
        -c /tmp/convo.txt \
        "And what about Japan?"

Full documentation

usage: llcat [-h] [-c CONVERSATION] [-m [MODEL]] [-k KEY] [-s SERVER]
                [-tf TOOL_FILE] [-tp TOOL_PROGRAM]
                [prompt ...]

positional arguments:
  prompt                Your prompt

options:
  -h, --help            show this help message and exit
  -c, --conversation CONVERSATION
                        Conversation history file
  -m, --model [MODEL]   Model to use (or list models if no value)
  -k, --key KEY         API key for authorization
  -s, --server SERVER   Server URL (e.g., http://::1:8080)
  -tf, --tool_file TOOL_FILE
                        JSON file with tool definitions
  -tp, --tool_program TOOL_PROGRAM
                        Program to execute tool calls