azc 1.0.7

Command-line tool for interacting with LLMs

azc - LLM Chat from the command-line

A command-line tool for interacting with LLMs.

Why should you use this?

• If you're a command-line junkie, you don't need to switch to another tool to chat with your LLM
• One tool, multiple LLMs (OpenAI, Anthropic, Ollama, Gemini) - Why settle for one when you can have them all?
• Pay-as-you-go pricing for LLM providers (Cheaper in many cases)

Features

• Multi-provider support
  • Ollama
  • OpenAI
  • Anthropic
  • Gemini
• Streaming responses (see response as it is being generated)
• Persistent command-line history (use up and down arrows to navigate)
• Chat history & reset (full discussion, start new chat)
• Switch provider and model (compare models and providers)
• Markdown output (nicely formatted headings, lists, tables, etc.)
• Command-line parameters (first prompt)

Possible future features

• Support for more LLM providers
• Support RTL languages
• Save output to file
• Patterns library (a-la fabric)
• Upload files
• Aggregate responses from multiple providers
• Support more modes (image generation, transcription, etc.)
• Automated testing
• track total cost

Installation

pip install azc

Running

% azc
azc> how tall is the eiffel tower?
                                  ollama:llama3.1:latest (1st message)
  The Eiffel Tower stands at an impressive height of:

  • 324 meters (1,063 feet) tall, including its antenna.
  • 302.9 meters (994.7 feet) tall, excluding its antenna.

  It was the world's tallest man-made structure when it was first built for the 1889 World's Fair in
  Paris.

azc> q
👋 Bye
%

You can specify the first prompt as a command-line argument:

% azc -b "What is the capital of Panama?"
The capital of Panama is Panama City.
%

Command-line parameters

• default parameter: first prompt
• -d / --double-enter - Press enter twice to submit - This is useful for those who want to use use multi-line prompts without pressing ctrl-j to add new line.
• -b / --batch - Exit after the first response
• -v / --verbose - Print verbose output
• --provider - The provider to use (e.g. openai or ollama). Abbreviations allowed, like op for openai
• --model - The model to use. Abbreviations allowed, like tu for gpt-3.5-turbo

Commands

• q or exit - exit the program
• h or ? - show help
• l - list models
• n - start new chat
• p - Change provider
• m - Change model
• ctrl-n - new line

Setup

You will need to configure at least one LLM API.

You should create a .env file which contains your API Key/s.

See .env.sample for a sample file

Here are the links to the API sign-up pages (or download in case of Ollama):

• OpenAI
• Anthropic
• Ollama
• Gemini

You can configure the default models you want to use in config.json

Limitations

• Streaming updates are limited to screen height (after that it displays ellipsis and will update the display only when the response is complete)
• No support for RTL languages

Contributing

Contributions are welcome! Please feel free to submit a PR.

License

MIT