Skip to main content

No project description provided

Project description

LLM-cli

A lightweight Command Line Interface (CLI) for interacting with Large Language Models (LLMs) using LiteLLM.

💡 Why This Project?

Sometimes network constraints or data limitations make it difficult to access large language models via web interfaces. This CLI provides a lightweight, flexible solution for LLM interactions directly from the terminal.

🚀 Features

  • Simple CLI Interface: Easily chat with different LLMs from your terminal
  • Input: Pipe inputs or redirect file text.
  • Multiple Chat Modes:
    • Direct single-message chat
    • Interactive chat UI with markdown rendering
    • Image support for vision-capable models
  • Flexible Configuration: Customize model, temperature, and system prompts
  • Easy Configuration Management: Update settings with a simple command
  • Sessions : Logs chat sessions, can be resumed saved chat later.

🔧 Prerequisites

  • Api keys to the llms, set api keys as environment variables

💾 Installation

  1. Via Pip
pip install llm-to-cli

Or

  1. From Repo
# Clone the repository
git clone https://github.com/tikendraw/llm-cli.git
cd llm-cli

# Install 
pip install .

🖥️ Usage

Basic Chat

  • Send a single message to an LLM:

    llm-cli chat "Hello, how are you?"
    
  • Pipe input

    echo "what is 34th prime number" | llm-cli chat
    
  • File redirection

    llm-chat chat < some_file_with_question.txt
    

Interactive Chat UI

  • Start an interactive chat session:

    llm-cli chatui
    

Image Support

  • Add image
    llm-cli chat --image path/to/image/or/url
    

Configuration

  • View current configuration:

    llm-cli config
    
  • Update configuration:

    llm-cli config model "anthropic/claude-3-haiku"
    llm-cli config temperature 0.7
    

🛠️ Commands

  • chat: Send a single message
  • chatui: Interactive chat
  • config: Manage CLI configuration
  • history: See and manage history

🤝 Contributing

Contributions are welcome! Please feel free to submit a Pull Request.

🖹 License

The MIT one.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llm_to_cli-0.1.1.tar.gz (9.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

llm_to_cli-0.1.1-py3-none-any.whl (11.2 kB view details)

Uploaded Python 3

File details

Details for the file llm_to_cli-0.1.1.tar.gz.

File metadata

  • Download URL: llm_to_cli-0.1.1.tar.gz
  • Upload date:
  • Size: 9.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.2 CPython/3.12.3 Linux/6.8.0-52-generic

File hashes

Hashes for llm_to_cli-0.1.1.tar.gz
Algorithm Hash digest
SHA256 4d1b409adb68dd251c257d9eb37b6b0ceb897a11025f02efab6a452a018a4a09
MD5 0eda4c97ba988949cfc7e557f5e56506
BLAKE2b-256 402eb689e7598829e8315e73a9f443f2144a897da788e4b3c2e6a67b2581ea2f

See more details on using hashes here.

File details

Details for the file llm_to_cli-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: llm_to_cli-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 11.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.2 CPython/3.12.3 Linux/6.8.0-52-generic

File hashes

Hashes for llm_to_cli-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 cdc922e44ddbd3c63a192fb0459c4e99f3c93a43cc88bb50e82ea46d62f4db99
MD5 d2d65cf549c2bbf3f8ef3b3aa92d59c0
BLAKE2b-256 69e0879e42d9745a074e8e5e9fa54d23b21c601d0766efadeac3e5acd2f811ec

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page