Skip to main content

A command-line interface for language models

Project description

llme, a CLI assitant for OpenAI-compatible chat servers

A simple, single-file command-line chat client compatible with the OpenAI API.

(or "I just want to quickly test my model hosted with vllm but don't want to spin up openwebui")

Features

  • OpenAI API Compatible: Works with any self-hosted LLM platform that supports OpenAI chat completions API.
  • Extremely simple: Single file, no installation needed.
  • Command-line interface: Run it from the terminal.
  • Tools included: Ask it to act on your file system and edit files (yolo).

Installation

  1. Clone the repository:

    git clone https://github.com/privat/llme.git
    cd llme
    
  2. Install the dependencies:

    pip install -r requirements.txt
    

Or use your operating system's package manager to install python requests, termcolor, and rich

Usage

./llme.py --base-url "https://api.openai.com/v1"

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llme_cli-0.1.0.tar.gz (17.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

llme_cli-0.1.0-py3-none-any.whl (18.1 kB view details)

Uploaded Python 3

File details

Details for the file llme_cli-0.1.0.tar.gz.

File metadata

  • Download URL: llme_cli-0.1.0.tar.gz
  • Upload date:
  • Size: 17.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.5

File hashes

Hashes for llme_cli-0.1.0.tar.gz
Algorithm Hash digest
SHA256 af3ec1039546e6d80339a55f4754cf126153b52a77992fc9e25c550df36d3091
MD5 510c736c28e387e6b06fab42c4c295d0
BLAKE2b-256 ede278342b842aede98aa6fe39fa6bb3300437c3262cd70b527c59440b42da5a

See more details on using hashes here.

File details

Details for the file llme_cli-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: llme_cli-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 18.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.5

File hashes

Hashes for llme_cli-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 cd4c59a79dfea433fd84694bb48c2512f36d7d21e676ef96e463117bd5781015
MD5 5cf5e86de537e543563e202de272c7b4
BLAKE2b-256 ed4633bc8843899ef112b6c24d4b61acdb9819a39822960a7fc60ca9b319ebcc

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page