chatrepl 0.1.0a1

A Python 2.7+ REPL for interacting with LLMs with an OpenAI Chat Completions-compatible API.

A Python 2.7+ REPL for interacting with LLMs with an OpenAI Chat Completions-compatible API.

Features

• Zero Dependencies: Works with stock Python 2.7+ and 3.x
• Interactive Chat: Natural REPL interface with conversation tracking
• Streaming Responses: See responses as they're generated
• Multiline Input: Support for complex prompts with :multiline
• File Integration: Load prompts from text files with :send <textfile>
• Conversation Persistence: Save/load complete conversations in JSON format
• Enhanced Input: Optional readline support for history and line editing
• Dual Modes: Both interactive REPL and pipe-friendly CLI

Interactive Mode

$ python -m chatrepl \
  --api-key "your-api-key" \
  --base-url "https://api.openai.com/v1" \
  --model "gpt-4o"

Basic Conversation

User [1]: Explain recursion to a 5-year-old

Assistant [1]: Imagine you're holding a doll that has...

Using Files

User [2]: :send code.py
Assistant [2]: I notice this Python code could be improved...

User [3]: :save review_chat.json

Multiline Input

User [4]: :multiline
Enter EOF on a blank line to finish input:
> Compare these programming languages:
> 1. Python
> 2. Rust
> 3. Go
> [Ctrl-D]

Assistant [4]: Here's a comparison:
1. Python - High-level, interpreted...
2. Rust - Systems programming...
3. Go - Compiled, concurrent...

Non-interactive Mode (Piped Input)

$ uname -a | python -m chatrepl --api-key <your_api_key> --base-url <your_base_url> --model <model_name>
The output you've provided appears to be system information from ... [output streamed to STDOUT]

Print Saved Conversations

$ python -m chatrepl --print conversation.json
User [1]: ...

Assistant [1]: ...

Interactive Commands

• :multiline - Enter multiline input mode (end with blank line + Ctrl-D)
• :send TEXTFILE - Send contents of TEXTFILE
• :load JSONFILE - Load conversation from JSONFILE
• :save JSONFILE - Save conversation to JSONFILE
• :help - Show help
• :quit or Ctrl-D - Exit the program

Best Practices

1. For long sessions, periodically save with :save
2. Use :multiline for structured prompts (lists, code, etc.)
3. JSON files can be edited manually for prompt engineering

Contributing

Contributions are welcome! Please submit pull requests or open issues on the GitHub repository.

License

This project is licensed under the MIT License.