Access large language models from the command-line
Project description
llm
Access large language models from the command-line
Installation
Install this tool using pip
:
pip install llm
You need an OpenAI API key, which should either be set in the OPENAI_API_KEY
environment variable, or saved in a plain text file called ~/.openai-api-key.txt
in your home directory.
Usage
The default command for this is llm chatgpt
- you can use llm
instead if you prefer.
To run a prompt:
llm 'Ten names for cheesecakes'
To stream the results a token at a time:
llm 'Ten names for cheesecakes' -s
To switch from ChatGPT 3.5 (the default) to GPT-4 if you have access:
llm 'Ten names for cheesecakes' -4
Pass --model <model name>
to use a different model.
Logging to SQLite
If a SQLite database file exists in ~/.llm/log.db
then the tool will log all prompts and responses to it.
You can create that file by running the init-db
command:
llm init-db
Now any prompts you run will be logged to that database.
To avoid logging a prompt, pass --no-log
or -n
to the command:
llm 'Ten names for cheesecakes' -n
Help
For help, run:
llm --help
You can also use:
python -m llm --help
Development
To contribute to this tool, first checkout the code. Then create a new virtual environment:
cd llm
python -m venv venv
source venv/bin/activate
Now install the dependencies and test dependencies:
pip install -e '.[test]'
To run the tests:
pytest
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.