A package to easily make an LLM talk with itself forever.
Project description
The End is Never
A package to make an LLM talk with itself forever.
from thendisnever.thend import isnever
isnever()
Parameters
model_name
: The model to generate text with.- This is the default model.
- This must be a model compatible with AutoModelForCausalLM.
prompt
: The initial prompt for the model.- This is the inspiration for the default prompt.
max_memory_ratio
: The % of past tokens to remember.- This must be a real number between or equal to 0 and 1.
Notes
- When running
isnever()
for the first time, it will download the model and tokenizer from HuggingFace. This will take a while, but it only needs to be done once. - If you want to use the CPU (not recommended because it's slow, but it works), make sure you have PyTorch for CPU installed before installing this package.
Contributing
Check out this guide that describes how to create a package with Typer.
Before testing, make sure to update the version:
pyproject.toml
->tool.poetry
src/thendisnever/__init__.py
->__version__
And the dependencies:
pyproject.toml
->tool.poetry.dependencies
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
thendisnever-0.10.0.tar.gz
(4.9 kB
view hashes)
Built Distribution
Close
Hashes for thendisnever-0.10.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e4cbe03fc0458d8d66c2db7ff6c041c5c860f64dd60160744a14d66dae764a7b |
|
MD5 | d91fa0f522c2001b873eca27f2aecd58 |
|
BLAKE2b-256 | e6ab4c1799c47bc61362b64e645ecb2d39c760b22447f12efdc9d0778f98cb0d |