thendisnever 0.1.0

A package to easily make an LLM talk with itself for eternity.

The End is Never

A package to make an LLM talk with itself for eternity.

from thendisnever.theend import isnever
isnever(
  model_name='Fredithefish/ScarletPajama-3B-HF', # Default LLM
  prompt='THE END IS NEVER THE END IS NEVER ', # Default prompt
  max_memory_ratio=0.25 # Default % of latest tokens to remember
)

Notes

• For the default LLM (which you can change as shown above), you'll need at least:
  • ~ 6GB of free disk space
  • ~ 15GB of RAM
• When running isnever() for the first time, it will download the model and tokenizer from HuggingFace. This will take a while, but it only needs to be done once.
• If you want to use the CPU (not recommended because it's slow, but it works), make sure you have PyTorch for CPU installed.

Contributing

1. Install poetry if necessary.

2. Create and setup the poetry environment:

   git clone https://github.com/andrewhinh/thendisnever.git
   cd thendisnever
   poetry shell
   poetry install
   

3. Make your changes, remembering to update in pyproject.toml the version in the tool.poetry section and the tool.poetry.dependencies section as necessary.

4. Build the package:

   poetry build
   

5. Add TestPyPI as a source:

   poetry config repositories.testpypi https://test.pypi.org/legacy/
   

6. Publish the package to TestPyPI:

   poetry publish -r testpypi
   

7. Test the package in a fresh environment:

   pip install --index-url https://test.pypi.org/simple/ --no-deps --upgrade thendisnever
   

8. Once confirmed to work, make a PR from a feature branch to main on GitHub.

9. Once PR is merged, email me to be added as a collaborator on PyPI.

10. Once added as a collaborator, publish the package to PyPI:

    poetry publish