remoteinference 0.0.2

Remote inference for language models

llm_inference

Simple package to perform remote inference on language models of different providers.

getting started

Install the package

pip install remoteinference

If you have a LLM running on a remote server using llama.cpp for example you can initalize the model by running