llmlib 0.2.0

Portability lib for OpenAI, Hugging Face, and FastChat local model APIs

Portability lib for OpenAI, Hugging Face, and FastChat local model APIs

This library was written for examples in a book I wrote

You can read my book free online or can be purchased:

Safe For Humans AI - A "humans-first" approach to designing and building AI systems

Supported APIs

• get_completion(prompt, max_tokens=64)
• create_local_embeddings_files_in_dir(path_to_document_files_dir)
• query_local_embeddings(query)

These APIs are implemented separately in two Python classes:

• OpenAiWrapper
• HuggingFaceAiWrapper

Supported APIs and Models

Currently this compatibiolity library only works with selected OpenAI APIs and the small Hugging Face model facebook/opt-iml-1.3b that can be run locally on a laptop with no GPU and only 8G of RAM.

Run the example programs:

python test_completion_openai.py
python test_local_index_openai.py
python test_completion_hf.py
python test_local_index_hf.py