Pre-release

This release is a pre-release and may not be stable for production use.

elizaOS Local AI Plugin (Python)

Python implementation of the Local AI plugin for elizaOS, providing local LLM inference using llama.cpp.

Installation

pip install elizaos-plugin-local-ai

Requirements

Python 3.11+
llama-cpp-python
Model files (GGUF format)

Usage

from elizaos_plugin_local_ai import LocalAIPlugin, LocalAIConfig, TextGenerationParams

# Create configuration
config = LocalAIConfig(
    models_dir="/path/to/models",
    small_model="DeepHermes-3-Llama-3-3B-Preview-q4.gguf",
)

# Initialize plugin
plugin = LocalAIPlugin(config)

# Generate text
result = plugin.generate_text(TextGenerationParams(
    prompt="Tell me a joke",
    max_tokens=100,
))

print(result.text)

Configuration

Environment variables:

MODELS_DIR: Directory containing model files
CACHE_DIR: Directory for caching
LOCAL_SMALL_MODEL: Filename of small model
LOCAL_LARGE_MODEL: Filename of large model
LOCAL_EMBEDDING_MODEL: Filename of embedding model
LOCAL_EMBEDDING_DIMENSIONS: Embedding vector dimensions (default: 384)

License

MIT

Metadata

Release files for elizaos-plugin-local-ai 2.0.0a5

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for elizaos-plugin-local-ai 2.0.0a5
File	Size	Uploaded
elizaos_plugin_local_ai-2.0.0a5.tar.gz	7.7 kB	Mar 17, 2026	Details

Built distribution (wheel)

Table of built distributions (wheels) for elizaos-plugin-local-ai 2.0.0a5
File	Interpreter	ABI	Platform	Reset
elizaos_plugin_local_ai-2.0.0a5-py3-none-any.whl 8.4 kB Mar 17, 2026	Python 3	none	any	Details

Total release size: 16.1 kB

Release files / elizaos_plugin_local_ai-2.0.0a5.tar.gz

Download URL	elizaos_plugin_local_ai-2.0.0a5.tar.gz
Size	7.7 kB
Tags	Source
SHA-256 checksum How to use checksums	`a37397400a00111f55e665ef0acf44c56da1523dcf233c853e7e6826a7a50257`
BLAKE2b-256 checksum How to use checksums	`81b9d76eb993b7d1bd91ef5a93e5e05f340cdcaf63e23329798de7338ab0b324`
Upload date	Mar 17, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/6.2.0 CPython/3.12.10`

Release files / elizaos_plugin_local_ai-2.0.0a5-py3-none-any.whl

Download URL	elizaos_plugin_local_ai-2.0.0a5-py3-none-any.whl
Size	8.4 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`e2f18d9c9bba3893294f2965d1f56f38a455dee7e9fe2357824dd81300b16532`
BLAKE2b-256 checksum How to use checksums	`137eb625596adc0893d402035a948d3a7654586be8106ae46498f52ebbd5688a`
Upload date	Mar 17, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/6.2.0 CPython/3.12.10`

Release history Release notifications | RSS feed

This release

Pre-release

2.0.0a5 This release

Mar 17, 2026 2 release files

Pre-release

2.0.0a4

Feb 7, 2026 2 release files

elizaos-plugin-local-ai 2.0.0a5