A simple library for interfacing with language models.
Project description
langdash
A simple library for interfacing with language models.
Currently in alpha!
Features:
- Support for text generation, text classification (through prompting) and vector-based document searching.
- Lightweight, build-it-yourself-style prompt wrappers.
- Token healing and transformers/RNN state reuse for fast inference, like in Microsoft's guidance.
- First-class support for ggml backends.
Documentation: Read on readthedocs.io
Repository: main / Gitlab mirror
Installation
Use pip to install. By default, langdash does not come preinstalled with any additional modules. You will have to specify what you need like in the following command:
pip install --user langdash[embeddings,sentence_transformers]
List of modules:
- core:
- embeddings: required for running searching through embeddings
- backends:
- Generation backends: rwkv_cpp, llama_cpp, ctransformers (alpha), transformers
- Embedding backends: sentence_transformers
Note: If running from source, initialize the git submodules in the langdash/extern
folder to compile foreign backends.
Usage
Examples:
See examples folder for full examples.
License
Apache 2.0
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
langdash-1.3.2b0.tar.gz
(27.4 kB
view hashes)