dendron 0.1.2

A library for working with LLMs and behavior trees.

🌳 Dendron

Installation

To install Dendron, run

pip install dendron

This will automatically install torch, transformers, bitsandbytes, accelerate, and sentencepiece, and protobuf. You should consider installing and using Flash Attention, which is just a pip install, but has prerequisites that you should manually check. It's worth it though - maybe doubling your inference speeds.

Behavior Trees for Structured Programming of LLMs

Here is an example behavior tree that implements a chat agent:

You can build this agent by following the tutorial here.

Examples

For examples of basic language model node usage, see the example notebooks in this repository. For larger and more interesting examples, see the examples repo.

Documentation

You can find the main documentation for Dendron here. This includes a full tutorial building a chat agent that has text-to-speech and automatic speech recognition capabilities, and an API reference.

Acknowledgements

This work was supported in part by the Federal Transit Administration and the Regional Transportation Commission of Washoe County.