languru 0.1.2

The general purpose LLM app stacks.

Languru

The general-purpose LLM app stacks deploy AI services quickly and (stupidly) simply.

Getting Started

Install Languru:

pip install languru

Run agent server:

languru server run

Run llm action server:

languru llm run

Usage

from openai import OpenAI

client = OpenAI(base_url="http://localhost:8680/v1")
res = client.chat.completions.create(
    model="gpt-3.5-turbo",
    messages=[
        {"role": "system", "content": "You are a helpful assistant."},
        {"role": "user", "content": "Hello!"},
    ],
)
print(res)