README.md

botrun_litellm

A wrapper for litellm with TAIDE configuration support.

Installation

pip install botrun_litellm

Usage

from botrun_litellm import botrun_litellm_completion

response = botrun_litellm_completion(
    messages=[{"role": "user", "content": "Hello!"}],
    model="openai/gpt-4"
)

Usage 2

from botrun_litellm import botrun_litellm_completion

response = botrun_litellm_completion(
    messages=[{"role": "user", "content": "Hello!"}],
    model="taide/openai/Llama3-TAIDE-LX-70B-Chat",
    api_base: "base_url",
    api_key: "api_key"

)

Environment Variables

The following environment variables are required:

TAIDE_BASE_URL: Base URL for TAIDE API
TAIDE_API_KEY: API key for TAIDE

Supported models

"taide/openai/Llama-3.1-405B-Instruct-FP8",
"taide/openai/Llama-3.1-70B",
"taide/openai/Llama-3.1-Nemotron-70B-Instruct",
"taide/openai/Llama3-TAIDE-LX-70B-Chat",
"taide/openai/TAIDE-LX-70B-Chat"

License

MIT License

export requirements.txt

poetry export -f requirements.txt --output requirements.txt --without-hashes --without-urls

Metadata

Release files for botrun-litellm 0.2.10

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for botrun-litellm 0.2.10
File	Size	Uploaded
botrun_litellm-0.2.10.tar.gz	79.7 kB	May 11, 2026	Details

Built distribution (wheel)

Table of built distributions (wheels) for botrun-litellm 0.2.10
File	Interpreter	ABI	Platform	Reset
botrun_litellm-0.2.10-py3-none-any.whl 3.9 kB May 11, 2026	Python 3	none	any	Details

Total release size: 83.6 kB

Release files / botrun_litellm-0.2.10.tar.gz

Download URL	botrun_litellm-0.2.10.tar.gz
Size	79.7 kB
Tags	Source
SHA-256 checksum How to use checksums	`114d992e5e000cee17b40fd4d44bdf265cf833ddfd1e4996e62f943c8024497e`
BLAKE2b-256 checksum How to use checksums	`0b4f83fba8dc28cd20af939a2c88713f27fafeeaba75e4e04e8cabbaf61f674f`
Upload date	May 11, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/6.2.0 CPython/3.11.15`

Release files / botrun_litellm-0.2.10-py3-none-any.whl

Download URL	botrun_litellm-0.2.10-py3-none-any.whl
Size	3.9 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`b931ef281168e00fb9621edf9a00df34bc6a34e650001f7e6bed16880836edb4`
BLAKE2b-256 checksum How to use checksums	`e6c3ed8f9fcb869381c03f56890ebb08e2d3eaaa3e484389725c65f526b9684e`
Upload date	May 11, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/6.2.0 CPython/3.11.15`