lite ai client
Project description
LiteAI
提供比LiteLLM更简洁、范围更广的API,并支持更多的AI模型。
- 增加国内厂商的sdk接入
- 增加embedding/agent等接口
- 简化模型的输入输出信息,方便下游处理
厂商 | chat | 流式chat | Image输入 | Image输出 | Embedding | ToolUse | TTS | ASR |
---|---|---|---|---|---|---|---|---|
ZhipuAI | ✅ | ✅ | ✅ | ✅ | ✅ | |||
Qwen | ✅ | ✅ | ✅ | |||||
OpenAI | ✅ | ✅ | ||||||
Doubao | ✅ | ✅ | ||||||
MiniMax | ✅ | ✅ | ✅ | |||||
Xunfei | ✅ | |||||||
Ollama | ✅ | ✅ | ||||||
SiliconFlow | ✅ | ✅ |
Install
pip install -U liteai
批量请求模型
liteai batch \
-d liteai/data/batch_test.jsonl \
-m glm-4v \
-w 2 \
--input_column text \
--image_column image \
--image_dir liteai/data \
--system "用英文回答" \
--output_path output/bath_test_glm4v.xlsx
具体参数定义使用
bash liteai batch --help
查看
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
liteai-0.2.0.tar.gz
(357.4 kB
view hashes)
Built Distribution
liteai-0.2.0-py3-none-any.whl
(32.3 kB
view hashes)