轻量级 LLM 应用可观测性 SDK — 调用追踪、提示词工程、批量处理
Project description
UltraFlow
轻量级 LLM 应用可观测性 SDK — 调用追踪、提示词工程、批量处理。
特性
- Prompty — 将
.prompty文件作为无状态函数执行(同步 / 异步 / 流式) - Tracing —
@trace装饰器自动采集调用树,业务代码零侵入 - 批量处理 —
FlowProcessor并发执行批量任务 - CLI —
uf init、uf new、uf run,快速上手
安装
pip install UltraFlow
快速开始
1. 初始化项目
uf init my-project
cd my-project
2. 执行 Prompty
from ultraflow import Prompty
translate = Prompty("translate.prompty")
result = translate(text="Hello, world!")
3. 添加调用追踪
from ultraflow import Prompty, configure_tracing, shutdown_tracing, trace
configure_tracing(endpoint="http://localhost:8031")
@trace(kind="flow")
def translate_flow(text: str) -> str:
prompty = Prompty("translate.prompty")
return prompty(text=text)
result = translate_flow(text="Hello!")
shutdown_tracing()
4. 批量处理
from ultraflow import Prompty, FlowProcessor
translate = Prompty("translate.prompty")
processor = FlowProcessor(translate, "data.json", max_workers=5)
results = processor.run()
CLI 命令
| 命令 | 说明 |
|---|---|
uf init [PROJECT] |
初始化项目,生成配置和示例 prompty |
uf new FLOW_NAME |
创建 .prompty + .json 模板 |
uf run FLOW_NAME |
运行流程(自动查找同名 .json) |
uf run FLOW -d DATA -w N |
指定数据文件和并发数 |
uf connection init |
生成连接配置模板 |
uf connection list |
显示当前生效的连接配置 |
License
MIT
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ultraflow-1.0.0.tar.gz
(20.0 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
ultraflow-1.0.0-py3-none-any.whl
(19.0 kB
view details)
File details
Details for the file ultraflow-1.0.0.tar.gz.
File metadata
- Download URL: ultraflow-1.0.0.tar.gz
- Upload date:
- Size: 20.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: pdm/2.26.7 CPython/3.12.11 Darwin/24.6.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
66d237b8fd010bc32ac95f421ce7da83d15601e82d33d725461ee4ca55ce6c0a
|
|
| MD5 |
4a93e51267ea5bf2af290fdc8fcddb60
|
|
| BLAKE2b-256 |
880757d556e97dbc92ff078cdc0ce5e4dd959b6d67ba5d546c2095767a2c5110
|
File details
Details for the file ultraflow-1.0.0-py3-none-any.whl.
File metadata
- Download URL: ultraflow-1.0.0-py3-none-any.whl
- Upload date:
- Size: 19.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: pdm/2.26.7 CPython/3.12.11 Darwin/24.6.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3e7b75929a9e4167dd5fb36e7472eb14b387f2cbea989f9ba359a4507b5b0622
|
|
| MD5 |
aab7fabc6b4a4a54ea4af0f64d8b38f5
|
|
| BLAKE2b-256 |
2a98d6eed8daaeaf03cd1b5480313cbd7cab131a948eb35b0ecd486e84642629
|