轻量级 LLM 应用可观测性 SDK — 调用追踪、提示词工程、批量处理
Project description
UltraFlow
轻量级 LLM 应用可观测性 SDK — 调用追踪、提示词工程、批量处理。
特性
- Prompty — 将
.prompty文件作为无状态函数执行(同步 / 异步 / 流式) - Tracing —
@trace装饰器自动采集调用树,业务代码零侵入 - 批量处理 —
FlowProcessor并发执行批量任务 - CLI —
uf init、uf new、uf run,快速上手
安装
pip install UltraFlow
快速开始
1. 初始化项目
uf init my-project
cd my-project
2. 执行 Prompty
from ultraflow import Prompty
translate = Prompty("translate.prompty")
result = translate(text="Hello, world!")
3. 添加调用追踪
from ultraflow import Prompty, configure_tracing, shutdown_tracing, trace
configure_tracing(endpoint="http://localhost:8031")
@trace(kind="flow")
def translate_flow(text: str) -> str:
prompty = Prompty("translate.prompty")
return prompty(text=text)
result = translate_flow(text="Hello!")
shutdown_tracing()
4. 批量处理
from ultraflow import Prompty, FlowProcessor
translate = Prompty("translate.prompty")
processor = FlowProcessor(translate, "data.json", max_workers=5)
results = processor.run()
CLI 命令
| 命令 | 说明 |
|---|---|
uf init [PROJECT] |
初始化项目,生成配置和示例 prompty |
uf new FLOW_NAME |
创建 .prompty + .json 模板 |
uf run FLOW_NAME |
运行流程(自动查找同名 .json) |
uf run FLOW -d DATA -w N |
指定数据文件和并发数 |
uf connection init |
生成连接配置模板 |
uf connection list |
显示当前生效的连接配置 |
License
MIT
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ultraflow-1.0.3.tar.gz
(20.0 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
ultraflow-1.0.3-py3-none-any.whl
(19.0 kB
view details)
File details
Details for the file ultraflow-1.0.3.tar.gz.
File metadata
- Download URL: ultraflow-1.0.3.tar.gz
- Upload date:
- Size: 20.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: pdm/2.26.7 CPython/3.12.11 Darwin/24.6.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
17d4c160ee6ba3b350d4ad48f9b6f6cc5c086b7e7eafcaf5f3e43e5dd9b1b074
|
|
| MD5 |
10ec9cb1f4f59a674cf7aef64469afd6
|
|
| BLAKE2b-256 |
cd901978e15a2147cb0612f53a034f894ab4436ec950463fdde8b0eff32063dc
|
File details
Details for the file ultraflow-1.0.3-py3-none-any.whl.
File metadata
- Download URL: ultraflow-1.0.3-py3-none-any.whl
- Upload date:
- Size: 19.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: pdm/2.26.7 CPython/3.12.11 Darwin/24.6.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2ab1386a01f99e9c8f009809dd9154561dc7b69e4af13948782d39f67328ceac
|
|
| MD5 |
e68cdcb450e97c205c94b37f89012bb6
|
|
| BLAKE2b-256 |
24448ce60280f11ca83c510bfa372a26c2c41483c544629a621fe52b86624c51
|