轻量级 LLM 应用可观测性 SDK — 调用追踪、提示词工程、批量处理
Project description
UltraFlow
轻量级 LLM 应用可观测性 SDK — 调用追踪、提示词工程、批量处理。
特性
- Prompty — 将
.prompty文件作为无状态函数执行(同步 / 异步 / 流式) - Tracing —
@trace装饰器自动采集调用树,业务代码零侵入 - 批量处理 —
FlowProcessor并发执行批量任务 - CLI —
uf init、uf new、uf run,快速上手
安装
pip install UltraFlow
快速开始
1. 初始化项目
uf init my-project
cd my-project
2. 执行 Prompty
from ultraflow import Prompty
translate = Prompty("translate.prompty")
result = translate(text="Hello, world!")
3. 添加调用追踪
from ultraflow import Prompty, configure_tracing, shutdown_tracing, trace
configure_tracing(endpoint="http://localhost:8031")
@trace(kind="flow")
def translate_flow(text: str) -> str:
prompty = Prompty("translate.prompty")
return prompty(text=text)
result = translate_flow(text="Hello!")
shutdown_tracing()
4. 批量处理
from ultraflow import Prompty, FlowProcessor
translate = Prompty("translate.prompty")
processor = FlowProcessor(translate, "data.json", max_workers=5)
results = processor.run()
CLI 命令
| 命令 | 说明 |
|---|---|
uf init [PROJECT] |
初始化项目,生成配置和示例 prompty |
uf new FLOW_NAME |
创建 .prompty + .json 模板 |
uf run FLOW_NAME |
运行流程(自动查找同名 .json) |
uf run FLOW -d DATA -w N |
指定数据文件和并发数 |
uf connection init |
生成连接配置模板 |
uf connection list |
显示当前生效的连接配置 |
License
MIT
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ultraflow-1.0.1.tar.gz
(20.0 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
ultraflow-1.0.1-py3-none-any.whl
(19.0 kB
view details)
File details
Details for the file ultraflow-1.0.1.tar.gz.
File metadata
- Download URL: ultraflow-1.0.1.tar.gz
- Upload date:
- Size: 20.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: pdm/2.26.7 CPython/3.12.11 Darwin/24.6.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c48c2bbbbd8352e7dc2be9554473dde490f3c9479d1e49145a8cb47955829de6
|
|
| MD5 |
95b521ac8e47235b0c78b7f23017c29a
|
|
| BLAKE2b-256 |
a0ff1d71061f666ae1c5ac5679ccf35ab20cc8fc1ac5685c6c8f3f187ff60977
|
File details
Details for the file ultraflow-1.0.1-py3-none-any.whl.
File metadata
- Download URL: ultraflow-1.0.1-py3-none-any.whl
- Upload date:
- Size: 19.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: pdm/2.26.7 CPython/3.12.11 Darwin/24.6.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
5f89c1b8dfb753e819e355649760b4e2da03b5b5e7d7a3f58ca9a6bb4e9d84a0
|
|
| MD5 |
42dd0d82c0134230c92da288c7fae118
|
|
| BLAKE2b-256 |
2b642435991e93fed80c671519043b5c46d326036558d50ee414ab3b57ca53e2
|