Skip to main content

Python SDK for TongFlow — author plugins and run multi-modal GenAI workflows

Project description

tongflow

The Python SDK for TongFlow — an open-source, multi-modal GenAI workflow studio.

pip install tongflow gives you the tongflow import package. It has two uses:

  1. Run workflows — execute a workflow exported from the TongFlow canvas as an embedded engine, straight from Python (no desktop app needed).
  2. Author plugins — implement node capabilities against TongFlow's ABI contract.

Install

pip install tongflow

Requires Python 3.10+. The SDK is backend-neutral: it depends only on pydantic and typing_extensions, and never imports modal (or any other backend).

Run a workflow as an embedded engine

Build a flow on the TongFlow canvas, export it (Export Executable*.executable.json), then run it from Python:

from tongflow import run_workflow

result = run_workflow(
    "my-flow.executable.json",
    inputs={"input_ab12cd34": {"texts": ["a cute cat"]}},  # keyed by WorkflowInput.name
    auto_install=True,   # clone missing plugins + provision a shared venv
)

print(result["status"])            # "success" | "failed"
print(result["outputs"])           # {nodeId -> ABI output}
print(result["outputs_by_name"])   # {output name -> [values]}

run_workflow reads the exported plan (already topologically sorted, with resolved bindings and output routes), materializes asset inputs, spawns each plugin's local entry.py, and returns each node's output. With auto_install=True it clones any missing plugins ({org}/{pluginId}.git, default org https://github.com/tong-io; override per plugin via plugin_git_urls=) and installs tongflow plus each plugin's requirements.txt into a shared venv. It stays backend-neutral — a deploy-first plugin's entry.py deploys-once and invokes its remote backend.

Outputs are inline by default (inline_outputs=True): outputs and intermediate assets stay in memory, and binary results come back as {bytesBase64, mime, filename} — nothing is written for them. Pass inline_outputs=False (optionally with out_dir=) to spill binaries to disk and get file_key paths instead.

Where it writes to disk

Defaults follow the desktop app's per-user directory, so the SDK and the app share plugins/venv and the SDK does not pollute your working directory:

What Default location Override
Cloned plugins <user-data>/plugins plugins_dir= / TONGFLOW_PLUGINS_DIR
Shared plugin venv <user-data>/data/.tongflow/plugin-venv data_dir= / TONGFLOW_DATA_DIR
Binary outputs none by default (kept in memory) inline_outputs=False, out_dir=

<user-data> is ~/Library/Application Support/TongFlow (macOS), %APPDATA%\TongFlow (Windows), or $XDG_DATA_HOME/TongFlow (Linux).

Author a plugin

A plugin is a small Python package that implements one or more ABI node slots. Annotate each slot method with the generated types and mark it with @node_slot:

from tongflow.slots import node_slot
from tongflow.node_slots import NodeSlots
from tongflow.models.gen_text import GenTextInput, GenTextOutput

@node_slot(NodeSlots.GEN_TEXT)
def gen_text(input: GenTextInput) -> GenTextOutput:
    answer = my_llm(input.text)              # attribute access; types come from the ABI
    return GenTextOutput(success=True, text=answer)

The platform runs each plugin's entry.py, exchanging ABI JSON over stdin/stdout. @node_slot deep-constructs the incoming dict into a typed BaseModel and dumps your returned model back to a dict — plugin code never sees or produces a raw dict.

A plugin comes in one of two shapes, decided purely by its files (the scanner detects them from code — it does not look at the plugin's name):

  • Self-contained — ships an entry.py that does the work in-process.
  • Deploy-first — ships a deploy.py whose handler class is marked @deploy, plus a thin entry.py bridge (identical across deploy-first plugins — copy it from any reference plugin) that deploys once and invokes the remote backend, plus a requirements.txt for that backend. Example using Modal:
import modal
from pathlib import Path
from tongflow import deploy
from tongflow.slots import node_slot
from tongflow.node_slots import NodeSlots
from tongflow.models.gen_text import GenTextInput, GenTextOutput

app = modal.App(Path(__file__).resolve().parent.name)

@deploy                      # tongflow's backend-neutral marker; the scanner detects it via AST
@app.cls(...)
class Inference:
    @modal.method()
    @node_slot(NodeSlots.GEN_TEXT)
    def gen(self, input: GenTextInput) -> GenTextOutput: ...

Naming is a separate convention, unrelated to the two shapes above. Where the work actually runs (locally, on Modal, on another cloud) is the plugin's own concern, and the name prefix carries no execution meaning. Plugin repos are named tongflow-<label>-<name> — for example tongflow-api-openai or tongflow-modal-ltx. These are only naming examples; the prefix does not decide whether a plugin is self-contained or deploy-first.

Pin the SDK in your plugin's image build (pip_install("tongflow==0.1.0")) to match the version you develop against.

👉 Full plugin guide — directory layout, the ABI, generated model conventions, and how to publish: docs/plugins.md.

Build & publish (maintainers)

From the repo root:

export TWINE_USERNAME=__token__
export TWINE_PASSWORD=pypi-xxxxxxxx   # https://pypi.org/manage/account/token/
pnpm tongflow:publish

Runs scripts/publish-tongflow-pypi.sh (clean, python -m build, twine check, twine upload). Dry-run to TestPyPI with TONGFLOW_UPLOAD_TESTPYPI=1 pnpm tongflow:publish.

License

AGPL-3.0 — see LICENSE. The whole project is dual-licensed under AGPL-3.0 / a commercial license; see COMMERCIAL-LICENSE.md or contact business@tongflow.com.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tongflow-0.2.4.tar.gz (66.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tongflow-0.2.4-py3-none-any.whl (82.8 kB view details)

Uploaded Python 3

File details

Details for the file tongflow-0.2.4.tar.gz.

File metadata

  • Download URL: tongflow-0.2.4.tar.gz
  • Upload date:
  • Size: 66.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.13

File hashes

Hashes for tongflow-0.2.4.tar.gz
Algorithm Hash digest
SHA256 79b197e5bb58fb2ea34720bc7d1a0e09e7c7d6f301759793563e6d87899c9363
MD5 58722155fcbf8cb38d35eee5f09863b2
BLAKE2b-256 0c3e40612e59ad64a7c68a4a16b367965a6d0c9d4cd5f45e6be4a9c2db1da592

See more details on using hashes here.

File details

Details for the file tongflow-0.2.4-py3-none-any.whl.

File metadata

  • Download URL: tongflow-0.2.4-py3-none-any.whl
  • Upload date:
  • Size: 82.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.13

File hashes

Hashes for tongflow-0.2.4-py3-none-any.whl
Algorithm Hash digest
SHA256 15e6bb9bdd85f68e39b227f62574ac67b76badc4321f2ef84e8ad8179ebdf574
MD5 9738f5030d0de3d7dbbda4e56a768268
BLAKE2b-256 a0aed7386ec7d1d6762eb230bc599e3ea27b91f0510df5fb2cab32f9a39c770d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page