Skip to main content

ms_flow

In-process, desktop-first, domain-agnostic orchestrator for massive data flows: jobs, executors and persistence in the same process as your app — no broker, no daemon, no server. Works from a Qt app, a notebook or a plain script.

workers.py (tasks and jobs live in a module the workers can import):

from sqlmodel import Field, SQLModel

from ms_flow import job, table_sink, task


class Result(SQLModel, table=True):      # the project creates this table when it opens
    __tablename__ = "results"
    id: int | None = Field(default=None, primary_key=True)
    value: int
    double_value: int


@task()
def double_value(value: int) -> dict:
    return {"value": value, "double_value": 2 * value}


@job(task=double_value, output=table_sink("results", columns=("value", "double_value")))
def double_values(params, project):
    yield from range(1000)

run.py:

from ms_flow import Workspace
from workers import Result, double_values

ms = Workspace(app_id="demo")
try:
    ms.create_or_open_project(name="demo", folder="./demo_project", activate=True)
    print(ms.engine.wait(ms.submit(double_values)).status)   # completed
    print(ms.project_db.count(Result))                       # 1000
finally:
    ms.shutdown()

Install

pip install ms_flow            # engine + projects: SQLite and loky

Documentation

https://molsuite.github.io/ms_flow/: a guide to tasks, jobs, sinks, following and continuing jobs and where they run, and the API reference.

Status

Beta. The public API (ms_flow, ms_flow.api, ms_flow.engine) is the stable surface; ms_flow.core.* may change without notice.

License

MIT — see LICENSE.

Metadata

Release files for ms-flow 0.11.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for ms-flow 0.11.0
File Size Uploaded Provenance Actions
ms_flow-0.11.0.tar.gz 300.2 kB With provenance Details for ms_flow-0.11.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for ms-flow 0.11.0
File Interpreter ABI Platform Actions
ms_flow-0.11.0-py3-none-any.whl Python 3 none any Details for ms_flow-0.11.0-py3-none-any.whl

Total release size: 525.9 kB

Release files / ms_flow-0.11.0.tar.gz

Download URL ms_flow-0.11.0.tar.gz
Size 300.2 kB
Tags Source
SHA-256 checksum
How to use checksums
55e85586ba0ee178d93075cc312d442e1e7fa2999bcdb9b7885ff88e326e38e7
BLAKE2b-256 checksum
How to use checksums
b0b6b2038b3f1a918cefb18531ce054f1fed2c9983ff318c5c608522a4057b3d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 16, 2026.

Transparency log

Release files / ms_flow-0.11.0-py3-none-any.whl

Download URL ms_flow-0.11.0-py3-none-any.whl
Size 225.7 kB
Tags Python 3
SHA-256 checksum
How to use checksums
318e8328d1c8f31fe6f2329f8aa6b0e59a8595b535a3acb551a6186a3a6a99f0
BLAKE2b-256 checksum
How to use checksums
564c66a3c1bfdcd1c852b90bc73502a44d48128acd0abcb0bebb6168c125beb6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 16, 2026.

Transparency log

Security for ms-flow 0.11.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

Both files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for ms_flow-0.11.0.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 16, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page