Skip to main content

processfork-sglang

ProcessFork plugin for SGLang ≥0.5. Snapshot / fork / checkout endpoints that preserve RadixAttention prefix-sharing across restores.

Install

pip install "processfork-sglang[sglang]"

Use

python -m sglang.launch_server \
  --model meta-llama/Llama-3-8B \
  --plugin processfork \
  --deterministic-mode

Endpoints (matching the vLLM plugin's surface):

POST /processfork/snapshot
POST /processfork/fork
POST /processfork/checkout
POST /processfork/merge

The plugin maps SGLang's mem_pool.req_to_token_pool onto the paged-batchinvariant-v1 LogicalSeq array, so prefix-sharing survives across snapshot/restore.

Bit-exact restore requires --deterministic-mode.

Status

The trait surface and wire format are stable. The live FFI shim into sglang.srt.mem_cache.RadixCache lands in v1.0.1 alongside the vLLM adapter. Until then, the plugin's HTTP surface returns 501 with a clear pointer to this README.

Metadata

Release files for processfork-sglang 1.0.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for processfork-sglang 1.0.3
File Size Uploaded Provenance
processfork_sglang-1.0.3.tar.gz 6.8 kB With provenance Details

Built distribution (wheel)

Table of built distributions (wheels) for processfork-sglang 1.0.3
File Interpreter ABI Platform
processfork_sglang-1.0.3-py3-none-any.whl Python 3 none any Details

Total release size: 12.9 kB

Release files / processfork_sglang-1.0.3.tar.gz

Download URL processfork_sglang-1.0.3.tar.gz
Size 6.8 kB
Tags Source
SHA-256 checksum
How to use checksums
8178d3bd1a3a5f5e0ef199ea4c1af99cae95095da0830ae2dd0d3f3ecf4e715e
BLAKE2b-256 checksum
How to use checksums
65ecb8d0193db8012f7fcc3418e0a9a58af371c688aef989b871fc2b664d7223
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.12

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on May 6, 2026.

Transparency log

Release files / processfork_sglang-1.0.3-py3-none-any.whl

Download URL processfork_sglang-1.0.3-py3-none-any.whl
Size 6.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
0a5e5d25084339cd6736bf791b9acf2f5886fc761722cd076527eba53cc42dd7
BLAKE2b-256 checksum
How to use checksums
f4236784eda349f1ac00748c129c9341c3777da096d409219684f703f8f0a4f8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.12

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on May 6, 2026.

Transparency log

Security for processfork-sglang 1.0.3

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

All 2 files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for processfork_sglang-1.0.3.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on May 6, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page