Skip to main content

smg-grpc-proto

PyPI Python

Protocol Buffer definitions for SMG (Shepherd Model Gateway) gRPC services.

This package provides pre-compiled Python gRPC stubs for:

  • SGLang scheduler service (sglang_scheduler.proto)
  • SGLang encoder service (sglang_encoder.proto)
  • vLLM engine service (vllm_engine.proto)
  • TensorRT-LLM service (trtllm_service.proto)

Installation

pip install smg-grpc-proto

Requires grpcio>=1.81.1 and protobuf>=5.26.0.

Usage

from smg_grpc_proto import sglang_scheduler_pb2, sglang_scheduler_pb2_grpc
from smg_grpc_proto import sglang_encoder_pb2, sglang_encoder_pb2_grpc
from smg_grpc_proto import vllm_engine_pb2, vllm_engine_pb2_grpc
from smg_grpc_proto import trtllm_service_pb2, trtllm_service_pb2_grpc

Proto Source

The proto source files live in grpc_client/proto/ in the SMG repository. Python stubs are generated at build time using grpcio-tools and shipped in the wheel.

Development

To install in editable mode from the repo root:

pip install -e grpc_client/python/

For CI or environments where symlinks don't work:

mkdir -p grpc_client/python/smg_grpc_proto/proto
cp grpc_client/proto/*.proto grpc_client/python/smg_grpc_proto/proto/
pip install -e grpc_client/python/

Testing proto changes on a remote GPU machine

After editing .proto files locally, build a wheel and install it in the remote environment (e.g. vLLM):

# 1. Build wheel (regenerates Python stubs from latest .proto files)
cd grpc_client/python
# Copy proto files into the package tree (the repo uses a symlink which
# won't survive wheel packaging)
mkdir -p smg_grpc_proto/proto
cp ../proto/*.proto smg_grpc_proto/proto/
pip wheel . --no-deps -w dist/

# 2. Copy to remote
scp dist/smg_grpc_proto-*.whl remote-gpu:/tmp/

# 3. Install on remote (into vLLM's env or whichever env needs it)
pip install --force-reinstall /tmp/smg_grpc_proto-*.whl

No import changes are needed on the remote side — vLLM already imports from smg_grpc_proto.

License

Apache-2.0

Metadata

Release files for tokenspeed-smg-grpc-proto 0.4.14.post20260821

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for tokenspeed-smg-grpc-proto 0.4.14.post20260821
File Size Uploaded
tokenspeed_smg_grpc_proto-0.4.14.post20260821.tar.gz 28.9 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for tokenspeed-smg-grpc-proto 0.4.14.post20260821
File Interpreter ABI Platform
tokenspeed_smg_grpc_proto-0.4.14.post20260821-py3-none-any.whl Python 3 none any Details

Total release size: 126.1 kB

Release files / tokenspeed_smg_grpc_proto-0.4.14.post20260821.tar.gz

Download URL tokenspeed_smg_grpc_proto-0.4.14.post20260821.tar.gz
Size 28.9 kB
Tags Source
SHA-256 checksum
How to use checksums
6c05f1f66d98ce4fdd6844cc29c9cd7867e3e5e3aa8536a290d2d079e6a477af
BLAKE2b-256 checksum
How to use checksums
5a073895b7f969df80fd9f45c11830e58ed1f391eb8502438916d3f4bb98ae9b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Aug 21, 2026.

Transparency log

Release files / tokenspeed_smg_grpc_proto-0.4.14.post20260821-py3-none-any.whl

Download URL tokenspeed_smg_grpc_proto-0.4.14.post20260821-py3-none-any.whl
Size 97.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
c4cff237b941e8f1a83dce37753b639ab71a9b46ef51d0c9b0c6b990cb4bc636
BLAKE2b-256 checksum
How to use checksums
71bfb158353c9dcff559a6815fdffa9993e6acf5930f43fcf10ae2a50d6337b0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Aug 21, 2026.

Transparency log

Release history Release notifications | RSS feed

This release

0.4.14.post20260821 This release

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page