smg-grpc-proto

Protocol Buffer definitions for SMG (Shepherd Model Gateway) gRPC services.

This package provides pre-compiled Python gRPC stubs for:

SGLang scheduler service (sglang_scheduler.proto)
SGLang encoder service (sglang_encoder.proto)
vLLM engine service (vllm_engine.proto)
TensorRT-LLM service (trtllm_service.proto)

Installation

pip install smg-grpc-proto

Requires grpcio>=1.81.1 and protobuf>=5.26.0.

Usage

from smg_grpc_proto import sglang_scheduler_pb2, sglang_scheduler_pb2_grpc
from smg_grpc_proto import sglang_encoder_pb2, sglang_encoder_pb2_grpc
from smg_grpc_proto import vllm_engine_pb2, vllm_engine_pb2_grpc
from smg_grpc_proto import trtllm_service_pb2, trtllm_service_pb2_grpc

Proto Source

The proto source files live in grpc_client/proto/ in the SMG repository. Python stubs are generated at build time using grpcio-tools and shipped in the wheel.

Development

To install in editable mode from the repo root:

pip install -e grpc_client/python/

For CI or environments where symlinks don't work:

mkdir -p grpc_client/python/smg_grpc_proto/proto
cp grpc_client/proto/*.proto grpc_client/python/smg_grpc_proto/proto/
pip install -e grpc_client/python/

Testing proto changes on a remote GPU machine

After editing .proto files locally, build a wheel and install it in the remote environment (e.g. vLLM):

# 1. Build wheel (regenerates Python stubs from latest .proto files)
cd grpc_client/python
# Copy proto files into the package tree (the repo uses a symlink which
# won't survive wheel packaging)
mkdir -p smg_grpc_proto/proto
cp ../proto/*.proto smg_grpc_proto/proto/
pip wheel . --no-deps -w dist/

# 2. Copy to remote
scp dist/smg_grpc_proto-*.whl remote-gpu:/tmp/

# 3. Install on remote (into vLLM's env or whichever env needs it)
pip install --force-reinstall /tmp/smg_grpc_proto-*.whl

No import changes are needed on the remote side — vLLM already imports from smg_grpc_proto.

License

Apache-2.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tokenspeed_smg_grpc_proto-0.4.14.post20260820.tar.gz (28.9 kB view details)

Uploaded Aug 20, 2026 Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

The dropdown lists show the available interpreters, ABIs, and platforms. Enable javascript to be able to filter the list of wheel files.

tokenspeed_smg_grpc_proto-0.4.14.post20260820-py3-none-any.whl (97.1 kB view details)

Uploaded Aug 20, 2026 Python 3

File details

Details for the file tokenspeed_smg_grpc_proto-0.4.14.post20260820.tar.gz.

File metadata

Download URL: tokenspeed_smg_grpc_proto-0.4.14.post20260820.tar.gz
Upload date: Aug 20, 2026
Size: 28.9 kB
Tags: Source
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for tokenspeed_smg_grpc_proto-0.4.14.post20260820.tar.gz
Algorithm	Hash digest
SHA256	`846da8e67be8a0f57954bd14c85529b74543188a2dbf5d91a07611dcec052418`
MD5	`93e5b40f26a3e5338f5764dd75838657`
BLAKE2b-256	`81f844f687aa7a6059a5b2241872f4e17e04424171e0344b805383d393b476eb`

See more details on using hashes here.

Provenance

The following attestation bundles were made for tokenspeed_smg_grpc_proto-0.4.14.post20260820.tar.gz:

Publisher: tokenspeed-smg-grpc-proto.yml on lightseekorg/tokenspeed-third-party

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: tokenspeed_smg_grpc_proto-0.4.14.post20260820.tar.gz
- Subject digest: 846da8e67be8a0f57954bd14c85529b74543188a2dbf5d91a07611dcec052418
- Sigstore transparency entry: 2537303358
- Sigstore integration time: Aug 20, 2026
Source repository:
- Permalink: lightseekorg/tokenspeed-third-party@b607bfb47e3b8d4102276681f3bce1ccf1ff77ca
- Branch / Tag: refs/heads/main
- Owner: https://github.com/lightseekorg
- Access: private
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: tokenspeed-smg-grpc-proto.yml@b607bfb47e3b8d4102276681f3bce1ccf1ff77ca
- Trigger Event: workflow_dispatch