smg-grpc-proto

Protocol Buffer definitions for SMG (Shepherd Model Gateway) gRPC services.

This package provides pre-compiled Python gRPC stubs for:

SGLang scheduler service (sglang_scheduler.proto)
SGLang encoder service (sglang_encoder.proto)
vLLM engine service (vllm_engine.proto)
TensorRT-LLM service (trtllm_service.proto)

Installation

pip install smg-grpc-proto

Requires grpcio>=1.81.1 and protobuf>=5.26.0.

Usage

from smg_grpc_proto import sglang_scheduler_pb2, sglang_scheduler_pb2_grpc
from smg_grpc_proto import sglang_encoder_pb2, sglang_encoder_pb2_grpc
from smg_grpc_proto import vllm_engine_pb2, vllm_engine_pb2_grpc
from smg_grpc_proto import trtllm_service_pb2, trtllm_service_pb2_grpc

Proto Source

The proto source files live in grpc_client/proto/ in the SMG repository. Python stubs are generated at build time using grpcio-tools and shipped in the wheel.

Development

To install in editable mode from the repo root:

pip install -e grpc_client/python/

For CI or environments where symlinks don't work:

mkdir -p grpc_client/python/smg_grpc_proto/proto
cp grpc_client/proto/*.proto grpc_client/python/smg_grpc_proto/proto/
pip install -e grpc_client/python/

Testing proto changes on a remote GPU machine

After editing .proto files locally, build a wheel and install it in the remote environment (e.g. vLLM):

# 1. Build wheel (regenerates Python stubs from latest .proto files)
cd grpc_client/python
# Copy proto files into the package tree (the repo uses a symlink which
# won't survive wheel packaging)
mkdir -p smg_grpc_proto/proto
cp ../proto/*.proto smg_grpc_proto/proto/
pip wheel . --no-deps -w dist/

# 2. Copy to remote
scp dist/smg_grpc_proto-*.whl remote-gpu:/tmp/

# 3. Install on remote (into vLLM's env or whichever env needs it)
pip install --force-reinstall /tmp/smg_grpc_proto-*.whl

No import changes are needed on the remote side — vLLM already imports from smg_grpc_proto.

License

Apache-2.0

Metadata

Release files for smg-grpc-proto 0.4.19

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for smg-grpc-proto 0.4.19
File	Size	Uploaded
smg_grpc_proto-0.4.19.tar.gz	30.1 kB	Sep 20, 2026	Details

Built distribution (wheel)

Table of built distributions (wheels) for smg-grpc-proto 0.4.19
File	Interpreter	ABI	Platform	Reset
smg_grpc_proto-0.4.19-py3-none-any.whl 99.3 kB Sep 20, 2026	Python 3	none	any	Details

Total release size: 129.4 kB

Release files / smg_grpc_proto-0.4.19.tar.gz

Download URL	smg_grpc_proto-0.4.19.tar.gz
Size	30.1 kB
Tags	Source
SHA-256 checksum How to use checksums	`3df259eaaf16dbb7f44e3fb4d0b2da2fb4ee63be06d28b9be20a875a10d389cc`
BLAKE2b-256 checksum How to use checksums	`213378121f4c6100b5229f382553cc8c2f8b4b5ada526fa05b23aac20b7a3b50`
Upload date	Sep 20, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/7.0.0 CPython/3.12.14`

Release files / smg_grpc_proto-0.4.19-py3-none-any.whl

Download URL	smg_grpc_proto-0.4.19-py3-none-any.whl
Size	99.3 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`bae22889f445309d91b3b579a8820d271bbff82276364d23addd8e07260b2e30`
BLAKE2b-256 checksum How to use checksums	`33988c8da771cfdc7a543e9c7ea371abc421c62cc6a5c75ed80186a150455fe9`
Upload date	Sep 20, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/7.0.0 CPython/3.12.14`