4 projects
vllm-grpc-proxy
REST-to-gRPC proxy server for the vllm-grpc frontend
vllm-grpc-gen
Generated protobuf/gRPC stubs for the vllm-grpc frontend, proxy, and client
vllm-grpc-frontend
gRPC frontend server exposing vLLM's V1 engine over protobuf/gRPC
vllm-grpc-client
Lean async gRPC client for the vllm-grpc frontend
