simple-vertex-bridge 0.2.0

A simple Vertex AI proxy that automatically refresh tokens for you.

Simple Vertex Bridge

A simple Vertex AI proxy that automatically refresh tokens for you.

[中文]

Feature

• OpenAI style chat completion API with token attached
• OpenAI style model list API
• Automatically refresh tokens
• Stream output
• Reused h2 connection

Usage

Prerequisites

• Install uv.

Authentication

There are two ways to authenticate:

1. By gcloud CLI
   • Install gcloud CLI.
   • Run gcloud auth application-default login to authenticate.
2. By service account key
   • Create a service account key in the Google Cloud Console, according to this documentation.
   • Download the json key file.
   • Set the GOOGLE_APPLICATION_CREDENTIALS environment variable to the path of the key file.

Launch

• Note: svbridge-config.json will be created in the current directory.

1. You can run uvx simple-vertex-bridge to launch the bridge directly from pypi.
2. Or clone this repo and enter and run uv sync, then activate venv and run python svbridge.py.

Now your API is ready

• Model List: http://localhost:8086/v1/models, v1 can be omitted.
• API Endpoint: http://localhost:8086/v1/chat/completions, v1 can be omitted.
• API Key: anything, the bridge will replace it with the Vertex AI token.

License

The Unlicense.

TBH I dont care what you do with this code, just dont sue me if it breaks something. uwu