Skip to main content

SAGE Edge aggregator shell - mounts LLM gateway under an optional prefix

Project description

SAGE Edge (L6 Aggregator)

Minimal FastAPI shell for mounting the LLM gateway with optional prefixing.

  • Default behavior mounts the LLM gateway at /, keeping /v1/* endpoints stable.
  • Optional llm_prefix (env/CLI) mounts the gateway under a custom path while preserving /healthz and /readyz at the edge level.
  • Edge health endpoints live at /healthz and /readyz regardless of mount path.
  • Uses SagePorts.EDGE_DEFAULT as the default port and respects XDG user paths for logs/PID files.

Quickstart

# Start in foreground (mount gateway at /)
python -m sage.edge.server --port 8899

# Start with prefix
python -m sage.edge.server --port 8899 --llm-prefix /llm

Design Notes

  • No backward-compat shims: imports should use sage.llm.gateway directly.
  • Uses get_user_paths() for runtime state and logs (no ~/.sage usage).
  • Intended as an opt-in shell; runtime behavior only changes when the edge server is started.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

isage_edge-0.2.0.1-cp311-none-any.whl (4.7 kB view details)

Uploaded CPython 3.11

File details

Details for the file isage_edge-0.2.0.1-cp311-none-any.whl.

File metadata

  • Download URL: isage_edge-0.2.0.1-cp311-none-any.whl
  • Upload date:
  • Size: 4.7 kB
  • Tags: CPython 3.11
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.14

File hashes

Hashes for isage_edge-0.2.0.1-cp311-none-any.whl
Algorithm Hash digest
SHA256 b1774ecbd46f56d72c37782ae56259af43a9389ada1feb1747030506e33e14c5
MD5 68334e0eddf25019face235c62216f1a
BLAKE2b-256 b067b7025b6567a345efd8ee7490557d9475a9e2021649cdf1bdf636685c6ada

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page