Skip to main content

SAGE Edge aggregator shell - mounts LLM gateway under an optional prefix

Project description

SAGE Edge (L6 Aggregator)

Minimal FastAPI shell for mounting the LLM gateway with optional prefixing.

  • Default behavior mounts the LLM gateway at /, keeping /v1/* endpoints stable.
  • Optional llm_prefix (env/CLI) mounts the gateway under a custom path while preserving /healthz and /readyz at the edge level.
  • Edge health endpoints live at /healthz and /readyz regardless of mount path.
  • Uses SagePorts.EDGE_DEFAULT as the default port and respects XDG user paths for logs/PID files.

Quickstart

# Start in foreground (mount gateway at /)
python -m sage.edge.server --port 8899

# Start with prefix
python -m sage.edge.server --port 8899 --llm-prefix /llm

Design Notes

  • No backward-compat shims: imports should use sage.llm.gateway directly.
  • Uses get_user_paths() for runtime state and logs (no ~/.sage usage).
  • Intended as an opt-in shell; runtime behavior only changes when the edge server is started.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

isage_edge-0.2.0.0-py3-none-any.whl (10.5 kB view details)

Uploaded Python 3

File details

Details for the file isage_edge-0.2.0.0-py3-none-any.whl.

File metadata

  • Download URL: isage_edge-0.2.0.0-py3-none-any.whl
  • Upload date:
  • Size: 10.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.14

File hashes

Hashes for isage_edge-0.2.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 2f803e324a90827a1d3f82c41d41d7b0cddaef2ac86d8aba571d35a2d76fe70f
MD5 8059c51bcdaa48ee646bc41d94089d3d
BLAKE2b-256 6e847d8a7b4ec99fd81e7272132201692b84d59cc9099c249937757fcb2b0d1f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page