xyberos-llm-providers

Remaining LLM providers plugin — RFC-0019, M6. Thin configs, no new architecture. The long tail of OpenAI-compatible providers are covered by presets over the core OpenAICompatibleLLM; Azure OpenAI, AWS Bedrock and Google Vertex AI get dedicated LLMProvider adapters.

Install

pip install xyberos-llm-providers     # from PyPI
pip install "xyberos-llm-providers[llm_providers]"  # optional: boto3 + google-auth for Bedrock/Vertex

# development (editable, from this repo):
pip install -e ./llm-providers
# (also available as the core extra):
pip install xyberos[llm-providers]

Provider presets (OpenAI-compatible — one line each)

from xyberos_llm_providers import get_llm
llm = get_llm("groq")                      # key from GROQ_API_KEY
print(llm.generate("Say hi"))

Dedicated adapters

• Azure OpenAI — AzureOpenAILLM(deployment, endpoint=..., api_key=...) posts to the Azure deployments endpoint with an api-key header (AZURE_OPENAI_ENDPOINT, AZURE_OPENAI_API_KEY, AZURE_OPENAI_DEPLOYMENT).
• AWS Bedrock — BedrockLLM(model_id) over bedrock-runtime.converse (lazy boto3; region from AWS_REGION/AWS_DEFAULT_REGION).
• Google Vertex AI — VertexAILlm(model, project=...) over the generateContent REST API (lazy google-auth token; VERTEX_AI_PROJECT/GOOGLE_CLOUD_PROJECT).

Plugin usage

from xyberos import create_app
from xyberos_llm_providers import LlmProvidersPlugin

app = create_app()
app.load_plugin(LlmProvidersPlugin(provider="deepseek"))   # or set LLM_PROVIDER=deepseek
print(app.llm.generate("Say hi"))

provider accepts a preset name or azure_openai / bedrock / vertex. An unconfigured plugin registers nothing (logs a warning); calling plugin.llm() directly surfaces misconfiguration errors.

Examples

• examples/llm_providers.py — lists presets and runs one; --stub for a no-network demo, otherwise a real call.

Tests

pip install pytest
pytest tests/

All adapters are tested against stub transports / fake clients — no network, no SDKs required. Bedrock/Vertex lazy-import tests skip when their SDK is present.

Ship location

Plugin (xyberos.plugins entry point) / [llm-providers] extra. One LLMProvider contract; providers are implementations of it.