Skip to main content

AISBF - AI Service Broker Framework || AI Should Be Free - A modular proxy server for managing multiple AI provider integrations

Project description

AISBF - AI Service Broker Framework || AI Should Be Free

A modular proxy server for managing multiple AI provider integrations with unified API interface. AISBF provides intelligent routing, load balancing, AI-assisted model selection, hosted model marketplaces, and multimodal Studio workflows across local and remote providers.


🌐 Try AISBF Now — No Installation Required!

➡️ Launch AISBF at https://aisbf.cloud

The fully hosted service is free to use. Just open your browser and start routing AI requests across all supported providers — no setup, no configuration, no API keys needed to get started.

Also available via TOR for privacy-first access: http://aisbfity4ud6nsht53tsh2iauaur2e4dah2gplcprnikyjpkg72vfjad.onion

AISBF Dashboard


Key Features

  • Multi-Provider Support: Unified interface for Google, OpenAI, Anthropic, Claude Code (OAuth2 or CLI), Ollama, Kiro, Kilocode, Codex, Qwen, CoderAI, and RunPod
  • CoderAI Broker Mode: NAT-friendly outbound WebSocket broker with provider-scoped registration tokens, persisted session metadata, direct dashboard status, and Studio endpoint forwarding
  • RunPod Runtime Management: Pod-backed, serverless-template, and public-catalog RunPod providers with runtime state persistence, startup polling, idle shutdown, and wrapper-mode delegation to OpenAI, Ollama, or CoderAI
  • AISBF Studio: Multimodal dashboard workspace for chat, image, video, audio, embedding, and 3D workflows with reusable characters, environments, voices, archives, and custom pipelines
  • Marketplace & References: Publish providers, models, rotations, and autoselects to a shared market, import them as locked references, and track listing analytics and revenue
  • Claude CLI Mode: When the claude binary is in PATH, requests are proxied through the official Anthropic CLI (claude -p) using each user's own account
  • Unified Wallet System: Fiat wallet with crypto/PayPal/Stripe top-ups and auto top-up for subscription renewals
  • Intelligent Routing: Weighted load balancing and AI-assisted model selection
  • Streaming Support: Full support for streaming responses from all providers
  • Web Dashboard: Complete configuration and management interface
  • Multi-User Support: Isolated configurations with role-based access control
  • Token Usage Analytics: Comprehensive analytics with cost estimation, broker telemetry, and export
  • Adaptive Rate Limiting: Learns from 429 responses for optimal request rates
  • Provider-Native Caching: 50-70% cost reduction with Anthropic, Google, and OpenAI caching
  • Context Management: Automatic condensation with 8+ methods when approaching limits
  • SSL/TLS & TOR: Built-in HTTPS with Let's Encrypt and TOR hidden service support
  • MCP Server: Model Context Protocol for remote agent integration

What's New Since 0.99.65

  • CoderAI broker telemetry and NAT traversal: Broker sessions now persist state across restarts, expose connection and performance telemetry in the dashboard, and support Studio-native proxying over WebSocket for remote or firewalled workers
  • RunPod provider support: AISBF can now manage RunPod pods, serverless templates, and public endpoints from the provider editor, including runtime refresh and protocol-aware delegation
  • Marketplace administration: Added dedicated market admin pages, publishing and settlement flows, user export filters, locked imported references, and improved search and ordering
  • Studio expansion: Added dashboard Studio bindings, multimodal function routing, reusable profile assets, custom pipelines, and admin/user scoped Studio persistence APIs
  • Operational hardening: Signup cleanup removes stale self-registered accounts after 14 days of inactivity, dashboard proxy path handling was normalized, and provider model caches are reused before refresh

Quick Start

Installation

From PyPI (Recommended)

pip install aisbf

From Source

python setup.py install

Usage

aisbf

Server starts on http://127.0.0.1:17765

Web Dashboard

Access the dashboard at http://localhost:17765/dashboard (default credentials: admin / admin)

Security — change the default password immediately. The default admin/admin credentials are publicly known. Open the dashboard → Settings → Change Password before exposing AISBF to any network. For HTTPS deployments, set the environment variable AISBF_HTTPS=true to mark session cookies as Secure.

The dashboard provides:

  • Provider configuration and API key management
  • RunPod runtime controls and CoderAI broker session monitoring
  • Rotation and autoselect model setup
  • Prompt security controls, Context Lens analytics, and NSFW/privacy routing filters
  • AISBF Studio multimodal workflows and pipeline bindings
  • User wallet management and top-up options
  • Token usage analytics, broker telemetry, and cost tracking
  • Marketplace publishing, importing, and administration
  • SSL/TLS and TOR configuration
  • Multi-user administration

Featured Capabilities

Market

  • Publish providers, single models, rotations, and autoselect configurations to the built-in AISBF marketplace
  • Import published resources as locked references instead of cloning their full configuration locally
  • Track listing activity, usage settlement, revenue, and admin-side market visibility from the dashboard

CoderAI

  • Use coderai providers in direct HTTP mode, direct WebSocket bridge mode, or NAT-friendly broker mode
  • Register remote workers with provider-scoped tokens and inspect broker session status from the dashboard
  • Forward Studio-native endpoints over the CoderAI bridge so chat, multimodal, and long-running jobs can work through the same connection

Security Filters

  • Enable prompt-security scanning to detect suspicious prompt patterns before upstream execution
  • Enable Context Lens analytics to capture prompt composition metadata, risk summaries, and redacted evidence
  • Enable NSFW and privacy classification so AISBF can route or restrict traffic based on content sensitivity
  • Optionally block high-risk prompts and keep persisted prompt text disabled by default while redaction remains enabled
  • Prompt analytics stay empty until Prompt Security or Context Lens Analytics is explicitly enabled in settings or resource overrides

API Usage

Basic Chat Completion

curl -X POST http://localhost:17765/api/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "openai/gpt-4",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Wallet Top-Up

curl -X POST http://localhost:17765/api/wallet/topup \
  -H "Content-Type: application/json" \
  -d '{
    "amount": 10.00,
    "currency": "USD",
    "payment_method": "stripe"
  }'

CoderAI Broker Session Status

curl http://localhost:17765/api/coderai/broker/sessions

Documentation

For complete documentation, configuration guides, and API reference:

🚀 Support AISBF - Your Donations Matter!

The project includes multiple donation options to support its development:

Ethereum Donation

ETH to 0xdA6dAb526515b5cb556d20269207D43fcc760E51

PayPal Donation

https://paypal.me/nexlab

Bitcoin Donation

Address: bc1qcpt2uutqkz4456j5r78rjm3gwq03h5fpwmcc5u

Author

Stefy Lanza stefy@nexlab.net

Repository

Official repository: https://git.nexlab.net/nexlab/aisbf.git

License

GNU General Public License v3.0

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

aisbf-0.99.67.tar.gz (1.7 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

aisbf-0.99.67-py3-none-any.whl (3.1 MB view details)

Uploaded Python 3

File details

Details for the file aisbf-0.99.67.tar.gz.

File metadata

  • Download URL: aisbf-0.99.67.tar.gz
  • Upload date:
  • Size: 1.7 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.7

File hashes

Hashes for aisbf-0.99.67.tar.gz
Algorithm Hash digest
SHA256 0df2ccae3090e01bfe7d446125cda2296e392668aa94c3b4efbc749314fcdab8
MD5 692332fdf1fd3b8fa1132ecb91246627
BLAKE2b-256 cee924c738e8ce6c47d88a69a464a73465d4c81631d6e9148b6eee306b52dc0e

See more details on using hashes here.

File details

Details for the file aisbf-0.99.67-py3-none-any.whl.

File metadata

  • Download URL: aisbf-0.99.67-py3-none-any.whl
  • Upload date:
  • Size: 3.1 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.7

File hashes

Hashes for aisbf-0.99.67-py3-none-any.whl
Algorithm Hash digest
SHA256 6b788b77d08fdde76f6070106a2a9a28be551e9d610253e029d3f261b2fb8646
MD5 b90c11be48b91de127864a4d853eabd5
BLAKE2b-256 986d5c13ce642e6834465838b0fa70199e0c5ec08e8789a834d4c6686048761d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page