Skip to main content

AISBF - AI Service Broker Framework || AI Should Be Free - A modular proxy server for managing multiple AI provider integrations

Project description

AISBF - AI Service Broker Framework || AI Should Be Free

A modular proxy server for managing multiple AI provider integrations with unified API interface. AISBF provides intelligent routing, load balancing, AI-assisted model selection, hosted model marketplaces, and multimodal Studio workflows across local and remote providers.


🌐 Try AISBF Now — No Installation Required!

➡️ Launch AISBF at https://aisbf.cloud

The fully hosted service is free to use. Just open your browser and start routing AI requests across all supported providers — no setup, no configuration, no API keys needed to get started.

Also available via TOR for privacy-first access: http://aisbfity4ud6nsht53tsh2iauaur2e4dah2gplcprnikyjpkg72vfjad.onion

AISBF Dashboard


Key Features

  • Multi-Provider Support: Unified interface for Google, OpenAI, Anthropic, Claude Code (OAuth2 or CLI), Ollama, Kiro, Kilocode, Codex, Qwen, CoderAI, and RunPod
  • CoderAI Broker Mode: NAT-friendly outbound WebSocket broker with provider-scoped registration tokens, persisted session metadata, direct dashboard status, and Studio endpoint forwarding
  • RunPod Runtime Management: Pod-backed, serverless-template, and public-catalog RunPod providers with runtime state persistence, startup polling, idle shutdown, and wrapper-mode delegation to OpenAI, Ollama, or CoderAI
  • AISBF Studio: Multimodal dashboard workspace for chat, image, video, audio, embedding, and 3D workflows with reusable characters, environments, voices, archives, and custom pipelines
  • Marketplace & References: Publish providers, models, rotations, and autoselects to a shared market, import them as locked references, and track listing analytics and revenue
  • Claude CLI Mode: When the claude binary is in PATH, requests are proxied through the official Anthropic CLI (claude -p) using each user's own account
  • Unified Wallet System: Fiat wallet with crypto/PayPal/Stripe top-ups and auto top-up for subscription renewals
  • Intelligent Routing: Weighted load balancing and AI-assisted model selection
  • Streaming Support: Full support for streaming responses from all providers
  • Web Dashboard: Complete configuration and management interface
  • Multi-User Support: Isolated configurations with role-based access control
  • Token Usage Analytics: Comprehensive analytics with cost estimation, broker telemetry, and export
  • Adaptive Rate Limiting: Learns from 429 responses for optimal request rates
  • Provider-Native Caching: 50-70% cost reduction with Anthropic, Google, and OpenAI caching
  • Context Management: Automatic condensation with 8+ methods when approaching limits
  • SSL/TLS & TOR: Built-in HTTPS with Let's Encrypt and TOR hidden service support
  • MCP Server: Model Context Protocol for remote agent integration

What's New Since 0.99.65

  • CoderAI broker telemetry and NAT traversal: Broker sessions now persist state across restarts, expose connection and performance telemetry in the dashboard, and support Studio-native proxying over WebSocket for remote or firewalled workers
  • RunPod provider support: AISBF can now manage RunPod pods, serverless templates, and public endpoints from the provider editor, including runtime refresh and protocol-aware delegation
  • Marketplace administration: Added dedicated market admin pages, publishing and settlement flows, user export filters, locked imported references, and improved search and ordering
  • Studio expansion: Added dashboard Studio bindings, multimodal function routing, reusable profile assets, custom pipelines, and admin/user scoped Studio persistence APIs
  • Operational hardening: Signup cleanup removes stale self-registered accounts after 14 days of inactivity, dashboard proxy path handling was normalized, and provider model caches are reused before refresh

Quick Start

Installation

From PyPI (Recommended)

pip install aisbf

From Source

python setup.py install

Usage

aisbf

Server starts on http://127.0.0.1:17765

Web Dashboard

Access the dashboard at http://localhost:17765/dashboard (default credentials: admin / admin)

Security — change the default password immediately. The default admin/admin credentials are publicly known. Open the dashboard → Settings → Change Password before exposing AISBF to any network. For HTTPS deployments, set the environment variable AISBF_HTTPS=true to mark session cookies as Secure.

The dashboard provides:

  • Provider configuration and API key management
  • RunPod runtime controls and CoderAI broker session monitoring
  • Rotation and autoselect model setup
  • Prompt security controls, Context Lens analytics, and NSFW/privacy routing filters
  • AISBF Studio multimodal workflows and pipeline bindings
  • User wallet management and top-up options
  • Token usage analytics, broker telemetry, and cost tracking
  • Marketplace publishing, importing, and administration
  • SSL/TLS and TOR configuration
  • Multi-user administration

Featured Capabilities

Market

  • Publish providers, single models, rotations, and autoselect configurations to the built-in AISBF marketplace
  • Import published resources as locked references instead of cloning their full configuration locally
  • Track listing activity, usage settlement, revenue, and admin-side market visibility from the dashboard

CoderAI

  • Use coderai providers in direct HTTP mode, direct WebSocket bridge mode, or NAT-friendly broker mode
  • Register remote workers with provider-scoped tokens and inspect broker session status from the dashboard
  • Forward Studio-native endpoints over the CoderAI bridge so chat, multimodal, and long-running jobs can work through the same connection

Security Filters

  • Enable prompt-security scanning to detect suspicious prompt patterns before upstream execution
  • Enable Context Lens analytics to capture prompt composition metadata, risk summaries, and redacted evidence
  • Enable NSFW and privacy classification so AISBF can route or restrict traffic based on content sensitivity
  • Optionally block high-risk prompts and keep persisted prompt text disabled by default while redaction remains enabled
  • Prompt analytics stay empty until Prompt Security or Context Lens Analytics is explicitly enabled in settings or resource overrides

API Usage

Basic Chat Completion

curl -X POST http://localhost:17765/api/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "openai/gpt-4",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Wallet Top-Up

curl -X POST http://localhost:17765/api/wallet/topup \
  -H "Content-Type: application/json" \
  -d '{
    "amount": 10.00,
    "currency": "USD",
    "payment_method": "stripe"
  }'

CoderAI Broker Session Status

curl http://localhost:17765/api/coderai/broker/sessions

Documentation

For complete documentation, configuration guides, and API reference:

🚀 Support AISBF - Your Donations Matter!

The project includes multiple donation options to support its development:

Ethereum Donation

ETH to 0xdA6dAb526515b5cb556d20269207D43fcc760E51

PayPal Donation

https://paypal.me/nexlab

Bitcoin Donation

Address: bc1qcpt2uutqkz4456j5r78rjm3gwq03h5fpwmcc5u

Author

Stefy Lanza stefy@nexlab.net

Repository

Official repository: https://git.nexlab.net/nexlab/aisbf.git

License

GNU General Public License v3.0

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

aisbf-0.99.78.tar.gz (1.7 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

aisbf-0.99.78-py3-none-any.whl (3.1 MB view details)

Uploaded Python 3

File details

Details for the file aisbf-0.99.78.tar.gz.

File metadata

  • Download URL: aisbf-0.99.78.tar.gz
  • Upload date:
  • Size: 1.7 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.7

File hashes

Hashes for aisbf-0.99.78.tar.gz
Algorithm Hash digest
SHA256 acd6d73655cf91d82a3a35e15f37040ac98ca8f2d1dda12cef2848f01b9f7393
MD5 98f8ac809d622d312ca5cbb0de427f11
BLAKE2b-256 e516e5f300a4038ce866f1ea069037af0e1ce3bf7e1f56cde81bc109da1e6dda

See more details on using hashes here.

File details

Details for the file aisbf-0.99.78-py3-none-any.whl.

File metadata

  • Download URL: aisbf-0.99.78-py3-none-any.whl
  • Upload date:
  • Size: 3.1 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.7

File hashes

Hashes for aisbf-0.99.78-py3-none-any.whl
Algorithm Hash digest
SHA256 aaa0647e5ba054d182d64fceab0aa516c6c9576db9dc5cc232f67e379ab31d81
MD5 aab082653aab1185b801f3eee2557773
BLAKE2b-256 7a97d7a475c8414c2c09f89833aba7c4e1db3528e269a86542e827dd8deb1945

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page