AISBF - AI Service Broker Framework || AI Should Be Free - A modular proxy server for managing multiple AI provider integrations
Project description
AISBF - AI Service Broker Framework || AI Should Be Free
A modular proxy server for managing multiple AI provider integrations with unified API interface. AISBF provides intelligent routing, load balancing, AI-assisted model selection, hosted model marketplaces, and multimodal Studio workflows across local and remote providers.
🌐 Try AISBF Now — No Installation Required!
➡️ Launch AISBF at https://aisbf.cloud
The fully hosted service is free to use. Just open your browser and start routing AI requests across all supported providers — no setup, no configuration, no API keys needed to get started.
Also available via TOR for privacy-first access: http://aisbfity4ud6nsht53tsh2iauaur2e4dah2gplcprnikyjpkg72vfjad.onion
Key Features
- Multi-Provider Support: Unified interface for Google, OpenAI, Anthropic, Claude Code (OAuth2 or CLI), Ollama, Kiro, Kilocode, Codex, Qwen, CoderAI, and RunPod
- CoderAI Broker Mode: NAT-friendly outbound WebSocket broker with provider-scoped registration tokens, persisted session metadata, direct dashboard status, and Studio endpoint forwarding
- RunPod Runtime Management: Pod-backed, serverless-template, and public-catalog RunPod providers with runtime state persistence, startup polling, idle shutdown, and wrapper-mode delegation to OpenAI, Ollama, or CoderAI
- AISBF Studio: Multimodal dashboard workspace for chat, image, video, audio, embedding, and 3D workflows with reusable characters, environments, voices, archives, and custom pipelines
- Marketplace & References: Publish providers, models, rotations, and autoselects to a shared market, import them as locked references, and track listing analytics and revenue
- Claude CLI Mode: When the
claudebinary is in PATH, requests are proxied through the official Anthropic CLI (claude -p) using each user's own account - Unified Wallet System: Fiat wallet with crypto/PayPal/Stripe top-ups and auto top-up for subscription renewals
- Intelligent Routing: Weighted load balancing and AI-assisted model selection
- Streaming Support: Full support for streaming responses from all providers
- Web Dashboard: Complete configuration and management interface
- Multi-User Support: Isolated configurations with role-based access control
- Token Usage Analytics: Comprehensive analytics with cost estimation, broker telemetry, and export
- Adaptive Rate Limiting: Learns from 429 responses for optimal request rates
- Provider-Native Caching: 50-70% cost reduction with Anthropic, Google, and OpenAI caching
- Context Management: Automatic condensation with 8+ methods when approaching limits
- SSL/TLS & TOR: Built-in HTTPS with Let's Encrypt and TOR hidden service support
- MCP Server: Model Context Protocol for remote agent integration
What's New Since 0.99.65
- CoderAI broker telemetry and NAT traversal: Broker sessions now persist state across restarts, expose connection and performance telemetry in the dashboard, and support Studio-native proxying over WebSocket for remote or firewalled workers
- RunPod provider support: AISBF can now manage RunPod pods, serverless templates, and public endpoints from the provider editor, including runtime refresh and protocol-aware delegation
- Marketplace administration: Added dedicated market admin pages, publishing and settlement flows, user export filters, locked imported references, and improved search and ordering
- Studio expansion: Added dashboard Studio bindings, multimodal function routing, reusable profile assets, custom pipelines, and admin/user scoped Studio persistence APIs
- Operational hardening: Signup cleanup removes stale self-registered accounts after 14 days of inactivity, dashboard proxy path handling was normalized, and provider model caches are reused before refresh
Quick Start
Installation
From PyPI (Recommended)
pip install aisbf
From Source
python setup.py install
Usage
aisbf
Server starts on http://127.0.0.1:17765
Web Dashboard
Access the dashboard at http://localhost:17765/dashboard (default credentials: admin / admin)
Security — change the default password immediately. The default
admin/admincredentials are publicly known. Open the dashboard → Settings → Change Password before exposing AISBF to any network. For HTTPS deployments, set the environment variableAISBF_HTTPS=trueto mark session cookies as Secure.
The dashboard provides:
- Provider configuration and API key management
- RunPod runtime controls and CoderAI broker session monitoring
- Rotation and autoselect model setup
- Prompt security controls, Context Lens analytics, and NSFW/privacy routing filters
- AISBF Studio multimodal workflows and pipeline bindings
- User wallet management and top-up options
- Token usage analytics, broker telemetry, and cost tracking
- Marketplace publishing, importing, and administration
- SSL/TLS and TOR configuration
- Multi-user administration
Featured Capabilities
Market
- Publish providers, single models, rotations, and autoselect configurations to the built-in AISBF marketplace
- Import published resources as locked references instead of cloning their full configuration locally
- Track listing activity, usage settlement, revenue, and admin-side market visibility from the dashboard
CoderAI
- Use
coderaiproviders in direct HTTP mode, direct WebSocket bridge mode, or NAT-friendly broker mode - Register remote workers with provider-scoped tokens and inspect broker session status from the dashboard
- Forward Studio-native endpoints over the CoderAI bridge so chat, multimodal, and long-running jobs can work through the same connection
Security Filters
- Enable prompt-security scanning to detect suspicious prompt patterns before upstream execution
- Enable Context Lens analytics to capture prompt composition metadata, risk summaries, and redacted evidence
- Enable NSFW and privacy classification so AISBF can route or restrict traffic based on content sensitivity
- Optionally block high-risk prompts and keep persisted prompt text disabled by default while redaction remains enabled
- Prompt analytics stay empty until Prompt Security or Context Lens Analytics is explicitly enabled in settings or resource overrides
API Usage
Basic Chat Completion
curl -X POST http://localhost:17765/api/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"model": "openai/gpt-4",
"messages": [{"role": "user", "content": "Hello!"}]
}'
Wallet Top-Up
curl -X POST http://localhost:17765/api/wallet/topup \
-H "Content-Type: application/json" \
-d '{
"amount": 10.00,
"currency": "USD",
"payment_method": "stripe"
}'
CoderAI Broker Session Status
curl http://localhost:17765/api/coderai/broker/sessions
Documentation
For complete documentation, configuration guides, and API reference:
- 📚 Full Documentation - Comprehensive user and developer guide
- 🔧 Installation Guide - Detailed setup instructions
- ⚙️ Configuration - All configuration options
- 🛡️ Security Filters - Prompt security, Context Lens analytics, and content classification
- 🎛️ Studio Guide - Multimodal Studio, bindings, and pipelines
- 🛒 Marketplace - Publishing, imports, and settlements
- 🤖 CoderAI Broker - Broker protocol and integration reference
- 💰 Wallet System - Complete wallet documentation
- 🔌 API Reference - Complete API documentation
- 🛠️ Development - Development and deployment guides
🚀 Support AISBF - Your Donations Matter!
The project includes multiple donation options to support its development:
Ethereum Donation
ETH to 0xdA6dAb526515b5cb556d20269207D43fcc760E51
PayPal Donation
Bitcoin Donation
Address: bc1qcpt2uutqkz4456j5r78rjm3gwq03h5fpwmcc5u
Author
Stefy Lanza stefy@nexlab.net
Repository
Official repository: https://git.nexlab.net/nexlab/aisbf.git
License
GNU General Public License v3.0
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file aisbf-0.99.68.tar.gz.
File metadata
- Download URL: aisbf-0.99.68.tar.gz
- Upload date:
- Size: 1.7 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
b0b94d9e0cc8b264ff0ffbf364bdc55ca6691bdb1d0769e90239236b552c5feb
|
|
| MD5 |
bf6edae981d364313976dea988f6e99a
|
|
| BLAKE2b-256 |
cd04d1a98de3da301cab57474a50d5c833c3ae79a0f014a027bff9803099cab9
|
File details
Details for the file aisbf-0.99.68-py3-none-any.whl.
File metadata
- Download URL: aisbf-0.99.68-py3-none-any.whl
- Upload date:
- Size: 3.1 MB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
428ccb215aad812813dd954cb405c45f667fd352a7a72f0957aa7718f9fac143
|
|
| MD5 |
2ce40e488867e027b29e3bf065594cab
|
|
| BLAKE2b-256 |
9c5dc022e79823e6e22d2720eb3a48469c3a7ebb47bd3621b07847f558a7bbe1
|