Self-healing engine for LLM APIs - Automatic fault diagnosis and 4-level cascade recovery
Project description
NeuralBridge SDK
Self-healing engine for LLM APIs - Automatic fault diagnosis and 4-level cascade recovery
Features
- 🎯 LLM Fault Semantic Diagnosis: Automatically identifies 10+ LLM-specific error categories (rate limits, context overflow, model errors, etc.)
- 🔄 4-Level Cascade Recovery: Hierarchical retry strategy from fast retry → provider failover → model downgrade → manual intervention
- 🛡️ Native Model-Level Self-Healing: Prevents avalanche failures with adaptive circuit breakers
- ⚡ Production-Ready: Tested against DashScope (Qwen) and DeepSeek APIs with 100% success rate
Installation
pip install neuralbridge-sdk
Quick Start
from neuralbridge_sdk import FlywheelEngine, ErrorCategory
engine = FlywheelEngine(
primary_provider="dashscope",
backup_provider="deepseek",
api_keys={
"dashscope": "YOUR_DASHSCOPE_KEY",
"deepseek": "YOUR_DEEPSEEK_KEY"
}
)
# Automatic self-healing with semantic diagnosis
response = engine.chat.completions.create(
model="qwen-turbo",
messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)
Performance Benchmarks
| Metric | Value |
|---|---|
| Latency (DashScope) | 732ms avg |
| Success Rate | 100% |
| Cost per 1K tokens | ¥0.0001 CNY |
| Test Coverage | ≥80% |
Documentation
Visit https://neuralbridge.ai/docs for full API reference and guides.
License
Proprietary - All rights reserved
Contact
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
No source distribution files available for this release.See tutorial on generating distribution archives.
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file neuralbridge_sdk-0.3.0-py3-none-any.whl.
File metadata
- Download URL: neuralbridge_sdk-0.3.0-py3-none-any.whl
- Upload date:
- Size: 8.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
d0a5f4b3cd21bb44e349d86f39b5cdf14ac9469507f49ebaba3c7b1d4a7ecb4a
|
|
| MD5 |
95e4070c49123c28cfaf3c11e09ac939
|
|
| BLAKE2b-256 |
06e0bd275f8bd987b6bbb524431df27fda9d8551ac0afe43de745551f736aade
|