Skip to main content

Self-healing engine for LLM APIs - Automatic fault diagnosis and 4-level cascade recovery

Project description

NeuralBridge SDK

Self-healing engine for LLM APIs - Automatic fault diagnosis and 4-level cascade recovery

Features

  • 🎯 LLM Fault Semantic Diagnosis: Automatically identifies 10+ LLM-specific error categories (rate limits, context overflow, model errors, etc.)
  • 🔄 4-Level Cascade Recovery: Hierarchical retry strategy from fast retry → provider failover → model downgrade → manual intervention
  • 🛡️ Native Model-Level Self-Healing: Prevents avalanche failures with adaptive circuit breakers
  • Production-Ready: Tested against DashScope (Qwen) and DeepSeek APIs with 100% success rate

Installation

pip install neuralbridge-sdk

Quick Start

from neuralbridge_sdk import FlywheelEngine, ErrorCategory

engine = FlywheelEngine(
    primary_provider="dashscope",
    backup_provider="deepseek",
    api_keys={
        "dashscope": "YOUR_DASHSCOPE_KEY",
        "deepseek": "YOUR_DEEPSEEK_KEY"
    }
)

# Automatic self-healing with semantic diagnosis
response = engine.chat.completions.create(
    model="qwen-turbo",
    messages=[{"role": "user", "content": "Hello"}]
)

print(response.choices[0].message.content)

Performance Benchmarks

Metric Value
Latency (DashScope) 732ms avg
Success Rate 100%
Cost per 1K tokens ¥0.0001 CNY
Test Coverage ≥80%

Documentation

Visit https://neuralbridge.ai/docs for full API reference and guides.

License

Proprietary - All rights reserved

Contact

admin@neuralbridge.ai

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

neuralbridge_sdk-0.3.1-py3-none-any.whl (8.7 kB view details)

Uploaded Python 3

File details

Details for the file neuralbridge_sdk-0.3.1-py3-none-any.whl.

File metadata

File hashes

Hashes for neuralbridge_sdk-0.3.1-py3-none-any.whl
Algorithm Hash digest
SHA256 10cfb4e98432ddee8f9c45a1caa7b1b26b21b40660c24c3e3913a488ca846cc0
MD5 78b5152b6519175c5172a23c4feccf48
BLAKE2b-256 6c373d50f14c128968c92dd3def1d033cb1135dee6e7f3015df3753c381e65fa

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page