Skip to main content

Self-healing engine for LLM APIs - Automatic fault diagnosis and 4-level cascade recovery

Project description

NeuralBridge SDK

Self-healing engine for LLM APIs - Automatic fault diagnosis and 4-level cascade recovery

Features

  • 🎯 LLM Fault Semantic Diagnosis: Automatically identifies 10+ LLM-specific error categories (rate limits, context overflow, model errors, etc.)
  • 🔄 4-Level Cascade Recovery: Hierarchical retry strategy from fast retry → provider failover → model downgrade → manual intervention
  • 🛡️ Native Model-Level Self-Healing: Prevents avalanche failures with adaptive circuit breakers
  • Production-Ready: Tested against DashScope (Qwen) and DeepSeek APIs with 100% success rate

Installation

pip install neuralbridge-sdk

Quick Start

from neuralbridge_sdk import FlywheelEngine, ErrorCategory

engine = FlywheelEngine(
    primary_provider="dashscope",
    backup_provider="deepseek",
    api_keys={
        "dashscope": "YOUR_DASHSCOPE_KEY",
        "deepseek": "YOUR_DEEPSEEK_KEY"
    }
)

# Automatic self-healing with semantic diagnosis
response = engine.chat.completions.create(
    model="qwen-turbo",
    messages=[{"role": "user", "content": "Hello"}]
)

print(response.choices[0].message.content)

Performance Benchmarks

Metric Value
Latency (DashScope) 732ms avg
Success Rate 100%
Cost per 1K tokens ¥0.0001 CNY
Test Coverage ≥80%

Documentation

Visit https://neuralbridge.ai/docs for full API reference and guides.

License

Proprietary - All rights reserved

Contact

admin@neuralbridge.ai

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

neuralbridge_sdk-0.3.0-py3-none-any.whl (8.7 kB view details)

Uploaded Python 3

File details

Details for the file neuralbridge_sdk-0.3.0-py3-none-any.whl.

File metadata

File hashes

Hashes for neuralbridge_sdk-0.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 d0a5f4b3cd21bb44e349d86f39b5cdf14ac9469507f49ebaba3c7b1d4a7ecb4a
MD5 95e4070c49123c28cfaf3c11e09ac939
BLAKE2b-256 06e0bd275f8bd987b6bbb524431df27fda9d8551ac0afe43de745551f736aade

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page