Skip to main content

Self-healing engine for LLM APIs - Automatic fault diagnosis and 4-level cascade recovery

Project description

NeuralBridge SDK

Self-healing engine for LLM APIs - Automatic fault diagnosis and 4-level cascade recovery

Features

  • 🎯 LLM Fault Semantic Diagnosis: Automatically identifies 10+ LLM-specific error categories (rate limits, context overflow, model errors, etc.)
  • 🔄 4-Level Cascade Recovery: Hierarchical retry strategy from fast retry → provider failover → model downgrade → manual intervention
  • 🛡️ Native Model-Level Self-Healing: Prevents avalanche failures with adaptive circuit breakers
  • Production-Ready: Tested against DashScope (Qwen) and DeepSeek APIs with 100% success rate

Installation

pip install neuralbridge-sdk

Quick Start

from neuralbridge_sdk import FlywheelEngine, ErrorCategory

engine = FlywheelEngine(
    primary_provider="dashscope",
    backup_provider="deepseek",
    api_keys={
        "dashscope": "YOUR_DASHSCOPE_KEY",
        "deepseek": "YOUR_DEEPSEEK_KEY"
    }
)

# Automatic self-healing with semantic diagnosis
response = engine.chat.completions.create(
    model="qwen-turbo",
    messages=[{"role": "user", "content": "Hello"}]
)

print(response.choices[0].message.content)

Performance Benchmarks

Metric Value
Latency (DashScope) 732ms avg
Success Rate 100%
Cost per 1K tokens ¥0.0001 CNY
Test Coverage ≥80%

Documentation

Visit https://neuralbridge.ai/docs for full API reference and guides.

License

Proprietary - All rights reserved

Contact

admin@neuralbridge.ai

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

neuralbridge_sdk-3.0.0.tar.gz (8.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

neuralbridge_sdk-3.0.0-py3-none-any.whl (2.3 kB view details)

Uploaded Python 3

File details

Details for the file neuralbridge_sdk-3.0.0.tar.gz.

File metadata

  • Download URL: neuralbridge_sdk-3.0.0.tar.gz
  • Upload date:
  • Size: 8.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.12

File hashes

Hashes for neuralbridge_sdk-3.0.0.tar.gz
Algorithm Hash digest
SHA256 5eed1820565a94d3b0ee924dbe8ca7fd93dc33d59220988640b99b318e322e55
MD5 3ebff7541cf67e7f98cec8f2f07dc375
BLAKE2b-256 2be48824c6af2282f5669576af00dbc1d464b1ce44c91539c975b4c9e0bed382

See more details on using hashes here.

File details

Details for the file neuralbridge_sdk-3.0.0-py3-none-any.whl.

File metadata

File hashes

Hashes for neuralbridge_sdk-3.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 3b8149230ff51d137d4e3915e309f7fc59722521893bc80e0e05c1564473d44b
MD5 a20598ab4f23d4014e0b88318a3b1def
BLAKE2b-256 8590f1ac3de72a411658a9a07c800fe4b89bc81cd3f9573be2cb9faacdc29a7b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page