Skip to main content

Self-healing engine for LLM APIs - Automatic fault diagnosis and 4-level cascade recovery

Project description

NeuralBridge SDK

Self-healing engine for LLM APIs - Automatic fault diagnosis and 4-level cascade recovery

Features

  • 🎯 LLM Fault Semantic Diagnosis: Automatically identifies 10+ LLM-specific error categories (rate limits, context overflow, model errors, etc.)
  • 🔄 4-Level Cascade Recovery: Hierarchical retry strategy from fast retry → provider failover → model downgrade → manual intervention
  • 🛡️ Native Model-Level Self-Healing: Prevents avalanche failures with adaptive circuit breakers
  • Production-Ready: Tested against DashScope (Qwen) and DeepSeek APIs with 100% success rate

Installation

pip install neuralbridge-sdk

Quick Start

from neuralbridge_sdk import FlywheelEngine, ErrorCategory

engine = FlywheelEngine(
    primary_provider="dashscope",
    backup_provider="deepseek",
    api_keys={
        "dashscope": "YOUR_DASHSCOPE_KEY",
        "deepseek": "YOUR_DEEPSEEK_KEY"
    }
)

# Automatic self-healing with semantic diagnosis
response = engine.chat.completions.create(
    model="qwen-turbo",
    messages=[{"role": "user", "content": "Hello"}]
)

print(response.choices[0].message.content)

Performance Benchmarks

Metric Value
Latency (DashScope) 732ms avg
Success Rate 100%
Cost per 1K tokens ¥0.0001 CNY
Test Coverage ≥80%

Documentation

Visit https://neuralbridge.ai/docs for full API reference and guides.

License

Proprietary - All rights reserved

Contact

admin@neuralbridge.ai

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

neuralbridge_sdk-3.0.1.tar.gz (8.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

neuralbridge_sdk-3.0.1-py3-none-any.whl (2.3 kB view details)

Uploaded Python 3

File details

Details for the file neuralbridge_sdk-3.0.1.tar.gz.

File metadata

  • Download URL: neuralbridge_sdk-3.0.1.tar.gz
  • Upload date:
  • Size: 8.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.12

File hashes

Hashes for neuralbridge_sdk-3.0.1.tar.gz
Algorithm Hash digest
SHA256 937d22143942a765d37724dffd07406a10c2bb74b56035040d31ca5a29c1ee7a
MD5 9de01ab5e57017c8a4f42ca914e888aa
BLAKE2b-256 e5f1b951b50d19bdbd723bc92b79e5beff4720f1f2feb4d223695620ebf14bb5

See more details on using hashes here.

File details

Details for the file neuralbridge_sdk-3.0.1-py3-none-any.whl.

File metadata

File hashes

Hashes for neuralbridge_sdk-3.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 c143a49d324700653a7f5349147828784fc73caee9032da61f4b847328778f11
MD5 7f1042e60a4205e8765a5ecc53384538
BLAKE2b-256 f4b782aeb2b280868a0d96dc9a15edd9926ae8313353ec6079478268d579327c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page