LLM Hub - Unified LLM Calling Library

A unified calling library supporting multiple LLM providers (International + Chinese AI), providing a consistent API interface.

📖 API Reference documentation can be found in the docs/ directory

✨ Features

• 🔌 Unified API - One interface for all LLM providers
• 🌍 Multi-Provider Support - OpenAI, DeepSeek, Kimi, Gemini, Claude, etc.
• 🇨🇳 Chinese AI Support - Qwen, GLM, ERNIE, MiniCPM
• 💻 Local Deployment - Ollama, llama.cpp
• 🤔 Reasoning Mode - Display thinking process (DeepSeek support)
• 📊 Accurate Token Counting - Official tokenizers for each provider
• 📡 Streaming Output - Real-time response generation
• 📁 File Upload - Support for PDF, Word, Excel, PPT, Image OCR, and more
• 💾 Configuration Management - JSON/YAML config, profiles, environment variables
• 🔌 Plugin System - Support for third-party Provider extensions

📋 Supported Providers

📁 Supported File Formats

🚀 Installation

# Basic installation
pip install gracefox-llm-hub

# Install environment sensing support (system resource monitoring)
pip install gracefox-llm-hub[env]

# Install accurate token counting
pip install gracefox-llm-hub[tokenizers]

# Install file upload support (all formats)
pip install gracefox-llm-hub[files-all]

# Install all features
pip install gracefox-llm-hub[all]

⚙️ Configuration

Supports JSON/YAML config files, environment variables, code parameters, and more.

{
    "provider": "deepseek",
    "model": "deepseek-chat",
    "api_key": "your-api-key",
    "temperature": 0.7,
    "max_tokens": 2000,
    "reasoning": true,
    "stream": true
}

Configuration priority (low to high): Default → Environment variables → Profiles → Config files → JSON string → Code parameters

📦 Project Structure

llm-hub/
├── llm_hub/
│   ├── core/           # Core functionality (client, enums, exceptions)
│   ├── config/         # Configuration management (config, manager, security)
│   ├── models/         # Data models (message, conversation, response)
│   ├── providers/      # Provider implementations (base, factory, providers)
│   ├── environment/    # Environment sensing (optional, system monitoring)
│   └── utils/          # Utilities
│       ├── file_loader/    # File upload (multi-format support)
│       ├── stream_handler/ # Stream handling
│       ├── rate_limiter/   # Rate limiting
│       └── logger.py       # Logging system
├── docs/               # API reference documentation
├── examples/           # Example code
└── pyproject.toml      # Project configuration

🔧 Development

# Development installation
pip install -e .[dev,all]

# Code formatting
black llm_hub/

# Code linting
ruff check llm_hub/

# Type checking
mypy llm_hub/

🔌 Plugin System

LLM Hub supports third-party Provider extensions through the entry points mechanism.

# setup.py
setup(
    entry_points={
        "llm_hub.providers": [
            "my_provider = my_package:MyProvider",
        ]
    }
)

🤝 Contributing

Contributions are welcome! Please feel free to submit Pull Requests.

📄 License

GNU General Public License v3.0

📧 Contact

• Author: GraceFox
• Email: 948743980@qq.com
• Homepage: https://gitee.com/SteHub/llm-hub

Quick Reference

Installation Options

Supported Providers

API Key Acquisition

📖 Complete API reference documentation and usage examples can be found in the docs/ directory

⭐ If you find this useful, please give it a Star on Gitee!