nya-proxy 0.0.4

A lightweight, flexible API proxy with dynamic token rotation, load balancing, and rate limiting capabilities.

🐾 NyaProxy - Universal API Proxy

Your Swiss Army Knife for API Proxy Management

🌟 Core Capabilities

Feature	Description	Config Reference
🔄 Token Rotation	Automatic key cycling across multiple providers	variables.keys
⚖️ Load Balancing	5 strategies: Round Robin, Random, Least Connections, Fastest Response, Weighted	load_balancing_strategy
🚦 Rate Limiting	Granular controls per endpoint/key with smart queuing	rate_limit
🕵️ Request Masking	Dynamic header substitution across multiple identity providers	headers + variables
📊 Real-time Metrics	Interactive dashboard with request analytics and system health	dashboard.enabled

🚀 Installation

Docker (Production)

docker run -d \
  -p 8080:8080 \
  -v ${PWD}/config.yaml:/app/config.yaml \
  -v nya-proxy-logs:/app/logs \
  k3scat/nya-proxy:latest

PyPI (Development)

pip install nya-proxy
nyaproxy --config config.yaml --log-level debug

📡 Service Endpoints

Service	Endpoint	Description
API Proxy	http://localhost:8080/api/<endpoint_name>	Main proxy endpoint for API requests
Dashboard	http://localhost:8080/dashboard	Real-time metrics and monitoring
Config UI	http://localhost:8080/config	Visual configuration interface

Note: Replace 8080 with your configured port if different

🔧 API Configuration

OpenAI-Compatible APIs (Gemini, Anthropic, etc)

gemini:
  name: Google Gemini API
  endpoint: https://generativelanguage.googleapis.com/v1beta/openai
  aliases:
    - /gemini
  key_variable: keys
  headers:
    Authorization: 'Bearer ${{keys}}'
  variables:
    keys:
      - your_gemini_key_1
      - your_gemini_key_2
  load_balancing_strategy: least_requests
  rate_limit:
    endpoint_rate_limit: 75/d     # Total endpoint limit
    key_rate_limit: 5/m          # Per-key limit
    rate_limit_paths:
      - "/v1/chat/*"            # Apply limits to specific paths
      - "/v1/images/*"

Generic REST APIs

novelai:
  name: NovelAI API
  endpoint: https://image.novelai.net
  aliases:
    - /novelai
  key_variable: tokens
  headers:
    Authorization: 'Bearer ${{tokens}}'
  variables:
    tokens:
      - your_novelai_token_1
      - your_novelai_token_2
  load_balancing_strategy: round_robin
  rate_limit:
    endpoint_rate_limit: 10/s
    key_rate_limit: 2/s

🖥️ Management Interfaces

Real-time Metrics Dashboard

Monitor at http://localhost:8080/dashboard:

• Request volumes and response times
• Rate limit status and queue depth
• Key usage and performance metrics
• Error rates and status codes

Visual Configuration Interface

Manage at http://localhost:8080/config:

• Live configuration editing
• Syntax validation
• Variable management
• Rate limit adjustments
• Auto reload on save

🛡️ Advanced Reference Architecture (Advanced Deployment)

graph TD
    A[Client] --> B[Nginx]
    B --> C[NyaProxy]
    C --> D[Auth Service]
    D --> E[API Providers]
    F[Monitoring] --> D

🌌 Future Roadmap

graph LR
A[Q3 2025] --> B[🔄 Smart Request Routing]
A --> C[📡 gRPC/WebSocket Support]
B --> D[📈 Auto-scaling Rules]
C --> E[📊 Protocol Analytics]
F[Q4 2025] --> G[🧩 Plugin System]
F --> H[🔍 Custom Metrics API]

❤️ Community

Need enterprise support? Contact [e-mail]

📈 Project Growth