💎 ONYX AI Qwen2 Engine

High-performance streaming server for Qwen2 models, optimized for ONYX platform.

📦 Installation

pip install onyx-AI-Qwen2

Option 2: requirements.txt

fastapi
uvicorn
transformers>=4.48.0
torch
accelerate
einops
sentencepiece
protobuf
tiktoken
onyx-AI-Qwen2

💻 Usage ▶ Standard Script

from ONYXAI_Qwen2 import OnyxQwenEngine

# 1. إنشاء المحرك
engine = OnyxQwenEngine(model_id="Qwen/Qwen2.5-1.5B-Instruct")

# 2. استخراج الـ app 
app = engine.app 

if __name__ == "__main__":
    engine.run(port=7860)

🛠 API Usage Endpoint

POST /predict

Example Request

{
  "messages": [
    {
      "role": "user",
      "content": "Write a long story about space exploration."
    }
  ],
  "stream": true,
  "temperature": 0.7,
  "max_tokens": 1024
}

🔗 Links Organization: ONYX / RUI Company Author: Eng. Rawan Jassim

© 2026 ONYX. All rights reserved.