onyx-AI-Gemma4 0.1.5

Professional Multimodal AI Engine for Onyx platform

💎 ONYX AI Gemma 4 Engine (E2B Edition) A high-performance, professional FastAPI wrapper for Gemma multimodal models, featuring built-in 4-bit quantization and real-time streaming. Developed by ONYX (RUI Company). --- 🚀 Features Zero Configuration: Deploy a multimodal AI server in seconds Optimized Performance: Native 4-bit quantization via `bitsandbytes` Streaming Support: Real-time token generation using SSE Hardware Friendly: Works on both GPU and high-performance CPU --- 📦 Installation Option 1: Install via pip ```bash pip install onyx-AI-Gemma4 ``` Option 2: requirements.txt ```txt fastapi uvicorn transformers>=4.48.0 torch accelerate bitsandbytes Pillow torchvision onyx-AI-Gemma4 ``` --- 💻 Usage ▶ Standard Script ```python from ONYXAI_Gemma4E2B import OnyxEngine

Initialize the engine

engine = OnyxEngine(model_id="google/gemma-4-E2B-it")

Run the server

if name == "main": engine.run(host="0.0.0.0", port=7860)

---
🌐 Production / Hugging Face Spaces
```python
from ONYXAI_Gemma4E2B import OnyxEngine
import uvicorn
import os

engine = OnyxEngine(model_id="google/gemma-4-E2B-it")
app = engine.app

@app.get("/")
def home():
    return {"message": "ONYX Engine is running!"}

if __name__ == "__main__":
    port = int(os.environ.get("PORT", 7860))
    uvicorn.run(app, host="0.0.0.0", port=port)

---

🛠 API Usage Endpoint

POST /predict

Example Request

{
  "messages": [
    {
      "role": "user",
      "content": "Explain the importance of AI in modern software engineering."
    }
  ],
  "temperature": 0.7,
  "max_tokens": 1024
}

---

🔗 Links Organization: ONYX / RUI Company Author: Eng. Rawan Jassim

© 2026 ONYX. All rights reserved.