TurboPrivate AI — Self-Hosted Enterprise AI Platform

Switch from OpenAI in 30 seconds. Drop-in compatible API with built-in safety, governance, and 40–60% cost reduction.

Run powerful LLMs on your own hardware — with enterprise safety, governance, and full data sovereignty.

Quick Start

One-Click Install

curl -fsSL https://get.turboprivate.ai | bash

Or via pip

pip install turboprivate-ai
turbo deploy --provider bare-metal --gpu auto
turbo model serve meta-llama/Llama-3.1-8B --quant int4
turbo chat

Docker Compose (Hardware-Aware)

git clone https://github.com/Kubenew/turboprivate-ai.git
cd turboprivate-ai

# Auto-detects GPU / Apple Silicon / CPU
curl -fsSL https://get.turboprivate.ai | bash

# Or manually:
docker compose -f docker-compose.gpu.yml up -d    # NVIDIA GPU
docker compose -f docker-compose.mac.yml up -d     # Apple Silicon
docker compose -f docker-compose.cpu.yml up -d     # CPU fallback

Why TurboPrivate AI?

🏢 For Enterprises

TurboPrivate AI is the Enterprise On-Premise AI Gateway — a secure, compliant orchestration layer between your corporate data and open-source models.

What We Are

• ✅ Secure Wrapper: Mythos Safe gate with 7 verifiers (injection, PII, toxicity, etc.)
• ✅ OpenAI Parity: 100% compatible API — swap base_url and you're done
• ✅ SAP HANA Native: Direct, secure RAG connector with SQL injection guard + RLS
• ✅ Audit & Compliance: Immutable JSONL logs, GDPR/HIPAA/SOC 2 ready
• ✅ Hardware Agnostic: GPU, Apple Silicon, or CPU — auto-optimized

What We Are Not

• ❌ Model Training: We don't train models from scratch
• ❌ Custom UI: We integrate Open WebUI / LibreChat instead of building our own
• ❌ Vector DB: We connect to Qdrant, Milvus, pgvector — we don't replace them

See docs/ENTERPRISE.md for architecture details.

Security & Compliance

• Full data sovereignty: Nothing leaves your infrastructure
• Mythos Safe: 7-layer defense (injection, PII, toxicity, hallucination, etc.)
• Audit trail: Immutable JSONL logs with SIEM integration
• RBAC: Fine-grained access control with OIDC/SAML support
• Compliance ready: GDPR, HIPAA, SOC 2, PCI-DSS, ISO 27001

See SECURITY.md and docs/COMPLIANCE.md for details.

Enterprise Integrations

• SAP HANA: Vector store + RAG pipeline (Guide)
• SAP AI Core: BYOM deployment support
• Kubernetes: Helm charts, HPA, multi-cluster
• Observability: Prometheus, Grafana, OpenTelemetry
• Secrets: HashiCorp Vault, AWS Secrets Manager, K8s Secrets

Support & SLAs

📅 Book a 30-min PoC Call | ✉️ Contact Sales

📊 Performance (RTX 4090)

Independent benchmarks: benchmarks/

🛡️ Architecture

CLI / SDK / Dashboard
        ↓
   API Gateway (FastAPI · Auth · Rate Limiting)
        ↓
┌─────────────────┐  ┌───────────────────┐
│  Mythos Safe    │  │  TurboQuant INT4  │
│  Verifiers ·    │  │  vLLM/llama.cpp   │
│  Audit Trail    │  │  Inference Engine │
└─────────────────┘  └───────────────────┘
        ↓
   Memory & RAG (TurboMemory · pdf2struct)
        ↓
──────────┐ ┌──────────┐ ┌──────────┐
│  K3s     │ │Monitoring│ │ Storage  │
│  Cluster │ │Prom/Graf │ │ PG/Redis │
└────────── └──────────┘ └──────────┘

🎬 Demo

Documentation

• Architecture — System design
• Deployment — Production guide
• Enterprise Guide — Air-gapped, HA, sizing, migration
• Compliance — GDPR, HIPAA, SOC 2, PCI-DSS readiness
• SAP HANA Integration — Cost calculator, security checklist
• CLI Reference — All commands
• API Reference — FastAPI routes
• Security Policy — Vulnerability reporting
• Contributing — How to contribute

🔄 Changelog

0.1.9 (2026-05-17)

• Optimized SAP HANA Secure Connector: pre-compiled regex for high-throughput PII masking
• Air-gapped installer support: --offline flag + local compose file detection
• CI/CD security pipeline: automated SQL injection blocking tests
• Performance tuning: vectorized masking hints, reduced regex overhead

0.1.8 (2026-05-17)

• SAP HANA Secure RAG Connector: SQL injection guard, RLS mapping, PII masking
• Hardware-aware installer: auto-detects NVIDIA / Apple Silicon / CPU
• Docker Compose profiles: gpu.yml, mac.yml, cpu.yml for optimal deployment
• README overhaul: "What We Are / Are Not" transparency, Enterprise Gateway positioning
• Modular architecture: decoupled inference backends, plug-and-play vector DBs

0.1.7 (2026-05-17)

• SECURITY.md with threat model, hardening guide, SBOM, responsible disclosure
• CONTRIBUTING.md with dev setup, testing, PR guidelines
• Enterprise Deployment Guide: air-gapped, HA, secrets, proxy, hardware sizing
• Compliance readiness: GDPR, HIPAA, SOC 2, PCI-DSS, ISO 27001, EU AI Act
• One-click installer (install.sh) + docker-compose.full.yml with GPU passthrough
• GitHub issue templates: bug report, feature request, security report
• README overhaul: feature comparison table, "For Enterprises" section, badges

0.1.6 (2026-05-16)

• SAP HANA integration guide: cost calculator, security checklist, BYOM, compliance
• Enterprise hardening best practices
• SECURITY.md and CONTRIBUTING.md added

0.1.5 (2026-05-16)

• SAP HANA vector store integration (LangChain + HanaDB)
• FastAPI RAG endpoint with similarity search
• Document ingestion with PDF/text + HNSW index

0.1.4 (2026-05-13)

• Production Helm charts (configmap, ingress, services)
• TurboQuant v3: AWQ + INT4 mixed-precision
• K3s provisioner with multi-node discovery
• vLLM backend: speculative decoding + prefix caching

Full changelog →

📄 License

Apache 2.0 — see LICENSE.

Built by Kubenew — ex-HPE engineer, 12+ years enterprise infrastructure