nexaai 1.0.40rc3

Run next-generation LLMs and VLMs locally, natively, and at top speed on any hardware.

nexaai

Run next-generation LLMs and VLMs locally, natively, and at top speed on any hardware.

nexaai is the official Python SDK for NexaSDK/NexaML:
An NPU‑first cross‑platform inference engine that powers LLMs, VLMs, embeddings, audio, and vision models across NPU, GPU, and CPU—on desktop, mobile, automotive, and IoT.

---

Features

• 🚀 NPU‑First Performance — Accelerated AI with automatic device selection and backend optimizations.
• 🔮 Day‑0 Architecture Support — Run new LLMs, VLMs, ASR, and CV models immediately (GGUF, MLX, .nexa, and more).
• 🧩 True Multimodality — Seamless pipelines for text, vision, and audio.
• 🤖 OpenAI-Compatible Server — Supports serving, chat, and function calling.
• 🏆 Cross‑Platform — macOS (Apple Silicon), Windows (x64, ARM64), Linux, mobile, embedded.

---

What is it?

nexaai offers a clean Python API over NexaML’s runtime. Build modern AI applications—chatbots, copilots, vision tools—that run fully on-device with maximal hardware utilization. Designed for rapid adoption of new models and formats, especially with NPU acceleration.

---

Installation & Quickstart

Please refer to our official docs for up-to-date install steps, environment notes, and code examples:

• Overview: NexaAI Python SDK Overview
• Quickstart: Quickstart Guide

The docs include supported Python versions, backend requirements (NPU, MLX, GPU, CPU), and ready-to-run examples for LLMs, VLMs, embeddings, and audio.

---

Links

• 📚 Docs: https://docs.nexa.ai/nexa-sdk-python/overview
• 🐞 Issues/Discussions: NexaAI Issues
• 💬 Community:
  • Discord
  • Slack

---