This release is a pre-release and may not be stable for production use.
nexaai
Run next-generation LLMs and VLMs locally, natively, and at top speed on any hardware.
nexaai is the official Python SDK for NexaSDK/NexaML:
An NPU‑first cross‑platform inference engine that powers LLMs, VLMs, embeddings, audio, and vision models across NPU, GPU, and CPU—on desktop, mobile, automotive, and IoT.
Features
- 🚀 NPU‑First Performance — Accelerated AI with automatic device selection and backend optimizations.
- 🔮 Day‑0 Architecture Support — Run new LLMs, VLMs, ASR, and CV models immediately (GGUF, MLX, .nexa, and more).
- 🧩 True Multimodality — Seamless pipelines for text, vision, and audio.
- 🤖 OpenAI-Compatible Server — Supports serving, chat, and function calling.
- 🏆 Cross‑Platform — macOS (Apple Silicon), Windows (x64, ARM64), Linux, mobile, embedded.
What is it?
nexaai offers a clean Python API over NexaML’s runtime. Build modern AI applications—chatbots, copilots, vision tools—that run fully on-device with maximal hardware utilization. Designed for rapid adoption of new models and formats, especially with NPU acceleration.
Installation & Quickstart
Please refer to our official docs for up-to-date install steps, environment notes, and code examples:
- Overview: NexaAI Python SDK Overview
- Quickstart: Quickstart Guide
The docs include supported Python versions, backend requirements (NPU, MLX, GPU, CPU), and ready-to-run examples for LLMs, VLMs, embeddings, and audio.
Links
- 📚 Docs: https://docs.nexa.ai/nexa-sdk-python/overview
- 🐞 Issues/Discussions: NexaAI Issues
- 💬 Community:
2 maintainers
Metadata
2 maintainers
Release files for nexaai 1.0.35rc12
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| nexaai-1.0.35rc12.tar.gz | 52.2 kB | Details |
Release files / nexaai-1.0.35rc12.tar.gz
| Download URL | nexaai-1.0.35rc12.tar.gz |
|---|---|
| Size | 52.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
3121d2b0ea0dfdc43408d6ba0429ff38f7e5b727e276e84a2f5708826c497741
|
|
BLAKE2b-256 checksum How to use checksums |
6fae13d6770df5bcad9e6ef002839e0bd3de7a64449f603a1c448db44e7866e7
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.10.19
|
