This release is a pre-release and may not be stable for production use.
nexaai
Run next-generation LLMs and VLMs locally, natively, and at top speed on any hardware.
nexaai is the official Python SDK for NexaSDK/NexaML:
An NPU‑first cross‑platform inference engine that powers LLMs, VLMs, embeddings, audio, and vision models across NPU, GPU, and CPU—on desktop, mobile, automotive, and IoT.
Features
- 🚀 NPU‑First Performance — Accelerated AI with automatic device selection and backend optimizations.
- 🔮 Day‑0 Architecture Support — Run new LLMs, VLMs, ASR, and CV models immediately (GGUF, MLX, .nexa, and more).
- 🧩 True Multimodality — Seamless pipelines for text, vision, and audio.
- 🤖 OpenAI-Compatible Server — Supports serving, chat, and function calling.
- 🏆 Cross‑Platform — macOS (Apple Silicon), Windows (x64, ARM64), Linux, mobile, embedded.
What is it?
nexaai offers a clean Python API over NexaML’s runtime. Build modern AI applications—chatbots, copilots, vision tools—that run fully on-device with maximal hardware utilization. Designed for rapid adoption of new models and formats, especially with NPU acceleration.
Installation & Quickstart
Please refer to our official docs for up-to-date install steps, environment notes, and code examples:
- Overview: NexaAI Python SDK Overview
- Quickstart: Quickstart Guide
The docs include supported Python versions, backend requirements (NPU, MLX, GPU, CPU), and ready-to-run examples for LLMs, VLMs, embeddings, and audio.
Links
- 📚 Docs: https://docs.nexa.ai/nexa-sdk-python/overview
- 🐞 Issues/Discussions: NexaAI Issues
- 💬 Community:
2 maintainers
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file nexaai-1.0.35rc12.tar.gz.
File metadata
- Download URL: nexaai-1.0.35rc12.tar.gz
- Upload date:
- Size: 52.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.2.0 CPython/3.10.19
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3121d2b0ea0dfdc43408d6ba0429ff38f7e5b727e276e84a2f5708826c497741
|
|
| MD5 |
9daf844834a24200f507c2232245aac6
|
|
| BLAKE2b-256 |
6fae13d6770df5bcad9e6ef002839e0bd3de7a64449f603a1c448db44e7866e7
|
