Skip to main content

nexaai

Run next-generation LLMs and VLMs locally, natively, and at top speed on any hardware.

nexaai is the official Python SDK for NexaSDK/NexaML:
An NPU‑first cross‑platform inference engine that powers LLMs, VLMs, embeddings, audio, and vision models across NPU, GPU, and CPU—on desktop, mobile, automotive, and IoT.


Features

  • 🚀 NPU‑First Performance — Accelerated AI with automatic device selection and backend optimizations.
  • 🔮 Day‑0 Architecture Support — Run new LLMs, VLMs, ASR, and CV models immediately (GGUF, MLX, .nexa, and more).
  • 🧩 True Multimodality — Seamless pipelines for text, vision, and audio.
  • 🤖 OpenAI-Compatible Server — Supports serving, chat, and function calling.
  • 🏆 Cross‑Platform — macOS (Apple Silicon), Windows (x64, ARM64), Linux, mobile, embedded.

What is it?

nexaai offers a clean Python API over NexaML’s runtime. Build modern AI applications—chatbots, copilots, vision tools—that run fully on-device with maximal hardware utilization. Designed for rapid adoption of new models and formats, especially with NPU acceleration.


Installation & Quickstart

Please refer to our official docs for up-to-date install steps, environment notes, and code examples:

The docs include supported Python versions, backend requirements (NPU, MLX, GPU, CPU), and ready-to-run examples for LLMs, VLMs, embeddings, and audio.


Links


Metadata

Release files for nexaai 1.0.44

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for nexaai 1.0.44
File Size Uploaded
nexaai-1.0.44.tar.gz 74.4 kB Details

Release files / nexaai-1.0.44.tar.gz

Download URL nexaai-1.0.44.tar.gz
Size 74.4 kB
Tags Source
SHA-256 checksum
How to use checksums
220a78239fa880eaf356c1fded659d16fea60114cb300c4c7cac6d047635f1fb
BLAKE2b-256 checksum
How to use checksums
0d4e561727d8e3b3717116a41075a166622c0ee715012a56a92bc1154432c242
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.10.19

Release history Release notifications | RSS feed

This release

1.0.44 This release

1 release file

1.0.43

1 release file

1.0.42

1 release file

1.0.41

1 release file

1.0.39

1 release file

1.0.37

1 release file

1.0.34

3 release files

1.0.33

2 release files

1.0.32

3 release files

1.0.31

3 release files

1.0.30

6 release files

1.0.29

3 release files

1.0.24

6 release files

1.0.23

6 release files

1.0.22

6 release files

1.0.21

5 release files

1.0.20

3 release files

1.0.19

3 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page