Skip to main content

BaseRT

Fast local LLM inference on Apple Silicon (Metal) and NVIDIA GB10 / DGX Spark (CUDA). This package installs the basert CLI, the prebuilt engine, and the Python bindings in one step.

pip install basert

Requires Apple Silicon with macOS 15+, or Linux/arm64 with an NVIDIA GPU and the CUDA 13 runtime (cuBLAS).

CLI

basert pull Qwen/Qwen3-4B      # download from Hugging Face and convert to .base
basert chat Qwen/Qwen3-4B      # chat in the terminal
basert serve Qwen/Qwen3-4B --api-key "$(uuidgen)" --port 8080   # OpenAI-compatible API

Python

import baseRT

with baseRT.Model("model.base") as model:
    print(model.generate_text("The capital of France is", max_tokens=64))

Docs: https://docs.basecompute.co · Source: https://github.com/basecompute/baseRT

License

The Python bindings and the basert CLI launcher are Apache-2.0. The bundled engine binaries (baseRT/_engine/) are under the BaseRT Engine license included with the package.

Metadata

Release files for basert 0.4.6

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distributions (wheels)

Table of built distributions (wheels) for basert 0.4.6
File Interpreter ABI Platform Actions
basert-0.4.6-py3-none-manylinux_2_39_aarch64.whl Python 3 none Linux glibc 2.39+ ARM64 Details for basert-0.4.6-py3-none-manylinux_2_39_aarch64.whl
basert-0.4.6-py3-none-macosx_15_0_arm64.whl Python 3 none macOS 15.0+ ARM64 Details for basert-0.4.6-py3-none-macosx_15_0_arm64.whl

Total release size: 68.7 MB

Release files / basert-0.4.6-py3-none-manylinux_2_39_aarch64.whl

Download URL basert-0.4.6-py3-none-manylinux_2_39_aarch64.whl
Size 39.3 MB
Tags Linux glibc 2.39+ ARM64 Python 3
SHA-256 checksum
How to use checksums
6aac0d1408d936b016fe64667344ac477b110881225fb34176cecfb11243d077
BLAKE2b-256 checksum
How to use checksums
5758cd279064d8be78854c854c78d1eb63af2d8f3890cfee7abc2f9c3d683ae1
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 10, 2026.

Transparency log

Release files / basert-0.4.6-py3-none-macosx_15_0_arm64.whl

Download URL basert-0.4.6-py3-none-macosx_15_0_arm64.whl
Size 29.4 MB
Tags Python 3 macOS 15.0+ ARM64
SHA-256 checksum
How to use checksums
4659a639a93f00e952bc823c0cd1ba07ba81faf693abeba48d2cfa7ae6c60a0d
BLAKE2b-256 checksum
How to use checksums
57edee86ed9a4a8bfb33a57a51018d65a9c4af2c28c7b45773b34a14fcd8cf38
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 10, 2026.

Transparency log

Security for basert 0.4.6

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

Both files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for basert-0.4.6-py3-none-manylinux_2_39_aarch64.whl

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 10, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.4.6 This release

2 release files Full provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page