Skip to main content

BaseRT

Fast local LLM inference on Apple Silicon (Metal) and NVIDIA GB10 / DGX Spark (CUDA). This package installs the basert CLI, the prebuilt engine, and the Python bindings in one step.

pip install basert

Requires Apple Silicon with macOS 15+, or Linux/arm64 with an NVIDIA GPU and the CUDA 13 runtime (cuBLAS).

CLI

basert pull Qwen/Qwen3-4B      # download from Hugging Face and convert to .base
basert chat Qwen/Qwen3-4B      # chat in the terminal
basert serve Qwen/Qwen3-4B --api-key "$(uuidgen)" --port 8080   # OpenAI-compatible API

Python

import baseRT

with baseRT.Model("model.base") as model:
    print(model.generate_text("The capital of France is", max_tokens=64))

Docs: https://docs.basecompute.co · Source: https://github.com/basecompute/baseRT

License

The Python bindings and the basert CLI launcher are Apache-2.0. The bundled engine binaries (baseRT/_engine/) are under the BaseRT Engine license included with the package.

Metadata

Release files for basert 0.4.7

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distributions (wheels)

Table of built distributions (wheels) for basert 0.4.7
File Interpreter ABI Platform Actions
basert-0.4.7-py3-none-manylinux_2_39_aarch64.whl Python 3 none Linux glibc 2.39+ ARM64 Details for basert-0.4.7-py3-none-manylinux_2_39_aarch64.whl
basert-0.4.7-py3-none-macosx_15_0_arm64.whl Python 3 none macOS 15.0+ ARM64 Details for basert-0.4.7-py3-none-macosx_15_0_arm64.whl

Total release size: 70.5 MB

Release files / basert-0.4.7-py3-none-manylinux_2_39_aarch64.whl

Download URL basert-0.4.7-py3-none-manylinux_2_39_aarch64.whl
Size 39.4 MB
Tags Linux glibc 2.39+ ARM64 Python 3
SHA-256 checksum
How to use checksums
35f25c938caff82872c6c876c14c522e46b4ed8623a03d25c8a327cab9de08bf
BLAKE2b-256 checksum
How to use checksums
4a84043b86431cf1dbbbc7d7068b8d839cc6f53d3bbf14ba50d425e0b616ddb3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 10, 2026.

Transparency log

Release files / basert-0.4.7-py3-none-macosx_15_0_arm64.whl

Download URL basert-0.4.7-py3-none-macosx_15_0_arm64.whl
Size 31.1 MB
Tags Python 3 macOS 15.0+ ARM64
SHA-256 checksum
How to use checksums
fcaf74eabf74d88694e4d8ac283092b47216742f44fe97b559ee4fa6d1c474ac
BLAKE2b-256 checksum
How to use checksums
cc3c4b3f56189d5515d908d9711472402d4dd64475858de412cbb39fcfdac54a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 10, 2026.

Transparency log

Security for basert 0.4.7

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

Both files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for basert-0.4.7-py3-none-manylinux_2_39_aarch64.whl

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 10, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.4.7 This release

2 release files Full provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page