Luxand LLM Python Wrapper

This is the supported, pure Python ctypes wrapper over the public LuxandLLMSDK.h C ABI. It does not bundle native binaries. To run model operations, download a matching Luxand LLM SDK native package separately and point the wrapper at that package with LUXLLM_NATIVE_PATH or configure_native_library(...). This wrapper requires native ABI 0.6 or newer; the guard runs before full native binding/model work.

Install the wrapper version matching the SDK release:

python -m pip install luxand-llm==1.0.0

Contributors testing an edited checkout should install that source explicitly:

python -m pip install -e ./wrappers/python

Point the wrapper at an unpacked Luxand LLM SDK native package before loading a model:

import luxand_llm as luxllm

luxllm.configure_native_library("/path/to/sdk/bin")
luxllm.activate_library()

with luxllm.Model("/path/to/model.gguf") as model:
    with model.create_engine(luxllm.Params().set("MaxParallelSessions", 1)) as engine:
        with engine.create_session() as session:
            session.add(luxllm.Role.USER, "Write one sentence about Paris.")
            result = session.generate(luxllm.Params().set("MaxTokens", 64))
            print(result.text)

For caller-driven batching, session.start() + engine.step() + session.read_text() mirrors the C pull API. Reads return CHUNK, NONE, FINISHED, or FAILED. A session-local runtime failure is a terminal FAILED read and does not interrupt healthy siblings; a shared engine/backend failure raises from engine.step(). High-level generate/stream/batch APIs still raise for their own failed request.

Native loading search order:

  1. configure_native_library(path) or load_native(path).
  2. LUXLLM_NATIVE_PATH.
  3. Package-adjacent library locations.
  4. The platform loader path.

Links:

Project links

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (1.0.1)

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for luxand from gravatar.com luxand

Credits

Author: Luxand

License expression

LicenseRef-Proprietary
View SPDX License List

Requires

Python >=3.9

Tags

llm local-llm gguf luxand

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

luxand_llm-1.0.0.tar.gz (45.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

luxand_llm-1.0.0-py3-none-any.whl (51.0 kB view details)

Uploaded Python 3

File details

Details for the file luxand_llm-1.0.0.tar.gz.

File metadata

  • Download URL: luxand_llm-1.0.0.tar.gz
  • Upload date:
  • Size: 45.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.13

File hashes

Hashes for luxand_llm-1.0.0.tar.gz
Algorithm Hash digest
SHA256 4a4e00bcdcb62220307aa58e7f5e9bae5726e6d3f9c5acc464927a2ed5309c8f
MD5 b865345c80b7d7444875965b0da1fba1
BLAKE2b-256 2f73610c58fe565b8618ccbc91099b1886bf06af94a9542a311d7f8620756300

See more details on using hashes here.

Provenance

The following attestation bundles were made for luxand_llm-1.0.0.tar.gz:

Publisher: python-publish.yml on Luxand/luxand-llm-engine

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file luxand_llm-1.0.0-py3-none-any.whl.

File metadata

  • Download URL: luxand_llm-1.0.0-py3-none-any.whl
  • Upload date:
  • Size: 51.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.13

File hashes

Hashes for luxand_llm-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 4c5723c5a47bea6305ee4d4489978c22f1078291a9f9ca849b2ab05e207bd042
MD5 80096f7d2d089b0767a89478c820be99
BLAKE2b-256 d8d41d22e63fe5682542d390193ad24e2f2ecc37bfce482756ee2301210f9eed

See more details on using hashes here.

Provenance

The following attestation bundles were made for luxand_llm-1.0.0-py3-none-any.whl:

Publisher: python-publish.yml on Luxand/luxand-llm-engine

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page