Luxand LLM Python Wrapper

This is the supported, pure Python ctypes wrapper over the public LuxandLLMSDK.h C ABI. It does not bundle native binaries. To run model operations, download a matching Luxand LLM SDK native package separately and point the wrapper at that package with LUXLLM_NATIVE_PATH or configure_native_library(...). This wrapper requires native ABI 0.7 or newer; the guard runs before full native binding/model work.

Install the wrapper version matching the SDK release:

python -m pip install luxand-llm==1.0.1

Contributors testing an edited checkout should install that source explicitly:

python -m pip install -e ./wrappers/python

Point the wrapper at an unpacked Luxand LLM SDK native package before loading a model:

import luxand_llm as luxllm

luxllm.configure_native_library("/path/to/sdk/bin")
luxllm.activate_library()

with luxllm.Model("/path/to/model.gguf") as model:
    with model.create_engine(luxllm.Params().set("MaxParallelSessions", 1)) as engine:
        with engine.create_session() as session:
            session.add(luxllm.Role.USER, "Write one sentence about Paris.")
            result = session.generate(luxllm.Params().set("MaxTokens", 64))
            print(result.text)

For caller-driven batching, session.start() + engine.step() + session.read_text() mirrors the C pull API. Reads return CHUNK, NONE, FINISHED, or FAILED. A session-local runtime failure is a terminal FAILED read and does not interrupt healthy siblings; a shared engine/backend failure raises from engine.step(). High-level generate/stream/batch APIs still raise for their own failed request.

Native loading search order:

  1. configure_native_library(path) or load_native(path).
  2. LUXLLM_NATIVE_PATH.
  3. Package-adjacent library locations.
  4. The platform loader path.

Links:

Project links

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Latest release

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for luxand from gravatar.com luxand

Credits

Author: Luxand

License expression

LicenseRef-Proprietary
View SPDX License List

Requires

Python >=3.9

Tags

llm local-llm gguf luxand

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

luxand_llm-1.0.1.tar.gz (46.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

luxand_llm-1.0.1-py3-none-any.whl (51.5 kB view details)

Uploaded Python 3

File details

Details for the file luxand_llm-1.0.1.tar.gz.

File metadata

  • Download URL: luxand_llm-1.0.1.tar.gz
  • Upload date:
  • Size: 46.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.13

File hashes

Hashes for luxand_llm-1.0.1.tar.gz
Algorithm Hash digest
SHA256 031b0a6e822287020c0600655fde2d0d35f64c09af1f5e4487574c5d44661e05
MD5 3446d6ba1e0d5af8315b16fd463a8052
BLAKE2b-256 02ed02dcfdacf555a75ae75813b70a9ba8afcfc63fd99d97a565396a332e9f9b

See more details on using hashes here.

Provenance

The following attestation bundles were made for luxand_llm-1.0.1.tar.gz:

Publisher: python-publish.yml on Luxand/luxand-llm-engine

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file luxand_llm-1.0.1-py3-none-any.whl.

File metadata

  • Download URL: luxand_llm-1.0.1-py3-none-any.whl
  • Upload date:
  • Size: 51.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.13

File hashes

Hashes for luxand_llm-1.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 9376e15e3c7f21f9979be8c318497346bd09d6893161f08ac95e07b3e08e60c4
MD5 4f0bb34e8623e622a9f7aa7451bbd6c2
BLAKE2b-256 706b05dc7dec4e7652cc81c57a1a8326d908c8caabae10b06ada7b3a2689db63

See more details on using hashes here.

Provenance

The following attestation bundles were made for luxand_llm-1.0.1-py3-none-any.whl:

Publisher: python-publish.yml on Luxand/luxand-llm-engine

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page