Pre-release
This release is a pre-release and may not be stable for production use.
LiteRT-LM Python
Python bindings for LiteRT-LM, a production-ready, open-source inference framework designed to deliver high-performance, cross-platform LLM deployments on edge devices.
Usage
Here is a simple example showing how to load a model and interact with it using the Python API:
import litert_lm
# Load the model using the CPU backend
with litert_lm.Engine("path/to/model.litertlm") as engine:
# Create a conversation and generate a response
with engine.create_conversation() as conversation:
user_message = "Hello world!"
# Alternative: send the full message for prompt template
# user_message = {"role": "user", "content": "Hello world!"}
# Synchronous completion
response = conversation.send_message(user_message)
print("Response:", response["content"][0]["text"])
# Asynchronous / Streaming completion
# stream = conversation.send_message_async(user_message)
# for text_piece in stream:
# print(text_piece, end="", flush=True)
For more information, please visit the main repository.
1 maintainer
Metadata
1 maintainer
Release files for litert-lm-nightly 0.9.0.dev20260326
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distributions (wheels)
Total release size: 219.0 MB
Release files / litert_lm_nightly-0.9.0.dev20260326-cp313-cp313-manylinux_2_38_aarch64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260326-cp313-cp313-manylinux_2_38_aarch64.whl |
|---|---|
| Size | 20.4 MB |
| Tags | CPython 3.13 Linux glibc 2.38+ ARM64 |
|
SHA-256 checksum How to use checksums |
54b231dc2718cf5341a395e3210803b299397d238218277ea206f5b3676f25b6
|
|
BLAKE2b-256 checksum How to use checksums |
c88f41e29dc627d37c69bb684e3a7f56adeb4e82cf45c37b1d4ea5a1768994d1
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260326-cp313-cp313-manylinux_2_35_x86_64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260326-cp313-cp313-manylinux_2_35_x86_64.whl |
|---|---|
| Size | 21.4 MB |
| Tags | CPython 3.13 Linux glibc 2.35+ x86-64 |
|
SHA-256 checksum How to use checksums |
0374ac4c1683b26b2a2d423615c5a19746ebdd0f76b2a40095c2f87e6abc61f4
|
|
BLAKE2b-256 checksum How to use checksums |
f5eb56ab605bc7ab0f3ddddcecf756222187aa1d25ea34bfc2eef91191f3e015
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"22.04","id":"jammy","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260326-cp313-cp313-macosx_12_0_arm64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260326-cp313-cp313-macosx_12_0_arm64.whl |
|---|---|
| Size | 12.9 MB |
| Tags | CPython 3.13 macOS 12.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
c1c5a6e9cef0468c20f5aa2c18e7d565e3e73806d56b762e1333734fa3fa8dc7
|
|
BLAKE2b-256 checksum How to use checksums |
a2308c9f8db8c9592518f58c2bf232797758e2e27700e8f5e7f9aef6912543fc
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260326-cp312-cp312-manylinux_2_38_aarch64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260326-cp312-cp312-manylinux_2_38_aarch64.whl |
|---|---|
| Size | 20.4 MB |
| Tags | CPython 3.12 Linux glibc 2.38+ ARM64 |
|
SHA-256 checksum How to use checksums |
b928bed89ff5b70355a149bcff139e2e8e8c658153b391a6c2fade95c843f6e8
|
|
BLAKE2b-256 checksum How to use checksums |
8365e658c6d4e5021bcb1852656fc9de395a34513533ec516f85a53f796abec6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260326-cp312-cp312-manylinux_2_35_x86_64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260326-cp312-cp312-manylinux_2_35_x86_64.whl |
|---|---|
| Size | 21.4 MB |
| Tags | CPython 3.12 Linux glibc 2.35+ x86-64 |
|
SHA-256 checksum How to use checksums |
9edcd314faea12f69198e965dde5005112b4ee1ec32ed4e7a277b463bd540592
|
|
BLAKE2b-256 checksum How to use checksums |
23c8a13589f8f65fc62e599344f7899663b8ae6107adb4184d118d6ac94d5dce
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"22.04","id":"jammy","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260326-cp312-cp312-macosx_12_0_arm64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260326-cp312-cp312-macosx_12_0_arm64.whl |
|---|---|
| Size | 12.9 MB |
| Tags | CPython 3.12 macOS 12.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
fe68981dca49b1b3b728cc7cce3eaff20dc05c9d52c4d8ecda3c9a2a2ebc7b63
|
|
BLAKE2b-256 checksum How to use checksums |
b0dd9c00656a72b7aef43a5886ce73e4cd3ab79769384c29ca54cdef822a2d19
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260326-cp311-cp311-manylinux_2_38_aarch64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260326-cp311-cp311-manylinux_2_38_aarch64.whl |
|---|---|
| Size | 20.4 MB |
| Tags | CPython 3.11 Linux glibc 2.38+ ARM64 |
|
SHA-256 checksum How to use checksums |
0f82a57742c0042eadc8eefc973e2bfa45dac6d2799999a9da3b78b0874f16f7
|
|
BLAKE2b-256 checksum How to use checksums |
6cd0eb1206aa393afd90590b81b77410d474fa4d52b912fbec6ba432d0fb4b95
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260326-cp311-cp311-manylinux_2_35_x86_64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260326-cp311-cp311-manylinux_2_35_x86_64.whl |
|---|---|
| Size | 21.4 MB |
| Tags | CPython 3.11 Linux glibc 2.35+ x86-64 |
|
SHA-256 checksum How to use checksums |
d0ef642f44c4af7069361c3b4fbfec3a667cf70f8b4cb9268534d8a84dac0bf9
|
|
BLAKE2b-256 checksum How to use checksums |
df2d9f23e2f4f86bfd4011ec260f17538d27d488db78f23a4b6161f8b3316dc9
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"22.04","id":"jammy","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260326-cp311-cp311-macosx_12_0_arm64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260326-cp311-cp311-macosx_12_0_arm64.whl |
|---|---|
| Size | 12.9 MB |
| Tags | CPython 3.11 macOS 12.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
b26bc55199267a5c4671e751b21514ea20f1fe76345d7d35bce28610703b46ed
|
|
BLAKE2b-256 checksum How to use checksums |
ce15a30e7f5da7ea94c8fbc25c47d6b28b314be38e2a182eaac9d725f48972fa
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260326-cp310-cp310-manylinux_2_38_aarch64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260326-cp310-cp310-manylinux_2_38_aarch64.whl |
|---|---|
| Size | 20.4 MB |
| Tags | CPython 3.10 Linux glibc 2.38+ ARM64 |
|
SHA-256 checksum How to use checksums |
bbca94e83236707c7eaaa61e94cd1b8d17de5f95fea5ea88f058be4a7ef0eb71
|
|
BLAKE2b-256 checksum How to use checksums |
32e1cf2aaab41758c1a9fb4c01f925a02e1f1066ad6782c8ae54f0610d251f88
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260326-cp310-cp310-manylinux_2_35_x86_64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260326-cp310-cp310-manylinux_2_35_x86_64.whl |
|---|---|
| Size | 21.4 MB |
| Tags | CPython 3.10 Linux glibc 2.35+ x86-64 |
|
SHA-256 checksum How to use checksums |
d4c36871935abb062c0b49fc9a74b6f1bc05aa9c4f6e7fd5a0bdd703a53c02cf
|
|
BLAKE2b-256 checksum How to use checksums |
e496b22a96a6b78ab26404c540f7822b056acc469401c4c749c0254b04eb60a6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"22.04","id":"jammy","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260326-cp310-cp310-macosx_12_0_arm64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260326-cp310-cp310-macosx_12_0_arm64.whl |
|---|---|
| Size | 12.9 MB |
| Tags | CPython 3.10 macOS 12.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
d9f91688cbc4a42a1727224df722095b4b1500a059933cf2767a1362ad41e5be
|
|
BLAKE2b-256 checksum How to use checksums |
72ca98796411c0a59a70f82ed0f9f6b0431beda4aa51cde551f13d27aca76eec
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
