Pre-release
This release is a pre-release and may not be stable for production use.
LiteRT-LM Python
Python bindings for LiteRT-LM, a production-ready, open-source inference framework designed to deliver high-performance, cross-platform LLM deployments on edge devices.
Usage
Here is a simple example showing how to load a model and interact with it using the Python API:
import litert_lm
# Load the model using the CPU backend
with litert_lm.Engine("path/to/model.litertlm") as engine:
# Create a conversation and generate a response
with engine.create_conversation() as conversation:
user_message = "Hello world!"
# Alternative: send the full message for prompt template
# user_message = {"role": "user", "content": "Hello world!"}
# Synchronous completion
response = conversation.send_message(user_message)
print("Response:", response["content"][0]["text"])
# Asynchronous / Streaming completion
# stream = conversation.send_message_async(user_message)
# for text_piece in stream:
# print(text_piece, end="", flush=True)
For more information, please visit the main repository.
1 maintainer
Metadata
1 maintainer
Release files for litert-lm-nightly 0.9.0.dev20260325
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distributions (wheels)
Total release size: 218.8 MB
Release files / litert_lm_nightly-0.9.0.dev20260325-cp313-cp313-manylinux_2_38_aarch64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260325-cp313-cp313-manylinux_2_38_aarch64.whl |
|---|---|
| Size | 20.4 MB |
| Tags | CPython 3.13 Linux glibc 2.38+ ARM64 |
|
SHA-256 checksum How to use checksums |
69ed76d7a40b93a9dab7f76bc62f9bf45c441445219f096b0184196b7a964a61
|
|
BLAKE2b-256 checksum How to use checksums |
954e277663bc434fe7f39ee1e1735279ebcf357a8ae5622edf52b2a94588448c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260325-cp313-cp313-manylinux_2_35_x86_64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260325-cp313-cp313-manylinux_2_35_x86_64.whl |
|---|---|
| Size | 21.4 MB |
| Tags | CPython 3.13 Linux glibc 2.35+ x86-64 |
|
SHA-256 checksum How to use checksums |
1856a72646462e3c4578b514c3cdfd2d171020eca022df9cbc22a9147ad3b90a
|
|
BLAKE2b-256 checksum How to use checksums |
61beef4d15f13d50c74f07e2d7b8ac903327284e2b82d77e2dab5303cc94ca55
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"22.04","id":"jammy","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260325-cp313-cp313-macosx_12_0_arm64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260325-cp313-cp313-macosx_12_0_arm64.whl |
|---|---|
| Size | 12.9 MB |
| Tags | CPython 3.13 macOS 12.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
942e7fae2a097fa9ec509644f85ad2c3716dea698a0acbed00b07b060b7bd52d
|
|
BLAKE2b-256 checksum How to use checksums |
669aa2949cfd0c6ea5802b361cba1857c1b8579e296813dcb912820b16077fb5
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260325-cp312-cp312-manylinux_2_38_aarch64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260325-cp312-cp312-manylinux_2_38_aarch64.whl |
|---|---|
| Size | 20.4 MB |
| Tags | CPython 3.12 Linux glibc 2.38+ ARM64 |
|
SHA-256 checksum How to use checksums |
0220321424e9a9a6512805be03d5732ce15da4406967fde759856e89d12d5685
|
|
BLAKE2b-256 checksum How to use checksums |
6df93f82044e28f78881d2596436adacfc2d34cdde8b72f01ebf9c0801261c1b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260325-cp312-cp312-manylinux_2_35_x86_64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260325-cp312-cp312-manylinux_2_35_x86_64.whl |
|---|---|
| Size | 21.4 MB |
| Tags | CPython 3.12 Linux glibc 2.35+ x86-64 |
|
SHA-256 checksum How to use checksums |
c7011da6b1d98e5e1ae8fe71be7f699c33c1839d1b1169421e456fd2b9e034e1
|
|
BLAKE2b-256 checksum How to use checksums |
e2b46233b2050b7366d2b392a6cd8db1bcb4787de8906e49657a63a0b1bcb31c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"22.04","id":"jammy","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260325-cp312-cp312-macosx_12_0_arm64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260325-cp312-cp312-macosx_12_0_arm64.whl |
|---|---|
| Size | 12.9 MB |
| Tags | CPython 3.12 macOS 12.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
09f5f4049079357fefb6e78157684a138f8ea8fcfb49cfec67895a6388294e63
|
|
BLAKE2b-256 checksum How to use checksums |
7b7ba84aeb434fb753f13d5f6f13e85ab583cfe011f4f38dbe3b6f5f5aa3e7ab
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260325-cp311-cp311-manylinux_2_38_aarch64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260325-cp311-cp311-manylinux_2_38_aarch64.whl |
|---|---|
| Size | 20.4 MB |
| Tags | CPython 3.11 Linux glibc 2.38+ ARM64 |
|
SHA-256 checksum How to use checksums |
da9dd6ff7597d37bc4a8d939c93488b9bb16f82f1a7bdb117d15aa4cb7d1e155
|
|
BLAKE2b-256 checksum How to use checksums |
deb00dc3586887ee4beed77b900b80639d25ba70cc4a48a305bde347c0a7d298
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260325-cp311-cp311-manylinux_2_35_x86_64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260325-cp311-cp311-manylinux_2_35_x86_64.whl |
|---|---|
| Size | 21.4 MB |
| Tags | CPython 3.11 Linux glibc 2.35+ x86-64 |
|
SHA-256 checksum How to use checksums |
dee0d4037ce66d66a5750f06ee4076de0ce5bb07efe372fac5cff8e547606cf4
|
|
BLAKE2b-256 checksum How to use checksums |
e953055048acdd6cbcae0b3a46f5e34ce753f6a7c03a5ef1d47707b6c7507ef6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"22.04","id":"jammy","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260325-cp311-cp311-macosx_12_0_arm64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260325-cp311-cp311-macosx_12_0_arm64.whl |
|---|---|
| Size | 12.9 MB |
| Tags | CPython 3.11 macOS 12.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
d2585baf641229d56b5feedf992f6a11de29e461b102e21582a2096e9209fb86
|
|
BLAKE2b-256 checksum How to use checksums |
123894845b1f8334f6743adea17f02f0bbfd17fd5938fce2cdb79c262e5acb96
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260325-cp310-cp310-manylinux_2_38_aarch64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260325-cp310-cp310-manylinux_2_38_aarch64.whl |
|---|---|
| Size | 20.4 MB |
| Tags | CPython 3.10 Linux glibc 2.38+ ARM64 |
|
SHA-256 checksum How to use checksums |
35216a7cdcfc4213c3b1d31f8972f4251474b0ef79039f197892344a1bbc2bf0
|
|
BLAKE2b-256 checksum How to use checksums |
60e3bb22f47e0129e6d4ec4c155ad5f52e0f6291bc0c8ee593e98d8485741c22
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260325-cp310-cp310-manylinux_2_35_x86_64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260325-cp310-cp310-manylinux_2_35_x86_64.whl |
|---|---|
| Size | 21.4 MB |
| Tags | CPython 3.10 Linux glibc 2.35+ x86-64 |
|
SHA-256 checksum How to use checksums |
e0f86c77f34f453ef52d42b04d3074a5e1bb6305e7c777de3695ce638897aaea
|
|
BLAKE2b-256 checksum How to use checksums |
7fcf5d84bb2625ea28c567077b640e6e6b633e1026dc88bcd4f7df8db1dc5ea5
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"22.04","id":"jammy","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260325-cp310-cp310-macosx_12_0_arm64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260325-cp310-cp310-macosx_12_0_arm64.whl |
|---|---|
| Size | 12.9 MB |
| Tags | CPython 3.10 macOS 12.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
e90473063b91446b159119e1f440d5e3ae3f65f2d8af11fe18085d76fa0a6e17
|
|
BLAKE2b-256 checksum How to use checksums |
6e24adf9b6c524635a33dd67adb6503d8cc45639036371f3ea5003029fe49e4c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.1 {"installer":{"name":"uv","version":"0.11.1","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
