Pre-release
This release is a pre-release and may not be stable for production use.
LiteRT-LM Python
Python bindings for LiteRT-LM, a production-ready, open-source inference framework designed to deliver high-performance, cross-platform LLM deployments on edge devices.
Usage
Here is a simple example showing how to load a model and interact with it using the Python API:
import litert_lm
# Load the model using the CPU backend
with litert_lm.Engine("path/to/model.litertlm") as engine:
# Create a conversation and generate a response
with engine.create_conversation() as conversation:
user_message = "Hello world!"
# Alternative: send the full message for prompt template
# user_message = {"role": "user", "content": "Hello world!"}
# Synchronous completion
response = conversation.send_message(user_message)
print("Response:", response["content"][0]["text"])
# Asynchronous / Streaming completion
# stream = conversation.send_message_async(user_message)
# for text_piece in stream:
# print(text_piece, end="", flush=True)
For more information, please visit the main repository.
1 maintainer
Metadata
1 maintainer
Release files for litert-lm-nightly 0.9.0.dev20260327
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distributions (wheels)
Total release size: 383.0 MB
Release files / litert_lm_nightly-0.9.0.dev20260327-py3-none-any.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260327-py3-none-any.whl |
|---|---|
| Size | 26.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
008795083ea69c3e5ce630d494cdaede6ebcbb88ce7b6efb1cea954809f4dda0
|
|
BLAKE2b-256 checksum How to use checksums |
35ad654117ed3a8d6a2dab4f468957e7addde59bd8bb05d1659d856ad1a83c74
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.2 {"installer":{"name":"uv","version":"0.11.2","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"22.04","id":"jammy","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260327-cp313-cp313-manylinux_2_38_aarch64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260327-cp313-cp313-manylinux_2_38_aarch64.whl |
|---|---|
| Size | 30.9 MB |
| Tags | CPython 3.13 Linux glibc 2.38+ ARM64 |
|
SHA-256 checksum How to use checksums |
36309012b9f736b82d73bb09e63d9e379bb4143cbfcc28bc905e233783014d26
|
|
BLAKE2b-256 checksum How to use checksums |
ae22583472c963e1aeeb9f4f3e939f8ec0d8e7af77a410d7bbe39708dbd7ae2b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.2 {"installer":{"name":"uv","version":"0.11.2","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260327-cp313-cp313-manylinux_2_35_x86_64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260327-cp313-cp313-manylinux_2_35_x86_64.whl |
|---|---|
| Size | 33.9 MB |
| Tags | CPython 3.13 Linux glibc 2.35+ x86-64 |
|
SHA-256 checksum How to use checksums |
3c119ec935852e39b1cd42adc5c8b9f57de0849d6ee75fc8789d5bcef64f3a6b
|
|
BLAKE2b-256 checksum How to use checksums |
a96223daf3a1b6f414a22233ec11bc880d4864d886db6dfbd7d198475ce14098
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.2 {"installer":{"name":"uv","version":"0.11.2","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"22.04","id":"jammy","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260327-cp313-cp313-macosx_12_0_arm64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260327-cp313-cp313-macosx_12_0_arm64.whl |
|---|---|
| Size | 31.0 MB |
| Tags | CPython 3.13 macOS 12.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
cd0004c3b82d49d9a699de4db3671b14ea9ccfb35e6138cbbf6f2b324de87024
|
|
BLAKE2b-256 checksum How to use checksums |
49b5c64995e1e117b86c82b39d9718c48339c00545b171414f979df043f3e5ab
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.2 {"installer":{"name":"uv","version":"0.11.2","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260327-cp312-cp312-manylinux_2_38_aarch64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260327-cp312-cp312-manylinux_2_38_aarch64.whl |
|---|---|
| Size | 30.9 MB |
| Tags | CPython 3.12 Linux glibc 2.38+ ARM64 |
|
SHA-256 checksum How to use checksums |
ca9f4d825a797c699985b9b493d21ea606fd4868472e9f2f081fb3d00a81e591
|
|
BLAKE2b-256 checksum How to use checksums |
a5872a72f1bc3c8baa8b5cf03eed1532356fba841c48384979e01d1d5105c6ff
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.2 {"installer":{"name":"uv","version":"0.11.2","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260327-cp312-cp312-manylinux_2_35_x86_64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260327-cp312-cp312-manylinux_2_35_x86_64.whl |
|---|---|
| Size | 33.9 MB |
| Tags | CPython 3.12 Linux glibc 2.35+ x86-64 |
|
SHA-256 checksum How to use checksums |
a8c876ee2630982ae1041061612bb4f59048d0f415e066c82ee9732478379d7d
|
|
BLAKE2b-256 checksum How to use checksums |
064143e2c39d12b4b61f2932d3ad360bd527ff088d006aecf78058d41f1794e9
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.2 {"installer":{"name":"uv","version":"0.11.2","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"22.04","id":"jammy","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260327-cp312-cp312-macosx_12_0_arm64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260327-cp312-cp312-macosx_12_0_arm64.whl |
|---|---|
| Size | 31.0 MB |
| Tags | CPython 3.12 macOS 12.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
e45f5b6c4f5cc0b122e4b7f9c193006e530109beedac763109a3e56938684225
|
|
BLAKE2b-256 checksum How to use checksums |
83ab1cee6c65730187a5c24ea89dfa24d1f02f163af89c207e62c6a651765b58
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.2 {"installer":{"name":"uv","version":"0.11.2","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260327-cp311-cp311-manylinux_2_38_aarch64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260327-cp311-cp311-manylinux_2_38_aarch64.whl |
|---|---|
| Size | 30.9 MB |
| Tags | CPython 3.11 Linux glibc 2.38+ ARM64 |
|
SHA-256 checksum How to use checksums |
728f1188c5bd9cbc121279c20ec3b49d96741ea023d9f90172aa4911b2562b16
|
|
BLAKE2b-256 checksum How to use checksums |
d534f06bb3e2921453dc16b8d65ffe841579ebde1bdd2b47ead7e1fbc7a1b56c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.2 {"installer":{"name":"uv","version":"0.11.2","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260327-cp311-cp311-manylinux_2_35_x86_64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260327-cp311-cp311-manylinux_2_35_x86_64.whl |
|---|---|
| Size | 33.9 MB |
| Tags | CPython 3.11 Linux glibc 2.35+ x86-64 |
|
SHA-256 checksum How to use checksums |
3390d14d236a5e438a49b73c198976de6d6e72fd937ca623df62227c956b2074
|
|
BLAKE2b-256 checksum How to use checksums |
2a7067573a1ef651db2b01cd75fa973237f37d7a3e62fa780e1669e342eb9b30
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.2 {"installer":{"name":"uv","version":"0.11.2","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"22.04","id":"jammy","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260327-cp311-cp311-macosx_12_0_arm64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260327-cp311-cp311-macosx_12_0_arm64.whl |
|---|---|
| Size | 31.0 MB |
| Tags | CPython 3.11 macOS 12.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
dd0773e61cb9617b504508b42b3eba60787270db31d28ead131c37b7c4968f07
|
|
BLAKE2b-256 checksum How to use checksums |
269cb436b49ec7f0ac4bc75570d80830dbbe42ab237edad0dfdb0597242c082f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.2 {"installer":{"name":"uv","version":"0.11.2","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260327-cp310-cp310-manylinux_2_38_aarch64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260327-cp310-cp310-manylinux_2_38_aarch64.whl |
|---|---|
| Size | 30.9 MB |
| Tags | CPython 3.10 Linux glibc 2.38+ ARM64 |
|
SHA-256 checksum How to use checksums |
09fb4e6e344cf3f7a596eb907f20f6acdb01c60d2c9e8da71eb919447e1298bb
|
|
BLAKE2b-256 checksum How to use checksums |
fe822688edaef226cf6bfe7682c2526d18ad0f0acf4169867283e021a1dcdc6d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.2 {"installer":{"name":"uv","version":"0.11.2","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260327-cp310-cp310-manylinux_2_35_x86_64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260327-cp310-cp310-manylinux_2_35_x86_64.whl |
|---|---|
| Size | 33.9 MB |
| Tags | CPython 3.10 Linux glibc 2.35+ x86-64 |
|
SHA-256 checksum How to use checksums |
af1c6e9b0107e8e5866147f14af0ef20ca6eb131e11e83ada484cf9270d4fa47
|
|
BLAKE2b-256 checksum How to use checksums |
7c5b2f054d20e479b5d1b03ebed8c2bd8f441f19d2c29d431239aedeb7dbe30a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.2 {"installer":{"name":"uv","version":"0.11.2","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"22.04","id":"jammy","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260327-cp310-cp310-macosx_12_0_arm64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260327-cp310-cp310-macosx_12_0_arm64.whl |
|---|---|
| Size | 31.0 MB |
| Tags | CPython 3.10 macOS 12.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
5a017ff2b583e56ac8274001f8931883e371d1e62ddd922a23a4d19a3274577d
|
|
BLAKE2b-256 checksum How to use checksums |
13b0b106de78acf27276ae013f3e584029b096c487164b33bcbc8f339483c291
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.2 {"installer":{"name":"uv","version":"0.11.2","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
