Pre-release
This release is a pre-release and may not be stable for production use.
LiteRT-LM Python
Python bindings for LiteRT-LM, a production-ready, open-source inference framework designed to deliver high-performance, cross-platform LLM deployments on edge devices.
Usage
Here is a simple example showing how to load a model and interact with it using the Python API:
import litert_lm
# Load the model using the CPU backend
with litert_lm.Engine("path/to/model.litertlm") as engine:
# Create a conversation and generate a response
with engine.create_conversation() as conversation:
user_message = "Hello world!"
# Alternative: send the full message for prompt template
# user_message = {"role": "user", "content": "Hello world!"}
# Synchronous completion
response = conversation.send_message(user_message)
print("Response:", response["content"][0]["text"])
# Asynchronous / Streaming completion
# stream = conversation.send_message_async(user_message)
# for text_piece in stream:
# print(text_piece, end="", flush=True)
For more information, please visit the main repository.
1 maintainer
Metadata
1 maintainer
Release files for litert-lm-nightly 0.9.0.dev20260323
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distributions (wheels)
Total release size: 174.9 MB
Release files / litert_lm_nightly-0.9.0.dev20260323-cp313-cp313-manylinux_2_27_x86_64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260323-cp313-cp313-manylinux_2_27_x86_64.whl |
|---|---|
| Size | 28.1 MB |
| Tags | CPython 3.13 Linux glibc 2.27+ x86-64 |
|
SHA-256 checksum How to use checksums |
09c45d2d21aaa924cb3b80a04ab1e4113e788385952f1acff7f4bae6187f7645
|
|
BLAKE2b-256 checksum How to use checksums |
820a778bf80c6078453172d35e83714cfaf53a52fc49ba34af7eae31df659969
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.10.12 {"installer":{"name":"uv","version":"0.10.12","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260323-cp313-cp313-macosx_12_0_arm64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260323-cp313-cp313-macosx_12_0_arm64.whl |
|---|---|
| Size | 15.6 MB |
| Tags | CPython 3.13 macOS 12.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
7d54c68e5cffb685df19666f4c04bead0bfcf9be34491ca06604f06d268692cb
|
|
BLAKE2b-256 checksum How to use checksums |
11bcdc4e72ceef9edfc8c836d0ef31c952ee0169225dd5a2e7c1266ec21bd34b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.10.12 {"installer":{"name":"uv","version":"0.10.12","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260323-cp312-cp312-manylinux_2_27_x86_64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260323-cp312-cp312-manylinux_2_27_x86_64.whl |
|---|---|
| Size | 28.1 MB |
| Tags | CPython 3.12 Linux glibc 2.27+ x86-64 |
|
SHA-256 checksum How to use checksums |
b3bf3201b755579feed04beee99e118b33532b2a0eb42594fd4b029d76fa4825
|
|
BLAKE2b-256 checksum How to use checksums |
3316dc78b1177cf8aa8691e41aa74320a8904457bb0033dba9f2fa9dfda8f47d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.10.12 {"installer":{"name":"uv","version":"0.10.12","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260323-cp312-cp312-macosx_12_0_arm64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260323-cp312-cp312-macosx_12_0_arm64.whl |
|---|---|
| Size | 15.6 MB |
| Tags | CPython 3.12 macOS 12.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
ffc0530aa28e0b13cbf3a5c585f16329fcd6c125546904a45119b6ae641a17f5
|
|
BLAKE2b-256 checksum How to use checksums |
a11507aa2115618054a77e3bb6f95954152dab425da4ace285ea2b87eb8bed6d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.10.12 {"installer":{"name":"uv","version":"0.10.12","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260323-cp311-cp311-manylinux_2_27_x86_64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260323-cp311-cp311-manylinux_2_27_x86_64.whl |
|---|---|
| Size | 28.1 MB |
| Tags | CPython 3.11 Linux glibc 2.27+ x86-64 |
|
SHA-256 checksum How to use checksums |
9655d1c1c57408ab4fb620a818f21c8cd3ac73f6f2505b81056926444c04c97b
|
|
BLAKE2b-256 checksum How to use checksums |
1eed4215d29f9fd12328b31e0ced848d0eb8d252fde175687fc44b32b7562f81
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.10.12 {"installer":{"name":"uv","version":"0.10.12","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260323-cp311-cp311-macosx_12_0_arm64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260323-cp311-cp311-macosx_12_0_arm64.whl |
|---|---|
| Size | 15.6 MB |
| Tags | CPython 3.11 macOS 12.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
2ce7d0e0ecb096b7b146125d96c7ffce2593af9b334011465cac48d68646107b
|
|
BLAKE2b-256 checksum How to use checksums |
91f98530256dc175476f35d5dc907e54e96d7867796242ea16d7377b3f685619
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.10.12 {"installer":{"name":"uv","version":"0.10.12","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260323-cp310-cp310-manylinux_2_27_x86_64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260323-cp310-cp310-manylinux_2_27_x86_64.whl |
|---|---|
| Size | 28.1 MB |
| Tags | CPython 3.10 Linux glibc 2.27+ x86-64 |
|
SHA-256 checksum How to use checksums |
ccd50ee52cfe5652380249e6df03fa5a16bc8d3f1f6728dc802b415076cb4e5a
|
|
BLAKE2b-256 checksum How to use checksums |
2856ee63c401e03c37cadc2845f0b836d588e63259ab22543b0e2a9ab859af50
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.10.12 {"installer":{"name":"uv","version":"0.10.12","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260323-cp310-cp310-macosx_12_0_arm64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260323-cp310-cp310-macosx_12_0_arm64.whl |
|---|---|
| Size | 15.6 MB |
| Tags | CPython 3.10 macOS 12.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
a2751ae218a5e64b4217b2e72e0377d74f5f3f7c947316acf5aaa9eb29e335ea
|
|
BLAKE2b-256 checksum How to use checksums |
3f7b0ee5a81e36f9c77aeb7c94b55a66027bb95a44c0ba200fc4d7427feae921
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.10.12 {"installer":{"name":"uv","version":"0.10.12","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
