Pre-release
This release is a pre-release and may not be stable for production use.
LiteRT-LM Python
Python bindings for LiteRT-LM, a production-ready, open-source inference framework designed to deliver high-performance, cross-platform LLM deployments on edge devices.
Usage
Here is a simple example showing how to load a model and interact with it using the Python API:
import litert_lm
# Load the model using the CPU backend
with litert_lm.Engine("path/to/model.litertlm") as engine:
# Create a conversation and generate a response
with engine.create_conversation() as conversation:
user_message = "Hello world!"
# Alternative: send the full message for prompt template
# user_message = {"role": "user", "content": "Hello world!"}
# Synchronous completion
response = conversation.send_message(user_message)
print("Response:", response["content"][0]["text"])
# Asynchronous / Streaming completion
# stream = conversation.send_message_async(user_message)
# for text_piece in stream:
# print(text_piece, end="", flush=True)
For more information, please visit the main repository.
1 maintainer
Metadata
1 maintainer
Release files for litert-lm-nightly 0.9.0.dev20260324
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distributions (wheels)
Total release size: 217.2 MB
Release files / litert_lm_nightly-0.9.0.dev20260324-cp313-cp313-manylinux_2_27_x86_64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260324-cp313-cp313-manylinux_2_27_x86_64.whl |
|---|---|
| Size | 21.1 MB |
| Tags | CPython 3.13 Linux glibc 2.27+ x86-64 |
|
SHA-256 checksum How to use checksums |
42409f4d94621fae3a2abf3f73e6628e43b3cabf57caf87f8ab5aeb387350cd9
|
|
BLAKE2b-256 checksum How to use checksums |
e3d1ee4c8c5ed4ca1c430e7d986370c9b5b5e91bfde62eaf1d42851809fe748f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.0 {"installer":{"name":"uv","version":"0.11.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260324-cp313-cp313-manylinux_2_27_aarch64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260324-cp313-cp313-manylinux_2_27_aarch64.whl |
|---|---|
| Size | 20.3 MB |
| Tags | CPython 3.13 Linux glibc 2.27+ ARM64 |
|
SHA-256 checksum How to use checksums |
587fb3d4b88a4e34823915f20f61d2d90c7e3c6d33b0f50a0e6e27052cda3bb5
|
|
BLAKE2b-256 checksum How to use checksums |
05d990fe4607e78dce2c8397a5529e89365bac1ac257321a762c2e5293271cf3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.0 {"installer":{"name":"uv","version":"0.11.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260324-cp313-cp313-macosx_12_0_arm64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260324-cp313-cp313-macosx_12_0_arm64.whl |
|---|---|
| Size | 12.8 MB |
| Tags | CPython 3.13 macOS 12.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
3995916bd03dd793523699a8f48e48c5bf76ba281615d7b63db1ac417ff715e1
|
|
BLAKE2b-256 checksum How to use checksums |
8f1e2b44dabb40a069b3618323f54a5a59ea6a94f1fba660f00b424db4365a50
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.0 {"installer":{"name":"uv","version":"0.11.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260324-cp312-cp312-manylinux_2_27_x86_64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260324-cp312-cp312-manylinux_2_27_x86_64.whl |
|---|---|
| Size | 21.1 MB |
| Tags | CPython 3.12 Linux glibc 2.27+ x86-64 |
|
SHA-256 checksum How to use checksums |
ddfde8c03bb8c4dd11a1ed568c690ac2c9fdb4f6bb05bc7d5bae3f94de228f73
|
|
BLAKE2b-256 checksum How to use checksums |
6a42c986de4508748bf21de8a690d7300ee8b778e90dea62c8009b519b21635f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.0 {"installer":{"name":"uv","version":"0.11.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260324-cp312-cp312-manylinux_2_27_aarch64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260324-cp312-cp312-manylinux_2_27_aarch64.whl |
|---|---|
| Size | 20.3 MB |
| Tags | CPython 3.12 Linux glibc 2.27+ ARM64 |
|
SHA-256 checksum How to use checksums |
98dd893381c2d429e297e1b43288a924445ddd546a2de01bf86b51551de94134
|
|
BLAKE2b-256 checksum How to use checksums |
d18bb633f88b54a4340d87403e721c71ea43d5b4f0a0362d54c01567183abd31
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.0 {"installer":{"name":"uv","version":"0.11.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260324-cp312-cp312-macosx_12_0_arm64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260324-cp312-cp312-macosx_12_0_arm64.whl |
|---|---|
| Size | 12.8 MB |
| Tags | CPython 3.12 macOS 12.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
9bd461266d50d916126726340c1d4d8c16f68f7558fb051fd0a94d4a4ce0de8b
|
|
BLAKE2b-256 checksum How to use checksums |
df7ac74892a724a45d32726d34856f1becd60bad36758c32a3877b5f3bc8a846
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.0 {"installer":{"name":"uv","version":"0.11.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260324-cp311-cp311-manylinux_2_27_x86_64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260324-cp311-cp311-manylinux_2_27_x86_64.whl |
|---|---|
| Size | 21.1 MB |
| Tags | CPython 3.11 Linux glibc 2.27+ x86-64 |
|
SHA-256 checksum How to use checksums |
589c6bc47d94c32d0725edafa64b2dd4119f65beefa884651ba3221dba700ea4
|
|
BLAKE2b-256 checksum How to use checksums |
a1d7324283fcfcfca6920db2e5d936ff31bc03e1f57b7a9290bd39c376e9a6aa
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.0 {"installer":{"name":"uv","version":"0.11.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260324-cp311-cp311-manylinux_2_27_aarch64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260324-cp311-cp311-manylinux_2_27_aarch64.whl |
|---|---|
| Size | 20.3 MB |
| Tags | CPython 3.11 Linux glibc 2.27+ ARM64 |
|
SHA-256 checksum How to use checksums |
bd14817a1aedceacfe72576c5b0cfeec1caf6ed31c3452266f5f612180583db2
|
|
BLAKE2b-256 checksum How to use checksums |
1f8b7c8779684c62439d22235e15003e368289ff4a6d304a6d9c1cb9fd8b95cc
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.0 {"installer":{"name":"uv","version":"0.11.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260324-cp311-cp311-macosx_12_0_arm64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260324-cp311-cp311-macosx_12_0_arm64.whl |
|---|---|
| Size | 12.8 MB |
| Tags | CPython 3.11 macOS 12.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
58bb97545b5c49e2ff22484bf80cedc28f8f46daa69b40a7221966165963180f
|
|
BLAKE2b-256 checksum How to use checksums |
025888244173305056147d08e9e13b1544f6b82c1d232ebf533ed56a8197f9a0
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.0 {"installer":{"name":"uv","version":"0.11.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260324-cp310-cp310-manylinux_2_27_x86_64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260324-cp310-cp310-manylinux_2_27_x86_64.whl |
|---|---|
| Size | 21.1 MB |
| Tags | CPython 3.10 Linux glibc 2.27+ x86-64 |
|
SHA-256 checksum How to use checksums |
f3277f7d058e51c169d61dcf47ff32fd0bbc6916c5de44cfbc005c1817793ffa
|
|
BLAKE2b-256 checksum How to use checksums |
3a959717959b1c43f8e401ca40edbe24bf5d14be2ef258071a17ec5cd2b0cebd
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.0 {"installer":{"name":"uv","version":"0.11.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260324-cp310-cp310-manylinux_2_27_aarch64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260324-cp310-cp310-manylinux_2_27_aarch64.whl |
|---|---|
| Size | 20.3 MB |
| Tags | CPython 3.10 Linux glibc 2.27+ ARM64 |
|
SHA-256 checksum How to use checksums |
6226cbacbbd2608e843349da5e328d27d2328f628f52378835463e09ea113265
|
|
BLAKE2b-256 checksum How to use checksums |
314debbdf691e43e8e4f6d8d199f1734cd264821e5bd7014b3c35a8524b4cd3c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.0 {"installer":{"name":"uv","version":"0.11.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / litert_lm_nightly-0.9.0.dev20260324-cp310-cp310-macosx_12_0_arm64.whl
| Download URL | litert_lm_nightly-0.9.0.dev20260324-cp310-cp310-macosx_12_0_arm64.whl |
|---|---|
| Size | 12.8 MB |
| Tags | CPython 3.10 macOS 12.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
f4cd2a4bbc408ef1c5830f8208826fdb92ebdc63759a911631bfe1524b939f00
|
|
BLAKE2b-256 checksum How to use checksums |
e3eb75f2982939573b3a617392bdb98b2546265f7ee56fde7c4ab97947998d8d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.0 {"installer":{"name":"uv","version":"0.11.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
