autoinference-utils

Shared endpoint abstractions (SGLangEndpoint, VLLMEndpoint) for autoinference deployments.

Publishing

Bump version in pyproject.toml and merge to main — CI publishes automatically via trusted publishing.

To publish manually: cd autoinference_utils && uv build && uv publish

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

autoinference_utils-0.2.4.tar.gz (10.7 kB view details)

Uploaded Jul 23, 2026 Source

If you're not sure about the file name format, learn more about wheel file names.

The dropdown lists show the available interpreters, ABIs, and platforms. Enable javascript to be able to filter the list of wheel files.

Uploaded Jul 23, 2026 Python 3

Details for the file autoinference_utils-0.2.4.tar.gz.

Download URL: autoinference_utils-0.2.4.tar.gz
Upload date: Jul 23, 2026
Size: 10.7 kB
Tags: Source
Uploaded using Trusted Publishing? Yes
Uploaded via: uv/0.11.31 {"installer":{"name":"uv","version":"0.11.31","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Details for the file autoinference_utils-0.2.4-py3-none-any.whl.

Download URL: autoinference_utils-0.2.4-py3-none-any.whl
Upload date: Jul 23, 2026
Size: 9.4 kB
Tags: Python 3
Uploaded using Trusted Publishing? Yes
Uploaded via: uv/0.11.31 {"installer":{"name":"uv","version":"0.11.31","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Hashes for autoinference_utils-0.2.4-py3-none-any.whl
Algorithm	Hash digest
SHA256	`2aa1fef0a7481722fb0e72ee7705088128f6125e8fe352ea3fcbeda09dcc3f29`
MD5	`4e24a1ec9652cb305e870ceaa4f7cad2`
BLAKE2b-256	`389573f5fd80e89ae2bda27dbc0745571df6a2a6aaf7c8019641e5983e243f4b`