autoinference-utils

Shared endpoint abstractions (SGLangEndpoint, VLLMEndpoint) for autoinference deployments.

Publishing

Bump version in pyproject.toml and merge to main — CI publishes automatically via trusted publishing.

To publish manually: cd autoinference_utils && uv build && uv publish

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution for autoinference-utils 0.2.8
File	Size	Uploaded
autoinference_utils-0.2.8.tar.gz	14.3 kB	Oct 6, 2026	Details

Table of built distributions (wheels) for autoinference-utils 0.2.8
File	Interpreter	ABI	Platform	Reset
autoinference_utils-0.2.8-py3-none-any.whl 13.6 kB Oct 6, 2026	Python 3	none	any	Details

Total release size: 27.9 kB

Download URL	autoinference_utils-0.2.8.tar.gz
Size	14.3 kB
Tags	Source
SHA-256 checksum How to use checksums	`157fec8727b5ec12e1c4e594b62d932661de2e22c4baeab2a9839b88aaef21ac`
BLAKE2b-256 checksum How to use checksums	`ac36430e9626e2d97c5017a59fc110aa0d70d2a6e6b3f8b2e9f62e1c4e7b0066`
Upload date	Oct 6, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`uv/0.12.23 {"installer":{"name":"uv","version":"0.12.23","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}`

Download URL	autoinference_utils-0.2.8-py3-none-any.whl
Size	13.6 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`8e5270005dc0befff9a27a93183c45f03bbdde383a843a37d6fa218b9a7d0cec`
BLAKE2b-256 checksum How to use checksums	`76703a982c3529e76dd9d0d959d99323ffc37ed9ec2caf42e30076f7260e1c66`
Upload date	Oct 6, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`uv/0.12.23 {"installer":{"name":"uv","version":"0.12.23","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}`