autoinference-utils

Shared endpoint abstractions (SGLangEndpoint, VLLMEndpoint) for autoinference deployments.

Publishing

Bump version in pyproject.toml and merge to main — CI publishes automatically via trusted publishing.

To publish manually: cd autoinference_utils && uv build && uv publish

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution for autoinference-utils 0.2.12
File	Size	Uploaded
autoinference_utils-0.2.12.tar.gz	25.9 kB	Oct 8, 2026	Details

Table of built distributions (wheels) for autoinference-utils 0.2.12
File	Interpreter	ABI	Platform	Reset
autoinference_utils-0.2.12-py3-none-any.whl 30.3 kB Oct 8, 2026	Python 3	none	any	Details

Total release size: 56.2 kB

Download URL	autoinference_utils-0.2.12.tar.gz
Size	25.9 kB
Tags	Source
SHA-256 checksum How to use checksums	`9c8100658e70c619a33f9df8fa671bf79aa44116931222df7d266b145ab06e5f`
BLAKE2b-256 checksum How to use checksums	`9b55c38a3578ed027e9aea3cdfc1388bf228cd8c29dbf6309e3b619b1831b3f4`
Upload date	Oct 8, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`uv/0.12.24 {"installer":{"name":"uv","version":"0.12.24","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}`

Download URL	autoinference_utils-0.2.12-py3-none-any.whl
Size	30.3 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`24f09ad6541b358f17eef788afdb0bf391f104b384afc8c076719cc531ac96f0`
BLAKE2b-256 checksum How to use checksums	`f7d0705b4043ad980b247f1c6a7bcb27ca4d4fe63419106cd871726c34e4d4ee`
Upload date	Oct 8, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`uv/0.12.24 {"installer":{"name":"uv","version":"0.12.24","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}`