autoinference-utils

Shared endpoint abstractions (SGLangEndpoint, VLLMEndpoint) for autoinference deployments.

Publishing

Bump version in pyproject.toml and merge to main — CI publishes automatically via trusted publishing.

To publish manually: cd autoinference_utils && uv build && uv publish

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution for autoinference-utils 0.2.9
File	Size	Uploaded
autoinference_utils-0.2.9.tar.gz	16.3 kB	Oct 7, 2026	Details

Table of built distributions (wheels) for autoinference-utils 0.2.9
File	Interpreter	ABI	Platform	Reset
autoinference_utils-0.2.9-py3-none-any.whl 16.1 kB Oct 7, 2026	Python 3	none	any	Details

Total release size: 32.4 kB

Download URL	autoinference_utils-0.2.9.tar.gz
Size	16.3 kB
Tags	Source
SHA-256 checksum How to use checksums	`198376bdd9bb75a28cd5098deebcd0a73c28db649da1357d7e9e1ed1b901ac72`
BLAKE2b-256 checksum How to use checksums	`ca839ee6ce3646b8c10f8d0f7a94a395bf7b9d56f87088c3d1c97ffc5a367308`
Upload date	Oct 7, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`uv/0.12.23 {"installer":{"name":"uv","version":"0.12.23","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}`

Download URL	autoinference_utils-0.2.9-py3-none-any.whl
Size	16.1 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`bc626abfed8e33620173ca20256a034eeb8145b37430a18cedf6df78d5408ba6`
BLAKE2b-256 checksum How to use checksums	`e580b973851f07e885f4005c58eeadea9b3fab9e3ae707f9ec30c867d4984435`
Upload date	Oct 7, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`uv/0.12.23 {"installer":{"name":"uv","version":"0.12.23","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}`