Skip to main content

autoinference-utils

Shared endpoint abstractions (SGLangEndpoint, VLLMEndpoint) for autoinference deployments.

Publishing

Bump version in pyproject.toml and merge to main — CI publishes automatically via trusted publishing.

To publish manually: cd autoinference_utils && uv build && uv publish

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

autoinference_utils-0.2.3.tar.gz (10.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

autoinference_utils-0.2.3-py3-none-any.whl (8.8 kB view details)

Uploaded Python 3

File details

Details for the file autoinference_utils-0.2.3.tar.gz.

File metadata

  • Download URL: autoinference_utils-0.2.3.tar.gz
  • Upload date:
  • Size: 10.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.29 {"installer":{"name":"uv","version":"0.11.29","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for autoinference_utils-0.2.3.tar.gz
Algorithm Hash digest
SHA256 5054fd9c92f3681c0f6275226f2103cdd04c9a6f61d12e6096cb3c83b860c3a4
MD5 68eeec602c3e3df978164f5fb7a3cc25
BLAKE2b-256 f964fc80fc9c0273680a282d6001c69bdce7ff77ce077ed55ebeb01924f90d41

See more details on using hashes here.

File details

Details for the file autoinference_utils-0.2.3-py3-none-any.whl.

File metadata

  • Download URL: autoinference_utils-0.2.3-py3-none-any.whl
  • Upload date:
  • Size: 8.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.29 {"installer":{"name":"uv","version":"0.11.29","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for autoinference_utils-0.2.3-py3-none-any.whl
Algorithm Hash digest
SHA256 5ed82eacd3349e7896179ff2b3e082294744ff5159f13dcbd8a06f13f49f1893
MD5 46e7a348eaad060f520cd7aac28fd396
BLAKE2b-256 ad93f669f6c4773654adbe27569cfefa510f7eff2f0a096aa52c93bb428f28d8

See more details on using hashes here.

Release history Release notifications | RSS feed

0.2.6

2 files

0.2.5

2 files

0.2.4

2 files

This release

0.2.3 This release

2 files

0.2.2

2 files

0.2.1

2 files

0.2.0

2 files

0.1.2

2 files

0.1.0

2 files

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page