Skip to main content

autoinference-utils

Shared endpoint abstractions (SGLangEndpoint, VLLMEndpoint) for autoinference deployments.

Publishing

Bump version in pyproject.toml and merge to main — CI publishes automatically via trusted publishing.

To publish manually: cd autoinference_utils && uv build && uv publish

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

autoinference_utils-0.2.5.tar.gz (10.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

autoinference_utils-0.2.5-py3-none-any.whl (9.4 kB view details)

Uploaded Python 3

File details

Details for the file autoinference_utils-0.2.5.tar.gz.

File metadata

  • Download URL: autoinference_utils-0.2.5.tar.gz
  • Upload date:
  • Size: 10.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.0 {"installer":{"name":"uv","version":"0.12.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for autoinference_utils-0.2.5.tar.gz
Algorithm Hash digest
SHA256 099f62be51cb9b69ba1ad75998bda24f097476871b6f3311ea1e0a2501fcb49c
MD5 acb3d92df3489b388a4945cb68996ec5
BLAKE2b-256 e4bcb274b8329afa3904d8bd0c1bbe11cb44087744e21945e27f6a4cd7803467

See more details on using hashes here.

File details

Details for the file autoinference_utils-0.2.5-py3-none-any.whl.

File metadata

  • Download URL: autoinference_utils-0.2.5-py3-none-any.whl
  • Upload date:
  • Size: 9.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.0 {"installer":{"name":"uv","version":"0.12.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for autoinference_utils-0.2.5-py3-none-any.whl
Algorithm Hash digest
SHA256 169622360c2af70a979d44b4a2afd7a5f26436b6282b4cb9a87bd130ffbb3b04
MD5 b04cda3943d69047e26165b78a8c36eb
BLAKE2b-256 663519074c9799fe87a9bf6d5a586d9d4fbfe4fa7ec3bbb7a1dba89e3cee0938

See more details on using hashes here.

Release history Release notifications | RSS feed

0.2.6

2 files

This release

0.2.5 This release

2 files

0.2.4

2 files

0.2.3

2 files

0.2.2

2 files

0.2.1

2 files

0.2.0

2 files

0.1.2

2 files

0.1.0

2 files

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page