Skip to main content

autoinference-utils

Shared endpoint abstractions (SGLangEndpoint, VLLMEndpoint) for autoinference deployments.

Publishing

Bump version in pyproject.toml and merge to main — CI publishes automatically via trusted publishing.

To publish manually: cd autoinference_utils && uv build && uv publish

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

autoinference_utils-0.2.6.tar.gz (11.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

autoinference_utils-0.2.6-py3-none-any.whl (9.9 kB view details)

Uploaded Python 3

File details

Details for the file autoinference_utils-0.2.6.tar.gz.

File metadata

  • Download URL: autoinference_utils-0.2.6.tar.gz
  • Upload date:
  • Size: 11.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.5 {"installer":{"name":"uv","version":"0.12.5","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for autoinference_utils-0.2.6.tar.gz
Algorithm Hash digest
SHA256 4fd57b3346333bed6dc0248e3071344c3d3f3a0370c94c4c5f417adb06d6e603
MD5 2fee99021987fa684d66985e67c997c5
BLAKE2b-256 798ca899aa9eb71dd975742e9dbef43c996f010a1113441cd08c1b3e753cada5

See more details on using hashes here.

File details

Details for the file autoinference_utils-0.2.6-py3-none-any.whl.

File metadata

  • Download URL: autoinference_utils-0.2.6-py3-none-any.whl
  • Upload date:
  • Size: 9.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.12.5 {"installer":{"name":"uv","version":"0.12.5","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for autoinference_utils-0.2.6-py3-none-any.whl
Algorithm Hash digest
SHA256 ac8d6f864813636db725f54cb018eeca21bb571a3552f912757dff71474a5a81
MD5 a60d2e714e552ff57996cee926ecb9c9
BLAKE2b-256 f8414fe6e57a5e0893f8cc1ad044cc35863484b1b0921ff9c59fc17fe7fc0942

See more details on using hashes here.

Release history Release notifications | RSS feed

This release

0.2.6 This release

2 files

0.2.5

2 files

0.2.4

2 files

0.2.3

2 files

0.2.2

2 files

0.2.1

2 files

0.2.0

2 files

0.1.2

2 files

0.1.0

2 files

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page