Skip to main content

Shared endpoint abstractions for autoinference deployments

Project description

autoinference-utils

Shared endpoint abstractions (SGLangEndpoint, VLLMEndpoint) for autoinference deployments.

Publishing

Bump version in pyproject.toml and merge to main — CI publishes automatically via trusted publishing.

To publish manually: cd autoinference_utils && uv build && uv publish

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

autoinference_utils-0.2.2.tar.gz (9.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

autoinference_utils-0.2.2-py3-none-any.whl (8.2 kB view details)

Uploaded Python 3

File details

Details for the file autoinference_utils-0.2.2.tar.gz.

File metadata

  • Download URL: autoinference_utils-0.2.2.tar.gz
  • Upload date:
  • Size: 9.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.19 {"installer":{"name":"uv","version":"0.11.19","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for autoinference_utils-0.2.2.tar.gz
Algorithm Hash digest
SHA256 2d1c1b60af31e60f62f9344bc4b0d482c04ddfb38921508cee8aa27cbe214a25
MD5 703f25a06e7dc49c53106b3cdde6c500
BLAKE2b-256 ee894a06aeb448c6d92fec983055dca3da8d5d0e8dfb5486c03187b11a2944a6

See more details on using hashes here.

File details

Details for the file autoinference_utils-0.2.2-py3-none-any.whl.

File metadata

  • Download URL: autoinference_utils-0.2.2-py3-none-any.whl
  • Upload date:
  • Size: 8.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.19 {"installer":{"name":"uv","version":"0.11.19","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for autoinference_utils-0.2.2-py3-none-any.whl
Algorithm Hash digest
SHA256 9b7a6390dc6505bcb07c1deaeb024312261c46d0fbc1a9da91309054fcb1696e
MD5 018b1802e31733b76c3c55a69d193b72
BLAKE2b-256 ce7b33a5ce6c4a1d2870ae1e56b01005c7e4f47afcfafd59979e98b90363ccc2

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page