Skip to main content

Python bindings for the AeroLLM runtime — streaming inference for LLMs that don't fit in GPU memory

Project description

The author of this package has not provided a project description

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

aerollm_api-0.1.0rc1-cp39-abi3-macosx_11_0_arm64.whl (30.6 MB view details)

Uploaded CPython 3.9+macOS 11.0+ ARM64

File details

Details for the file aerollm_api-0.1.0rc1-cp39-abi3-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for aerollm_api-0.1.0rc1-cp39-abi3-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 5a6750d1c203476533ed03a3622a1f60445bed8b08597f92016701a7f1795fc3
MD5 fb9f7fe1dc55f44b6e93657c2c88d70c
BLAKE2b-256 83ad9945131429a5086a60af5167d6bd7f9b4e47a8b222dcbb564ac3af803b87

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page