Skip to main content

GEARLM

Project description

GEAR: An Efficient KV Cache Compression Recipe for Near-Lossless Generative Inference of LLM

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

GEARLM-0.0.5.tar.gz (109.7 kB view details)

Uploaded Source

Built Distribution

GEARLM-0.0.5-py3-none-any.whl (121.5 kB view details)

Uploaded Python 3

File details

Details for the file GEARLM-0.0.5.tar.gz.

File metadata

  • Download URL: GEARLM-0.0.5.tar.gz
  • Upload date:
  • Size: 109.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.10.13

File hashes

Hashes for GEARLM-0.0.5.tar.gz
Algorithm Hash digest
SHA256 41cef4b39c354f3281ab3ed7accd326e0ced81ba1f65ea2b6eeba736d0ad8bd9
MD5 a51eea932dfc4efd52d68f7f7a3d9397
BLAKE2b-256 2317275d55d07aa49f22561c0019bb6b34723ee6e2bcd993fb99eb1bc22fdeda

See more details on using hashes here.

File details

Details for the file GEARLM-0.0.5-py3-none-any.whl.

File metadata

  • Download URL: GEARLM-0.0.5-py3-none-any.whl
  • Upload date:
  • Size: 121.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.10.13

File hashes

Hashes for GEARLM-0.0.5-py3-none-any.whl
Algorithm Hash digest
SHA256 c388b7e4fbe51b07c3bbce7e62e26ff69a975044f0501442c2d4bc420089da36
MD5 c7e81cb74c7ed5c7ca291b3b2c8661fb
BLAKE2b-256 45723513637e3a355930ad53b1b6b8d9769c3208de3f2de26929ae10d70bd78f

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page