Skip to main content

Arithmetic compression using Llama LLM models

Project description

LLM-Compression

Arithmetic Compression using Llama LLM.

Requirements

To use the LLM model for compression you need to install llama-cpp-python and download a llama llm model in a .gguf format. I used the model Llama-3.2-1B-Instruct-Q4_K_M.gguf in my examples, download link.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llm_compression-0.1.1.tar.gz (17.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

llm_compression-0.1.1-py3-none-any.whl (19.3 kB view details)

Uploaded Python 3

File details

Details for the file llm_compression-0.1.1.tar.gz.

File metadata

  • Download URL: llm_compression-0.1.1.tar.gz
  • Upload date:
  • Size: 17.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.4 CPython/3.12.5 Windows/11

File hashes

Hashes for llm_compression-0.1.1.tar.gz
Algorithm Hash digest
SHA256 aeaf18da247617175eabaf677a3db4781117974a5a11dd389f31c2777a6809e7
MD5 845fdf3687880ce5e18eabe561640287
BLAKE2b-256 e6c2285183984e6a1e38d724ab32c58c5edf68bd7aadc9a5d8b42f0629c7d120

See more details on using hashes here.

File details

Details for the file llm_compression-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: llm_compression-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 19.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.4 CPython/3.12.5 Windows/11

File hashes

Hashes for llm_compression-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 6098fac0575c9785934727588613452af445f801262b4a4a7d78453e761410f3
MD5 cf929ff9fd2a66c0e287dab16971a5fd
BLAKE2b-256 f334706d546f15b5928bf247bf6e1d6915ecb3b7aa93eb5247abf817a4c62039

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page