Skip to main content

Lightning-fast LLM model introspection

Project description

rvnllm

rvnllm is a blazing-fast Python package for inspecting, diffing, and analyzing GGUF-based LLM model files.

Think ExifTool, but for large language models.

Features

  • Zero-copy GGUF model parsing
  • Tensor-level metadata inspection
  • Structural diffs between model files
  • Cross-platform wheels (Linux, macOS, Windows)

Installation

pip

pip install rvnllm

Build from source

git clone https://github.com/rvnllm/rvnllm.git
cd py/rvn_py
maturin build --release
pip install dist/*.whl

Usage example

import rvnllm

df = rvnllm.info("Llama-3-70B-Q4_0.gguf")
print(df.head())

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

rvn-0.1.2-cp38-abi3-win_amd64.whl (15.2 MB view details)

Uploaded CPython 3.8+Windows x86-64

rvn-0.1.2-cp38-abi3-manylinux_2_39_x86_64.whl (14.6 MB view details)

Uploaded CPython 3.8+manylinux: glibc 2.39+ x86-64

rvn-0.1.2-cp38-abi3-manylinux_2_34_x86_64.whl (14.6 MB view details)

Uploaded CPython 3.8+manylinux: glibc 2.34+ x86-64

File details

Details for the file rvn-0.1.2-cp38-abi3-win_amd64.whl.

File metadata

  • Download URL: rvn-0.1.2-cp38-abi3-win_amd64.whl
  • Upload date:
  • Size: 15.2 MB
  • Tags: CPython 3.8+, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.12

File hashes

Hashes for rvn-0.1.2-cp38-abi3-win_amd64.whl
Algorithm Hash digest
SHA256 3a44c74b7d1da28a096c4728c4e4d6512044b59614ea07394543156d72850c29
MD5 f83ff7d4c6807ec2e7e239a0419360c9
BLAKE2b-256 a2ea3c9cf33e585bdce4041dab4de090f2a93f70ed10310da96d9dc0fe34474e

See more details on using hashes here.

File details

Details for the file rvn-0.1.2-cp38-abi3-manylinux_2_39_x86_64.whl.

File metadata

  • Download URL: rvn-0.1.2-cp38-abi3-manylinux_2_39_x86_64.whl
  • Upload date:
  • Size: 14.6 MB
  • Tags: CPython 3.8+, manylinux: glibc 2.39+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.12

File hashes

Hashes for rvn-0.1.2-cp38-abi3-manylinux_2_39_x86_64.whl
Algorithm Hash digest
SHA256 6ce602148fb5ceef0b3df2b53b69990baa3ef25df3d78c19dc6a4d0fc9d4fef2
MD5 52722198fd499cfc237a947400a246e2
BLAKE2b-256 823ed1372c9107c46cc1e8648494cf0c49827d518e31cbdb219f28328690c6ca

See more details on using hashes here.

File details

Details for the file rvn-0.1.2-cp38-abi3-manylinux_2_34_x86_64.whl.

File metadata

  • Download URL: rvn-0.1.2-cp38-abi3-manylinux_2_34_x86_64.whl
  • Upload date:
  • Size: 14.6 MB
  • Tags: CPython 3.8+, manylinux: glibc 2.34+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.12

File hashes

Hashes for rvn-0.1.2-cp38-abi3-manylinux_2_34_x86_64.whl
Algorithm Hash digest
SHA256 6f5ee7ba5fe0f2d1d1a7099b0cd0687c2ef6fe35a678ac501964ad92f64510b6
MD5 d0e274b5e351f8b0e67b4ce43dd4c2d9
BLAKE2b-256 1ec946f0cbfb4d32100ded8fa9317621eeb35d49367fad37ca8085019024887c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page