Hexz
High-performance, deduplicated archive format for large-scale data distribution.
Hexz is a single-file archive format (.hxz) designed for storing and distributing massive datasets, disk images, and binary blobs. Unlike traditional archive formats (tar, zip) or deduplication tools (Git LFS), Hexz archives are natively seekable, allowing you to mount a multi-terabyte archive and access any byte instantly without decompressing the entire file.
Key Features
- Block-Level Deduplication: Uses Content-Defined Chunking (CDC) to identify shared blocks across different versions of the same data, even if offsets shift.
- Random Access (Seekable): O(1) seek time. Mount archives via FUSE to treat them as standard block devices or filesystems.
- Thin Archives (Deltas): Create archives that only store changed blocks, referencing a "base" archive for common data. Ideal for versioning large datasets.
- Git-like Workspaces: Checkout archives into writable workspaces. Hexz creates a standard, transparent directory structure using advanced FUSE passthrough while keeping state securely isolated in global storage (
~/.hexz/workspaces/). - Transparent Compression & Encryption: Supports LZ4 and Zstandard compression, and AES-256-GCM encryption.
- Self-Contained: A single
.hxzfile contains the data, the index, and the metadata. No complex repository structure required. - Cloud Native: Supports byte-range requests for on-demand fetching from S3-compatible object storage.
Why Hexz?
| Feature | Git LFS | Hexz |
|---|---|---|
| Deduplication | File-level | Block-level (CDC) |
| Access Pattern | Full Download | Random Access (Seekable) |
| Update Efficiency | Re-upload whole file | Only upload changed blocks |
| Mountable | No | Yes (FUSE) |
Quick Start
Install
make install
Pack an archive
hexz pack ./large_dataset.bin data.hxz --compression zstd
Mount and inspect
mkdir /mnt/data
hexz mount data.hxz /mnt/data
ls -lh /mnt/data
# Access contents via /mnt/data/disk
Create a thin delta
# Create a new version that dedups against the base
hexz pack ./large_dataset_v2.bin v2.hxz --base v1.hxz
Workspaces (Git-like Workflow)
# Checkout an archive into a writable workspace
hexz checkout data.hxz ./my_workspace
cd my_workspace
# Make changes to the mounted files
echo "New data" > README.md
# View changes
hexz status
# Commit changes to a new thin archive (delta)
hexz commit ../data_v2.hxz
Documentation
See the docs/ directory for detailed information on:
License
Licensed under Apache 2.0 or MIT.
1 maintainer
Metadata
1 maintainer
Release files for hexz 0.8.2
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| hexz-0.8.2.tar.gz | 280.1 kB | Details |
Built distributions (wheels)
| File | Reset | |||
|---|---|---|---|---|
| hexz-0.8.2-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl | PyPy 3.10 | PyPy 3.10 7.3 | Linux glibc 2.17+ ARM64 | Details |
| hexz-0.8.2-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl | PyPy 3.9 | PyPy 3.9 7.3 | Linux glibc 2.17+ ARM64 | Details |
| hexz-0.8.2-cp38-abi3-win_amd64.whl | CPython 3.8 | abi3 | Windows x86-64 | Details |
| hexz-0.8.2-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl | CPython 3.8 | abi3 | Linux glibc 2.17+ x86-64 | Details |
| hexz-0.8.2-cp38-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl | CPython 3.8 | abi3 | Linux glibc 2.17+ ARM64 | Details |
| hexz-0.8.2-cp38-abi3-macosx_11_0_arm64.whl | CPython 3.8 | abi3 | macOS 11.0+ ARM64 | Details |
| hexz-0.8.2-cp38-abi3-macosx_10_12_x86_64.whl | CPython 3.8 | abi3 | macOS 10.12+ x86-64 | Details |
Total release size: 9.1 MB
Release files / hexz-0.8.2.tar.gz
| Download URL | hexz-0.8.2.tar.gz |
|---|---|
| Size | 280.1 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
8a6b305c0d774a9e2bdb94e2f9048040447367149a2a94b2434725baad3e9240
|
|
BLAKE2b-256 checksum How to use checksums |
f11ed65b8576a8772864cb44e0819a12ea47534019b4f2f88ef51fbe497121a2
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Mar 16, 2026.
Transparency logRelease files / hexz-0.8.2-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
| Download URL | hexz-0.8.2-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl |
|---|---|
| Size | 1.3 MB |
| Tags | Linux glibc 2.17+ ARM64 PyPy 3.10 PyPy 3.10 7.3 |
|
SHA-256 checksum How to use checksums |
84536d7ade3294fbecc43f5c4123e8c48f3a4e363acf1ba6a0bc51553d765397
|
|
BLAKE2b-256 checksum How to use checksums |
a6e0534d32c6f37adb8d7ec0e31eed94f89ff20e0ae734c6a9d80ce9979f2df6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Mar 16, 2026.
Transparency logRelease files / hexz-0.8.2-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
| Download URL | hexz-0.8.2-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl |
|---|---|
| Size | 1.3 MB |
| Tags | Linux glibc 2.17+ ARM64 PyPy 3.9 PyPy 3.9 7.3 |
|
SHA-256 checksum How to use checksums |
09bffca17035a9428576d6a640affd043451b04cbb4565e45986ff073e469c88
|
|
BLAKE2b-256 checksum How to use checksums |
ae7168fff3f7d3e0e8f42aa15dba6a3d4e16f8d301203f563ea9388685d0348a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Mar 16, 2026.
Transparency logRelease files / hexz-0.8.2-cp38-abi3-win_amd64.whl
| Download URL | hexz-0.8.2-cp38-abi3-win_amd64.whl |
|---|---|
| Size | 1.1 MB |
| Tags | CPython 3.8 Windows x86-64 abi3 |
|
SHA-256 checksum How to use checksums |
629f6495dd59f42e67914aa2ca70cbcd0e4a46a5a2b829431b87db03700c2db6
|
|
BLAKE2b-256 checksum How to use checksums |
ac991b44e1a53296de9550111744231dbe517d273c09960a44a4123148255719
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Mar 16, 2026.
Transparency logRelease files / hexz-0.8.2-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Download URL | hexz-0.8.2-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl |
|---|---|
| Size | 1.4 MB |
| Tags | CPython 3.8 Linux glibc 2.17+ x86-64 abi3 |
|
SHA-256 checksum How to use checksums |
6b7fb26708021f3f0cd67be3ce5cc26af8af8bc919154d25e652ba445e751f14
|
|
BLAKE2b-256 checksum How to use checksums |
67e1cdc87906350dae07da83cb70e7814352712e552f2646bb46356bdcc257b3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Mar 16, 2026.
Transparency logRelease files / hexz-0.8.2-cp38-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
| Download URL | hexz-0.8.2-cp38-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl |
|---|---|
| Size | 1.3 MB |
| Tags | CPython 3.8 Linux glibc 2.17+ ARM64 abi3 |
|
SHA-256 checksum How to use checksums |
66916645a0d8eadf0df912af739bca88fb032d1e6dcb0c6ef5f77e165e037688
|
|
BLAKE2b-256 checksum How to use checksums |
c32696aefef7fa342292fee71b3b9929f51eb2bbd12425486d7adadaeba4cf3a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Mar 16, 2026.
Transparency logRelease files / hexz-0.8.2-cp38-abi3-macosx_11_0_arm64.whl
| Download URL | hexz-0.8.2-cp38-abi3-macosx_11_0_arm64.whl |
|---|---|
| Size | 1.1 MB |
| Tags | CPython 3.8 abi3 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
4f73fa098587cb83844caa2792c85183b0cee199a8b0b395156d0ec032458de8
|
|
BLAKE2b-256 checksum How to use checksums |
a06e88c70a978e37e30f0229a281da4abb5d63e7c1fca54a5a839f6b12ad4a25
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Mar 16, 2026.
Transparency logRelease files / hexz-0.8.2-cp38-abi3-macosx_10_12_x86_64.whl
| Download URL | hexz-0.8.2-cp38-abi3-macosx_10_12_x86_64.whl |
|---|---|
| Size | 1.3 MB |
| Tags | CPython 3.8 abi3 macOS 10.12+ x86-64 |
|
SHA-256 checksum How to use checksums |
92a4f2701e508e88343460bc3f10c06fb18e1e62e17008d8c4c342df20434810
|
|
BLAKE2b-256 checksum How to use checksums |
a083983a2ecc4528ba6ca26d7c9f186c72764ef3886f70aa513a9d70cffc08f2
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Mar 16, 2026.
Transparency log
