Skip to main content

This tool memoizes data to sqlite.

Project description

cachehash

Cachehash is a lightweight Python library for caching file, directory, and value data in SQLite using fast xxhash checksums.

It is designed to memoize expensive computations by binding results to the content hash of files or directories, so you can skip recomputation when inputs have not changed.


Features

  • Fast hashing with xxhash
  • 📂 Hash individual files, whole directories (structure + metadata + file content), or arbitrary values
  • 💾 Store and retrieve JSON-serializable Python values
  • 🗄️ Backed by SQLite, easy to inspect and portable
  • 🔑 Get/set by path + hash, or by hash alone
  • 🧰 Simple API for integration into data pipelines or caching layers

Installation

pip install cachehash

Requires Python 3.9 – 3.13.


Quick Start

from pathlib import Path
from cachehash.main import Cache

cache = Cache()

# Hash a file
file_hash = cache.hash_file(Path("data.csv"))
print(file_hash)

# Store computation result tied to the file
cache.set("data.csv", {"rows": 1234, "checksum": file_hash})

# Later, retrieve result if file unchanged
result = cache.get("data.csv")
print(result)

API Overview

Cache

  • hash_file(path) → str : Hash file contents
  • hash_directory(path) → str : Hash entire directory tree
  • hash_value(value) → str : Hash an arbitrary string/bytes
  • get(path) → Any | None : Retrieve value by file path + hash
  • get_by_hash(path) → Any | None : Retrieve value by hash only
  • set(path, value, append=False) : Store a value by file path + hash
  • set_by_hash(key, hash, value, append=False) : Store a value for precomputed hash
  • set_value(key, value) : Store a value by key only (not tied to content)
  • get_value(key) : Get a value by key only

Development

Clone the repo and install with dev dependencies:

git clone https://github.com/VerinFast/cachehash.git
cd cachehash
pip install -e .[dev]

Run tests:

pytest

Format code:

black src

License

Free for non-commercial use. See LICENSE for details.


Links

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

cachehash-1.1.4.tar.gz (16.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

cachehash-1.1.4-py3-none-any.whl (12.6 kB view details)

Uploaded Python 3

File details

Details for the file cachehash-1.1.4.tar.gz.

File metadata

  • Download URL: cachehash-1.1.4.tar.gz
  • Upload date:
  • Size: 16.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for cachehash-1.1.4.tar.gz
Algorithm Hash digest
SHA256 11289d9ff0734a775705d4a8149e05ff377edd70c46e1618b661e7b051d9f794
MD5 165b2f499615940ac07fa4b0c6955455
BLAKE2b-256 b2b9c223087c42d71f692c7ecd66ef0c4154436fadae18936d40b832a2000061

See more details on using hashes here.

Provenance

The following attestation bundles were made for cachehash-1.1.4.tar.gz:

Publisher: release.yml on VerinFast/cachehash

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file cachehash-1.1.4-py3-none-any.whl.

File metadata

  • Download URL: cachehash-1.1.4-py3-none-any.whl
  • Upload date:
  • Size: 12.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for cachehash-1.1.4-py3-none-any.whl
Algorithm Hash digest
SHA256 e5b805e649b5e2040cfeeba8732e179e297d31cfb89d9c0aca739ab732be83bf
MD5 5ef7e9aaf7af69a2653fb59178c78f6d
BLAKE2b-256 e63ba584093fe6f6de978a21ce8db869c4d605ca31fed47cbd9c5db63dd3409f

See more details on using hashes here.

Provenance

The following attestation bundles were made for cachehash-1.1.4-py3-none-any.whl:

Publisher: release.yml on VerinFast/cachehash

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page