Dependency Cache

🚧 Work In Progress 🚧

Description

Dependency Cache is a caching layer for object methods, with invalidation driven by a dependency graph. Rather than re-running expensive, deeply nested calculations on every call, it stores each method's result and only recomputes (and marks downstream methods for recalculation) when one of its declared dependencies actually changes. Under the hood, this project is written in Rust using pyo3 and built with maturin.

Installation

Install the latest stable version from PyPI:

pip install dependency-cache

API Overview

All decorators accept optional parameters like use_cache, dependencies, track_runtime_dependencies, and serialisable. For exact signatures and types, see the generated stubs file.

Setup

This project uses (and requires) uv as a package manager and maturin to compile.

To set up a local dev environment:

• install python dependencies

uv sync

• generate local development file for testing (and update pyi file for accurate typechecking)

maturin develop --generate-stubs
maturin develop -r --generate-stubs

• run python tests

uv run pytest
uv run pytest -vv

• run rust tests

cargo test

• temporary fix: generate stubs currently produces a file that is incorrectly formatted, use ruff to format the pyi file immediately

maturin develop --generate-stubs | uv run ruff format ./python/dependency_cache/dependency_cache.pyi

Quick Example

from dependency_cache import DependencyCacheBase, automagically_dependency_cached


class ExampleCalculation(DependencyCacheBase):
    """   C
        /   \
       A     B
    """

    def __init__(self, x, y):
        self.x = x
        self.y = y

    @automagically_dependency_cached()
    def A(self):
        print("calculating A")
        return self.x

    @automagically_dependency_cached()
    def B(self):
        print("calculating B")
        return self.y

    @automagically_dependency_cached()
    def C(self):
        print("calculating C")
        return self.B() + self.A()


c = ExampleCalculation(3, 5)
print(f"Result of C = {c.C()}")  # calculates all, prints 8
print(f"Result of C = {c.C()}")  # hits cache, prints 8

c.update_cached_value("A", 0)  # updates A, then invalidates C
print(f"Result of C = {c.C()}")  # recalculates C returns 5

This example can be found at python/examples/example.py with more runnable examples and use cases provided in the python/examples folder.

uv run ./python/examples/example.py

TODOs

This project is still a work in progress, with everything from API to underlying design subject to change on my whim.

Current TODO list (in no particular order):

• add global_variable to link objects together
• add validation to static dependencies, ensure methods are of decorator class (?)
• improve plot_dependency_graph (maybe to GUI?) with interactive nodes
• add object thread safety for python 3.14+
• work out how best to handle nested objects