rolling-checksum-py-mod 1.0.1

Pure Python module providing a variable-length, content-based blocking algorithm

Chop a file into variable-length, content-based chunks.

Example use: .. code-block:: python

>>> import rolling_checksum_mod
>>> with open('/tmp/big-file.bin', 'rb') as file_:
>>>     for chunk in rolling_checksum_mod.min_max_chunker(file_):
>>>         # chunk is now a piece of the data from file_, and it will not always have the same length.
>>>         # Instead, it has the property that if you insert a byte at the beginning of /tmp/big-file.bin,
>>>         # most of the chunks of the file will remain the same.  This can be nice for a deduplicating
>>>         # backup program.
>>>         print(len(chunk))