rolling-checksum-pyx-mod 1.1.2

Cython-augmented Python module providing a variable-length, content-based blocking algorithm

Chop a file into variable-length, content-based chunks.

Example use: .. code-block:: python

>>> import rolling_checksum_mod
>>> # If you have both rolling_checksum_pyx_mod and rolling_checksum_py_mod installed, the software will
>>> # automatically prefer the pyx version.  Both py and pyx versions require rolling_checksum_py_mod, but
>>> # only the pyx version requires rolling_checksum_pyx_mod.
>>> with open('/tmp/big-file.bin', 'rb') as file_:
>>>     for chunk in rolling_checksum_mod.min_max_chunker(file_):
>>>         # chunk is now a piece of the data from file_, and it will not always have the same length.
>>>         # Instead, it has the property that if you insert a byte at the beginning of /tmp/big-file.bin,
>>>         # most of the chunks of the file will remain the same.  This can be nice for a deduplicating
>>>         # backup program.
>>>         print(len(chunk))