Chop a file into variable-length, content-based chunks.
Example use: .. code-block:: python
>>> import rolling_checksum_mod
>>> # If you have both rolling_checksum_pyx_mod and rolling_checksum_py_mod installed, the software will
>>> # automatically prefer the pyx version. Both py and pyx versions require rolling_checksum_py_mod, but
>>> # only the pyx version requires rolling_checksum_pyx_mod.
>>> with open('/tmp/big-file.bin', 'rb') as file_:
>>> for chunk in rolling_checksum_mod.min_max_chunker(file_):
>>> # chunk is now a piece of the data from file_, and it will not always have the same length.
>>> # Instead, it has the property that if you insert a byte at the beginning of /tmp/big-file.bin,
>>> # most of the chunks of the file will remain the same. This can be nice for a deduplicating
>>> # backup program.
>>> print(len(chunk))
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file rolling_checksum_pyx_mod-1.1.3.tar.gz.
File metadata
- Download URL: rolling_checksum_pyx_mod-1.1.3.tar.gz
- Upload date:
- Size: 60.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/4.0.0 CPython/3.9.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
476f4e5d786b5f1071d2dc922f66a20713765365b248fe5c79d6daa795391951
|
|
| MD5 |
ed96bd311736a13369d353ec7ec175e0
|
|
| BLAKE2b-256 |
b6261b5053e194f016d80915fe36e30da5d924866fcef8d298b227c454cdb67d
|