Cython-augmented Python module providing a variable-length, content-based blocking algorithm
Project description
Chop a file into variable-length, content-based chunks.
Example use: .. code-block:: python
>>> import rolling_checksum_mod >>> # If you have both rolling_checksum_pyx_mod and rolling_checksum_py_mod installed, the software will >>> # automatically prefer the pyx version. Both py and pyx versions require rolling_checksum_py_mod, but >>> # only the pyx version requires rolling_checksum_pyx_mod. >>> with open('/tmp/big-file.bin', 'rb') as file_: >>> for chunk in rolling_checksum_mod.min_max_chunker(file_): >>> # chunk is now a piece of the data from file_, and it will not always have the same length. >>> # Instead, it has the property that if you insert a byte at the beginning of /tmp/big-file.bin, >>> # most of the chunks of the file will remain the same. This can be nice for a deduplicating >>> # backup program. >>> print(len(chunk))
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file rolling_checksum_pyx_mod-1.1.3.tar.gz
.
File metadata
- Download URL: rolling_checksum_pyx_mod-1.1.3.tar.gz
- Upload date:
- Size: 60.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.0 CPython/3.9.2
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 476f4e5d786b5f1071d2dc922f66a20713765365b248fe5c79d6daa795391951 |
|
MD5 | ed96bd311736a13369d353ec7ec175e0 |
|
BLAKE2b-256 | b6261b5053e194f016d80915fe36e30da5d924866fcef8d298b227c454cdb67d |