Fast random access to zstd files
Project description
indexed_zstd
This module provides an IndexedZstdFile class, which can be used to seek inside zstd files without having to decompress them first.
It's shamelessy based on indexed_bzip2, which was refactored to support zstd instead of bzip2 using libzstd-seek.
Kudos to the author for its work.
Seeking inside a block is only emulated, so IndexedZstdFile will only speed up seeking when there are more than one block, which sadly requires a bit of care in zstd.
Usage
Example 1
from indexed_zstd import IndexedZstdFile
file = IndexedZstdFile( "example.zst" )
# You can now use it like a normal file
file.seek( 123 )
data = file.read( 100 )
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
indexed_zstd-1.4.1.tar.gz
(63.3 kB
view hashes)
Built Distributions
Close
Hashes for indexed_zstd-1.4.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 714f50ff8163ec4ada0e7f9bd8517f8c9642be135aabb2aa6f6699d5a449b83b |
|
MD5 | e939bbead5c8a801d2c2bebf21782039 |
|
BLAKE2b-256 | b79d04adf1e7a209b5c0524a384572dc92105eab288e9151cd4422598eb10b40 |
Close
Hashes for indexed_zstd-1.4.1-pp38-pypy38_pp73-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7f18d43ebcceda5a9cfe167b2a83ce5f1c058cd86010f2e95300979cfbbf2c26 |
|
MD5 | 2accddef6c968ae42231425ee76afa73 |
|
BLAKE2b-256 | b1698d787808a12f99ea39c5a40a8d37c8a57dfd87d14063a9284cfbfad1b337 |
Close
Hashes for indexed_zstd-1.4.1-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1de96cd9a7039aa2ad5f90fcfcc10d6cb47b7f6b66c40f81ef5ab0d0cef07282 |
|
MD5 | 4caba456076a03778d53e652a3f76a87 |
|
BLAKE2b-256 | e3ace6d32c734509ca5e6200d591101813ed72a3d152471c6a338306ec75db4d |
Close
Hashes for indexed_zstd-1.4.1-pp37-pypy37_pp73-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4998a2aee59dc672c308488bb59cc63b15f5d10603826e248d5674654f0b9625 |
|
MD5 | 96f4761c0167e03a77ec7d6a82e42695 |
|
BLAKE2b-256 | 07a7816b37d751cc3d8f4825dc464a08112f7cc92f4e400b61fac9e0cbe8d23a |
Close
Hashes for indexed_zstd-1.4.1-cp310-cp310-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a462cd3883dcec48b8ee82bff520d425f663861564df18608a9e9ff7d48430fb |
|
MD5 | e1166c3afb5db350ddeadef5350a8ff4 |
|
BLAKE2b-256 | 3b77fbd6cff7946e867f4e594ddf358ba617c200e31ac8617113ff43545e21cd |
Close
Hashes for indexed_zstd-1.4.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f677f82a691d83d3c491a75db35dafbbeaf0c14c4f942c26d0b305e06080a01c |
|
MD5 | bf98768c492053caaedb7b2d4a3e7888 |
|
BLAKE2b-256 | b2dbf8300529425ae37330cf7fd3629d934ba304379e636c3e835cc0a6071ead |
Close
Hashes for indexed_zstd-1.4.1-cp310-cp310-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 611889aeb43acd8f2717ee4359cd046237deb90e76a3d913687dcf1365e487a2 |
|
MD5 | a18ae527a70d761e4cdf0f06e0d1ee27 |
|
BLAKE2b-256 | 1e488901c8b55f81c83180fe8d39db90f2403d0f09aa0967f540976f3cc1d14d |
Close
Hashes for indexed_zstd-1.4.1-cp39-cp39-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b8fd8b3a407a6b5a04ce2dcc9cbdd6eadfa01491a4229eb9c7abf52fa09f3164 |
|
MD5 | 523f940aea86d55088c62edde79627b6 |
|
BLAKE2b-256 | 2b6755ed1c85429719ebd29ff3b3495814b2aca1711386870de5538c6031edd7 |
Close
Hashes for indexed_zstd-1.4.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6069851819900ae7a1bfa0e6c1f7ac47f59182e9d9a640521c3fa130fc9484d9 |
|
MD5 | 405a6951a324c1c5c8059d7849c595c9 |
|
BLAKE2b-256 | 978eb4a0bf1fa8a93309bf5d88c5347b678ee5eeaba493b7bf9d602b2041357c |
Close
Hashes for indexed_zstd-1.4.1-cp39-cp39-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 16a3c39fea6b18865a1883dc87eed7c6ce70135ed85b9f404a21ebcb8808da36 |
|
MD5 | ef71313c0a99ee92377d004c22659edf |
|
BLAKE2b-256 | 3b584ead4191fe3e8d54f7bea767f2a116bf9cb69acac493854119033b28dfea |
Close
Hashes for indexed_zstd-1.4.1-cp38-cp38-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 316d9af0f802c71bf12ae48362cc182ffbd1d1edc33e9883a9fdfe797c5e5d90 |
|
MD5 | 2b0f2d78f359acb422ff49b2accf086a |
|
BLAKE2b-256 | 4a9ad7d33f5acc25f224a2b959accc630620650fc9afc12bcba22f384d246df3 |
Close
Hashes for indexed_zstd-1.4.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6d9c43be43cb5d2daecc3beb9e3e7502affc0a8c14ea2d91dfa581310aa6c92b |
|
MD5 | 84e739af7eea7d30b213cfaa012dc2e9 |
|
BLAKE2b-256 | dfb4b53c8b6bdbc209c804effb22435e33d31d4d027ead6322f531112d71bacc |
Close
Hashes for indexed_zstd-1.4.1-cp38-cp38-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 03b3a3f3da078e446297708ef93adafd1c745fb855b0728c93ec4c34461e9460 |
|
MD5 | 8554b7387cfdf9a71d24dfd5a9c3d1f1 |
|
BLAKE2b-256 | e21c1120480e09befe0f0304d2052fb4ee4fb366d98853385935f85c3d609ac0 |
Close
Hashes for indexed_zstd-1.4.1-cp37-cp37m-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b57684c6a2c5b0440f7d42bd788ff5880bc07f794e2abf8b8212f6ac2e53b8f6 |
|
MD5 | 58880c6d6387a733e90c3b7ffdcdf30a |
|
BLAKE2b-256 | bd3ffc567ed4ea9f03a7a994794e742b3df3c738a0b6e101068e1fbcdcb5daf6 |
Close
Hashes for indexed_zstd-1.4.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ddf96c7eee3cbccc28056c6301491d4c3180a65ed569899d3eb06323e04fb4c7 |
|
MD5 | a4bdce5ec06c8bf0187f989ce9b14edb |
|
BLAKE2b-256 | 80fc589f42809a85766e97dffc42944214e79f3085a18a73df2d75173a2b69ab |
Close
Hashes for indexed_zstd-1.4.1-cp37-cp37m-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | cb80af359141887500ce13a82826333c6f5a91c80bcda2b2ac8c32f859315b87 |
|
MD5 | fffec36225134f8481528064c2aa56a6 |
|
BLAKE2b-256 | 7664192206b673b855a9e672bd545e3f01760bcacfa0317d8404e3992ea07bf6 |
Close
Hashes for indexed_zstd-1.4.1-cp36-cp36m-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 08addb0d212527c605e5c6f1c62f2e0512633148fbaae94d8b806e227deffbf7 |
|
MD5 | 0cf44f820bd52c1b821ed2d4198b28b9 |
|
BLAKE2b-256 | 941293403259b44f19a7bc87102269b523efe366a9ab12f014cbf7c069a11aed |
Close
Hashes for indexed_zstd-1.4.1-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0785811025c3fd7f7a94dd2cceb4b8818c4ed9fcb5185cc98851e89400bf39a2 |
|
MD5 | 4e8d8eab1410c74b9b15edbd0c64e16e |
|
BLAKE2b-256 | e2c45cad9eed831dda151736f6893fc5510100c20daa22cddeabd8c7efebbbd0 |
Close
Hashes for indexed_zstd-1.4.1-cp36-cp36m-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5bb2775a9d6fff8d631a84d54cd0ca755eace922376c6fcf59a6cb64bde789d0 |
|
MD5 | c77d22105bc408ebd8583a1bace8d33d |
|
BLAKE2b-256 | 9c23faf039f27e29e40cd96b134051107ee6bd2666e2e4748c474736acf1f444 |