Fast random access to zstd files
Project description
indexed_zstd
This module provides an IndexedZstdFile class, which can be used to seek inside zstd files without having to decompress them first.
It's shamelessy based on indexed_bzip2, which was refactored to support zstd instead of bzip2 using libzstd-seek.
Kudos to the author for its work.
Seeking inside a block is only emulated, so IndexedZstdFile will only speed up seeking when there are more than one block, which sadly requires a bit of care in zstd.
Usage
Example 1
from indexed_zstd import IndexedZstdFile
file = IndexedZstdFile( "example.zst" )
# You can now use it like a normal file
file.seek( 123 )
data = file.read( 100 )
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
indexed_zstd-1.5.0.tar.gz
(63.3 kB
view hashes)
Built Distributions
Close
Hashes for indexed_zstd-1.5.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3c4bfd3573b6b498f83f6d486922e4e51d45053d0e50cc5e2ab27a1148e91637 |
|
MD5 | dc7546063e133019fa1019efd84630ed |
|
BLAKE2b-256 | 9c33613c98969997fc0bcc9d3156f0b73398b9d46bf6251c1c7f0f0622c52f57 |
Close
Hashes for indexed_zstd-1.5.0-pp38-pypy38_pp73-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3bf372f34b6f886737c96e3230fb3d7f01046a63d3942238d7d9c18d872b08db |
|
MD5 | bca5eb7fa905ac50b06f3052d1a094ea |
|
BLAKE2b-256 | 298fec1f81d97e4389c944e8f899a507af1dc20af734b517d49ac7b870084902 |
Close
Hashes for indexed_zstd-1.5.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6f5ef5537c8a7b67d6acb117af749e660ba8f88e63de6d2093bf853408ebb8b4 |
|
MD5 | c6f8cd901b62a792a7d1d9a67d23f051 |
|
BLAKE2b-256 | c083ba8528871c40220e6c29578b379bd1959e39e9d818c51d379e94d0ce6405 |
Close
Hashes for indexed_zstd-1.5.0-pp37-pypy37_pp73-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8687bd097190eab009aef03b779ae2280329543a833af19f85942d538a7ac0ad |
|
MD5 | 5d8471999832598e85cbb7e3686495cd |
|
BLAKE2b-256 | bdb98e00b9b48e47ca079d77ab4ce311c3333d9889c181b7f768d16656ade6e3 |
Close
Hashes for indexed_zstd-1.5.0-cp310-cp310-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 37839e047ff89a14d2bfbf32f23c94f1a815be6213b9c13206211ff6acb64acb |
|
MD5 | ce9a1d4a81dd74774e2e554f0c8f2e82 |
|
BLAKE2b-256 | 4cc535c394c2cf47dd631508cfc77d42e0d8781d8f3e6bc1e060616f8d5e49a0 |
Close
Hashes for indexed_zstd-1.5.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ee711f7bcdb4caca4f920c6072c1426ac4ea12776a9fa2e7918e32d60a24f685 |
|
MD5 | 5236305629e493ac71a42a4e5f1e382e |
|
BLAKE2b-256 | 61970b05f8de6a0ecdc101a6f92c5bcc61d44f713d4834fcdd4ef6bf8db1314a |
Close
Hashes for indexed_zstd-1.5.0-cp310-cp310-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d7eceefd0966c1e789fd7d49ccf02fcb0b67cb0502348f7af4fcd61f6bb137cc |
|
MD5 | c2986163513e3b089ccd51fa724a2fad |
|
BLAKE2b-256 | 1a2bd24137b31d6f6eefa6caec2d97987a53ddd011ce4da0965512d819ffea5d |
Close
Hashes for indexed_zstd-1.5.0-cp39-cp39-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8794bf07b23767c33d992c084b1aacfe3790f43eb2ecbc46942425fd1cc453ae |
|
MD5 | e27c6305cdd3c568340166a49b3c6a3f |
|
BLAKE2b-256 | f962dd9162ea1733c611bb9317d353d2b666e01c1670e4c97fb092d2023c0c80 |
Close
Hashes for indexed_zstd-1.5.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1169c9cb1596b3d525d88da48b137a3272f7d462326ccd2a3f9cc13a5cc3565d |
|
MD5 | 24ea29b147d5038f9f0d2359f028b125 |
|
BLAKE2b-256 | 51b2e9f2f6132e1edeef7ce9d4e4d909bb24c6c725bcd918e65cbe844d7bc40b |
Close
Hashes for indexed_zstd-1.5.0-cp39-cp39-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a9a70164d39b6d69cf38109b6cba4351ca82e1e40794280a7f68b86859895dae |
|
MD5 | 8cae72795ee99f60fe736870545e8989 |
|
BLAKE2b-256 | 7b9dd50e9f12b02f4b387817ba7364b3945e942d4e490788f003e7c4eb7737f6 |
Close
Hashes for indexed_zstd-1.5.0-cp38-cp38-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bb30c6b53cc53b477c27ef4a1705397203dd8570b2b168c37e6d6050c0b96734 |
|
MD5 | 2b2bd18acdc0654a56f2724ee101796e |
|
BLAKE2b-256 | 81fda59a2e750dbbe0f75251bdfd52f3b0c1153672a83f2b88b848123c5319e3 |
Close
Hashes for indexed_zstd-1.5.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 421a14be8f3f5b7d41611c5da9a506086d4c47f7f9577b75a8c8e5a762a71088 |
|
MD5 | 4f89f2dc971570a68e25ce9bd4216021 |
|
BLAKE2b-256 | ff006df8568cd2b578682491686874d83c8babae9d3aa40836ebe5066ea83090 |
Close
Hashes for indexed_zstd-1.5.0-cp38-cp38-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c65906304b0ffbea562b61ef90a83329a2b257113f30643c5d6edb319301e890 |
|
MD5 | ad8865ce9ab51d010a87af76fa4e922f |
|
BLAKE2b-256 | 8332ea3c1b0444a186df8642cf97e89bf833fd0b920c3e4dd240fc5cacb02b88 |
Close
Hashes for indexed_zstd-1.5.0-cp37-cp37m-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 15bf9337712f6da4918582728a3cddba1ff6fbb0dcdddff6587424b11dc0dc92 |
|
MD5 | b49c9f2623f1ed9f2fe7d8034b316acc |
|
BLAKE2b-256 | 5e35f855bdb1135487deb272fa11f3bd1f933198455cb810b2aac9d7ca5d54d6 |
Close
Hashes for indexed_zstd-1.5.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7cbb1ffdfe6fd0bff798e2a3338d261b9f93d44f8c81d8f8dfa774c5ba75a62d |
|
MD5 | 134142c0a9c99cc1c325aaa15d81a20b |
|
BLAKE2b-256 | 252a4ca61a6aa967cefa2a5b0ace5e74e43aa4ba03a4b838350bda528d94b4ec |
Close
Hashes for indexed_zstd-1.5.0-cp37-cp37m-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e943c724542e599e9581ec0317634b6df2650215a1312364ccaacfc65955d719 |
|
MD5 | 3c4d71e33e5531acbd9b15e41dfe292b |
|
BLAKE2b-256 | 29b4f90bb0f8a601830d6e2bbfd64e0b357f70055081ad091f5c5533d7bf9c94 |
Close
Hashes for indexed_zstd-1.5.0-cp36-cp36m-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 85e7594c8ba4a6428f025a3d279ea0cb70b603ed8cd66d9fffeedfdaf879149f |
|
MD5 | 3184dbb0adb0979434cdc40e009329ec |
|
BLAKE2b-256 | cd2bface4bf34238ca0679761ccf6c3c459ab11ef98686a3001a51e20affc9cc |
Close
Hashes for indexed_zstd-1.5.0-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 06d9da4002ebe7286f959bd5519535e537d828fea5067feb9a40f93ac614bbc2 |
|
MD5 | 3ca81e7ad114f3c29225e0256ddc6de1 |
|
BLAKE2b-256 | 51ba080390c29c8024785f13e6b886642e231820ae3297bc5dd51419bd0a00e4 |
Close
Hashes for indexed_zstd-1.5.0-cp36-cp36m-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | cb53a16bfcd4b490f7802cddce7268c2f5ff97f34c642ab4c8ba3eb424c87276 |
|
MD5 | 09d3519ed5942a8db6ee372258cfab2b |
|
BLAKE2b-256 | c92d189b1cda2735d6c6803f83e08424b4bbd12d0ac46d93c7bbb04d5646ba7b |