Fast random access to zstd files
Project description
indexed_zstd
This module provides an IndexedZstdFile class, which can be used to seek inside zstd files without having to decompress them first.
It's shamelessy based on indexed_bzip2, which was refactored to support zstd instead of bzip2 using libzstd-seek.
Kudos to the author for its work.
Seeking inside a block is only emulated, so IndexedZstdFile will only speed up seeking when there are more than one block, which sadly requires a bit of care in zstd.
Usage
Example 1
from indexed_zstd import IndexedZstdFile
file = IndexedZstdFile( "example.zst" )
# You can now use it like a normal file
file.seek( 123 )
data = file.read( 100 )
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
indexed_zstd-1.3.1.tar.gz
(60.5 kB
view hashes)
Built Distributions
Close
Hashes for indexed_zstd-1.3.1-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2b4a4e04d5c7dd38b3ba8c02e45fcf1660bcf9cd10be596b254eecc1c5ff8016 |
|
MD5 | d192c3adc1a2f458639ee83c5053614f |
|
BLAKE2b-256 | 55c97ec3585738a45fa9a412fd838448c8c911aa753ade254402b23a6ac02105 |
Close
Hashes for indexed_zstd-1.3.1-pp37-pypy37_pp73-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 623abb736c5f85ed90e0d315f87faa4abade0eee210faa25919768885da4eddc |
|
MD5 | ded61be9cff8fdfaf556b7a58f238931 |
|
BLAKE2b-256 | 2c2057c359168ac1fa4ddc7bcd5a18da330e818f879dc1469fde65556ba6dd6f |
Close
Hashes for indexed_zstd-1.3.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6694b4227294ea0d9c486e1b8b2b494b55f6a2d3e012533bd2b7a2e7aca64ed5 |
|
MD5 | e85db63416a57c0976c6db2a8f7c146f |
|
BLAKE2b-256 | 2b9340e14345b7a61b8936c73e10d018c50934b1e6de90e04a00468cbaa3a6a2 |
Close
Hashes for indexed_zstd-1.3.1-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0dd719a3f53d7b8562f23e6fbdbd05da13cbc2e8fbb255f2cf3b78d6523ef9d7 |
|
MD5 | 8941ac74471c229a957cb4dcd6dd11a1 |
|
BLAKE2b-256 | 416a35f85725ca64e1ab11d0a2c90345a97110089959b2818114f7b48a385864 |
Close
Hashes for indexed_zstd-1.3.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 125110a30229d76ed83e2a37145d089b3fd8c9fe2de270aed081d2ba18f66055 |
|
MD5 | 1c1ef251563e45d05d8568d2067e6670 |
|
BLAKE2b-256 | 3ea7c07ff71eb0c266b53c2c4ba2d63653919c9141678fe5559bace9f68a1102 |
Close
Hashes for indexed_zstd-1.3.1-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a55a0e53c6a713d77ee706fdf33b22af0bc3782257e8777c174a90fc1acb12af |
|
MD5 | 879527083b955bad6483898c5f146313 |
|
BLAKE2b-256 | 76d9b8af645d315cf9a62cea850342b67152415a78036d4b991380b299628939 |
Close
Hashes for indexed_zstd-1.3.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f88b6a063603dc174c8e01df09eaede97c06e499acd164100dfac07cb6b53c2c |
|
MD5 | 2f4cc94e7859d42e0911a97481e401b9 |
|
BLAKE2b-256 | 1174dbfc91477cae5d569b9c4a8f0bd8f2ff19a272822f9a1c1e44fed5336d57 |
Close
Hashes for indexed_zstd-1.3.1-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9b51999eb7691eb88223fa0208ec9130a89af314c10ce60e980f668015501262 |
|
MD5 | 425dd95f5d7eb0bafbb632d445b964c8 |
|
BLAKE2b-256 | 2ea3ac7bc72cabaa64f32282e035d7bf407cc32d335aead973ba5d6149adb6d0 |
Close
Hashes for indexed_zstd-1.3.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ccb2794886fd3512d4778df7eed09e68f1298b51dd97756adef9c9901fd2195d |
|
MD5 | ac44c28db03e16ae27e68f3bc5e97f24 |
|
BLAKE2b-256 | 0d14c349ab609fcb45c219aff8301b82b0cdaa7026cf9722134b061b34ab8c6f |
Close
Hashes for indexed_zstd-1.3.1-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 80e9f5da6014fa582c5b048a6d66b4de6ae03756921ebda6642002291035dfae |
|
MD5 | 311a36b99238c8406dc461cae370a83f |
|
BLAKE2b-256 | 3e68b0f617ce6100528026eee781a008e8ad456a904abcda4baf947f0316a55e |
Close
Hashes for indexed_zstd-1.3.1-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d109727e320933592674f225c5ece0deece388a3281a9297589c6dbd42709766 |
|
MD5 | 5b259867ee933777bbb5ec29592f7e0e |
|
BLAKE2b-256 | 66915362d7cd0dd9f4f64ac8707cd00658fe23da2ba8296db8e86d498f512a05 |
Close
Hashes for indexed_zstd-1.3.1-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6e1a13ac99372ccc69185d465081b42ec7adad1e88a6f04529f0f08e7cd3b4de |
|
MD5 | 45d0401e21e927e5352877a0d981ff38 |
|
BLAKE2b-256 | 3e78e0f0b8a574c2f97f4e318d33256b1cc49cafcfefc1a02ba60dfb429ef673 |