Fast random access to zstd files
Reason this release was yanked:
superseded by 1.2.1
Project description
indexed_zstd
This module provides an IndexedZstdFile class, which can be used to seek inside zstd files without having to decompress them first.
It's shamelessy based on indexed_bzip2, which was refactored to support zstd instead of bzip2 using libzstd-seek.
Kudos to the author for its work.
Seeking inside a block is only emulated, so IndexedZstdFile will only speed up seeking when there are more than one block, which sadly requires a bit of care in zstd.
Usage
Example 1
from indexed_zstd import IndexedZstdFile
file = IndexedZstdFile( "example.zst" )
# You can now use it like a normal file
file.seek( 123 )
data = file.read( 100 )
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
indexed_zstd-1.2.0.tar.gz
(60.3 kB
view hashes)
Built Distributions
Close
Hashes for indexed_zstd-1.2.0-cp39-cp39-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b8dc752029d563a64dbd489af2e13c5dc1890cfde70782efb1e7aa23e86572be |
|
MD5 | 33c8c2e45dc4258e0e32ac8a88e0a82c |
|
BLAKE2b-256 | c3d3046d748f13a79d6334dedb49b2078829a41c61a7deed2cbf651f4b886d55 |
Close
Hashes for indexed_zstd-1.2.0-cp39-cp39-manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b80af4350458f51c1863f1656a28826b3cb778c0d503243fba3dec129be6c271 |
|
MD5 | ed326a6a58ac5ffdd657ba19c892cfaf |
|
BLAKE2b-256 | 1a5f1058baaf689dc11018dc05da1232fe2341edc228cdd670337fc71451b2b6 |
Close
Hashes for indexed_zstd-1.2.0-cp39-cp39-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 32cd52b9748a4d06bd7f8d8ffec01d950ef45794cf60146f8979c17e03e803d6 |
|
MD5 | 5dfdb0c4e011a6c79115645d25eb43b3 |
|
BLAKE2b-256 | 5f4404169109e295f8e678c226159e3cc0cac9b55d5a0b6079d8d8dfa2903139 |
Close
Hashes for indexed_zstd-1.2.0-cp38-cp38-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2fc16fdf5846f58d8e4b981d7d761febd5b40d76123fdcb85f3bf3808e5a050e |
|
MD5 | 6ce943919d3df0e4b0c28fdfceac2b3e |
|
BLAKE2b-256 | 4c44f40eca73d959a1dad638423267765a50fcbf4392cb8df7252acfca90902d |
Close
Hashes for indexed_zstd-1.2.0-cp38-cp38-manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | af336b3d049b3b1e5a5eaab18e4c62d37e167654664de3c53ecd8bedc1aa7781 |
|
MD5 | 92b12dc84ce168bf6adccd02de4df127 |
|
BLAKE2b-256 | 72f70f84a316f8d7831463ce836765dd5fbb0d8bdd32373dbeed8d3e1f86354b |
Close
Hashes for indexed_zstd-1.2.0-cp38-cp38-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | cbfa23bc829f21e997e46277bc4dec8441081314808fd221d30a6b60303657b0 |
|
MD5 | 99721331911a9b07faf34537e3aa2022 |
|
BLAKE2b-256 | e7e169a96ed76a3ef6dfe28646a11617063830e2894d1071ce21dbeeca00bdb4 |
Close
Hashes for indexed_zstd-1.2.0-cp37-cp37m-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e1b82847b740484c29e7943170a4978ce394690533139436d8e8bbca0f8e0e4d |
|
MD5 | 214c34358bc3e9659eb034cf40efe206 |
|
BLAKE2b-256 | e2c1b1bb6fb954e2fedb072157ff2eec49374ea7a69a11baee51562533bfb7b7 |
Close
Hashes for indexed_zstd-1.2.0-cp37-cp37m-manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 39c4da1e2deb78e5984462e04a763cf84289bb505d0ae2ea319400d52fdee0cb |
|
MD5 | 9c7b37d6c73e5d0b51363f8369656137 |
|
BLAKE2b-256 | 2ab93f070f9cafcf20746744aafcc2890e0e012f933bd8c1b90cb73bcb05c9dc |
Close
Hashes for indexed_zstd-1.2.0-cp37-cp37m-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ebd5d6427e2147555894d909f035f745e7a8d716b71b76c8e36aad40dad6fb2e |
|
MD5 | dc58efdaf687037b45cb0bb517734246 |
|
BLAKE2b-256 | cf532c46011f28e8cf28cd5f3448330ab7dc5f2e84616e9d510ae427e0456003 |
Close
Hashes for indexed_zstd-1.2.0-cp36-cp36m-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 78d91d7a1984132176123cda3716bd1b4ea30556da2262c6dd63ab3c335b5730 |
|
MD5 | a60410ca14bc2fd9fb9ed2b42a7e1c91 |
|
BLAKE2b-256 | 87c485c85ce4214afa4f331a526b4db08ec51169e9c307c8df7e8b0baa2d0896 |
Close
Hashes for indexed_zstd-1.2.0-cp36-cp36m-manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2c5230e6ba36ea889b2eb0d31efa5a95425eb7b68c38e4d09631060726cc79a8 |
|
MD5 | 3269cc4166f73e51d8c2d5d994e83e08 |
|
BLAKE2b-256 | 4d56c70cd451951508d44c466e3a144dccbe107031760087611291d196cf19d9 |
Close
Hashes for indexed_zstd-1.2.0-cp36-cp36m-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d9f83394b6a4086b7ea762781a24a2da399dd395fe27c34c577bdfd200217261 |
|
MD5 | 8649dc0e10b18badeb077202cce7cc86 |
|
BLAKE2b-256 | 7085fa6f385775cb526f22253d78dccd5e7bef084d6c6e6c8f604ef08a9744b0 |
Close
Hashes for indexed_zstd-1.2.0-cp35-cp35m-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0072c8e6230729ec7dbdb739d89e04c5540cf31911a67287d010a7798f005696 |
|
MD5 | 8efcfd12db6cbb290c4797c3a23fdce4 |
|
BLAKE2b-256 | 797c56a89a02640e150852fa2628f3fce1f9bf546f39dab9b076b5569fe0f0d7 |
Close
Hashes for indexed_zstd-1.2.0-cp35-cp35m-manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c841e44c79f973ea85e7131515befbe087a862002be9aa957a7cf1adb2ed8dd7 |
|
MD5 | a842c6030e891bdff434a78e9bdb44ab |
|
BLAKE2b-256 | 28bb1666069bfded9434278bb163cdb91bb86b7f17e2e5d90c1b7544852229d5 |
Close
Hashes for indexed_zstd-1.2.0-cp35-cp35m-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6c0ff2395673ef5b59e8503418c71c3c088cf6f3157d7d8b70e036a42bf8b7a3 |
|
MD5 | cbb62b35bdf62367f00c3c49a871bacf |
|
BLAKE2b-256 | 60c6fb3a32fe85ce98e6c4051107bd7aefb3b9913b7fafe0dcdc4eec124355ff |