Fast random access to zstd files
Reason this release was yanked:
superseded by 1.2.0
Project description
indexed_zstd
This module provides an IndexedZstdFile class, which can be used to seek inside zstd files without having to decompress them first.
It's shamelessy based on indexed_bzip2, which was refactored to support zstd instead of bzip2 using libzstd-seek.
Kudos to the author for its work.
Seeking inside a block is only emulated, so IndexedZstdFile will only speed up seeking when there are more than one block, which sadly requires a bit of care in zstd.
Usage
Example 1
from indexed_zstd import IndexedZstdFile
file = IndexedZstdFile( "example.zst" )
# You can now use it like a normal file
file.seek( 123 )
data = file.read( 100 )
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
indexed_zstd-1.1.1.tar.gz
(59.7 kB
view hashes)
Built Distributions
Close
Hashes for indexed_zstd-1.1.1-cp39-cp39-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ec54670f73a202372edd79e03680c96310be20a6604c0aa0ff98628a8bf632ff |
|
MD5 | cb2f8e489d871346e6ea4186ce2c543b |
|
BLAKE2b-256 | 62753592ec72d44abddb0db2d2637a4661faec8a05d95287d3059a83b2ce912f |
Close
Hashes for indexed_zstd-1.1.1-cp39-cp39-manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 21a6c89ff5f763a103834d052132603449ee9f549c563422cb5cb71f14285e64 |
|
MD5 | 50911c3b3613eb053c2f3b580819d90b |
|
BLAKE2b-256 | 9f2236c9cd8adaec86794b67d6e8cf8242e9aafb67b5f449942909ea3b853c58 |
Close
Hashes for indexed_zstd-1.1.1-cp39-cp39-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4556b9d0c1884187c0f1b8a82c9658a597a1dc1a9869f1b9032d777399d800bb |
|
MD5 | 7b9bfab25f5e5ddfb101fbb7b87f1c19 |
|
BLAKE2b-256 | ac2e08b7276c9c01c0c74b548720ae41119f40c681e4f508bfbca39a8fad853c |
Close
Hashes for indexed_zstd-1.1.1-cp38-cp38-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 68b895e2f3ff34e4f446b487d4aa972155e422160775a27243c005f8e809cf1f |
|
MD5 | dcf1c95dc55b79761b0d8c8ad45ed0f5 |
|
BLAKE2b-256 | 4496a1a1d3e96fd34259f9a2457cbcee3c92a184a3430ea2062e51428b030aac |
Close
Hashes for indexed_zstd-1.1.1-cp38-cp38-manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d21abae667990ea2aadca2912e5ad5b2c2d46a85f38c765b957b08cb5cb37c8e |
|
MD5 | 3ff502a5f214125cc4c46eb19ae71a89 |
|
BLAKE2b-256 | 69bcae19ffea40a2770fba2a31bb8ba3691943ebc09bfa30fed6af815c96af2e |
Close
Hashes for indexed_zstd-1.1.1-cp38-cp38-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5b376ec8ba186fbd03be9f8ceeeabbc277151962f64a7c4671a451e244a68498 |
|
MD5 | 403194ac723685036362e7aeb877f0b6 |
|
BLAKE2b-256 | e2e44fbadbaad6d592a9be70473a49245c531713b7f476c599bebadb0c9b7849 |
Close
Hashes for indexed_zstd-1.1.1-cp37-cp37m-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c77e0a97523b6d8589efe13a24cbb46503aa925e1aac6d7775060e7a59dc038b |
|
MD5 | 166cfa9a9268442da0b85a466362479b |
|
BLAKE2b-256 | 59329652163319dfbec13384597e28461f2a61e90b61e0545b3dfe9ec0b3893e |
Close
Hashes for indexed_zstd-1.1.1-cp37-cp37m-manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 40088988022a2efd6fa36649dd832a251e0390612a6db21e270cda6fde65345e |
|
MD5 | 79ed33685d95376bde9318de68a99bd2 |
|
BLAKE2b-256 | 556bb70607211cc4869eeb4213e84cdeda7da090e376da8f0ab0aac57b6fd72c |
Close
Hashes for indexed_zstd-1.1.1-cp37-cp37m-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6974de6875334329f9771485413788a3ae2e90b5a71484bed374fd48890944bb |
|
MD5 | 1bef910afe0572d43ef53488b8c01951 |
|
BLAKE2b-256 | 6569b5c40f123c898b37a0359f48ac849660b556b7deeca146b34899843e3ffe |
Close
Hashes for indexed_zstd-1.1.1-cp36-cp36m-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b3b924561fbd93b4b2db36571ee237fc133cfde876299ad020bdbf8d9eb020f7 |
|
MD5 | b2b7fae9881632774e2582d09c5e2652 |
|
BLAKE2b-256 | 4a6ae7e8fa288d859d1c9768597a29cfd2c85c26593416411440312573729a8e |
Close
Hashes for indexed_zstd-1.1.1-cp36-cp36m-manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 46abb2a5558d54f941c793ac5edc8d7455fe272f271349e35fc530ff413da5d9 |
|
MD5 | f5b24f1b12a907c7fd12cb31da16157f |
|
BLAKE2b-256 | ce37fe9b91b86a8a1cc2011d14cb32c88094488213cf4d1d16f30e0c717e2c9c |
Close
Hashes for indexed_zstd-1.1.1-cp36-cp36m-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 30e961c3e535d1b08639ce17fd087ba7e69dc154902e9568bc50d1af33635d72 |
|
MD5 | 7b1c214bbe924d9570f641a86e6e115a |
|
BLAKE2b-256 | 1f5bbc58ecc910ee51976f05ed83dd8dfde95d67c5b3f7a83cf9cf047f16d19a |
Close
Hashes for indexed_zstd-1.1.1-cp35-cp35m-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ff4c96e864d107a23726648bbbc21c3826438bcd8c57d79256c01fe07144462f |
|
MD5 | b35a61adf5c2c0f5257bf745a1c3643e |
|
BLAKE2b-256 | 6372666f42e2851274494d5a8c25c7e287b716997a3e42c42330a5a1140bbb21 |
Close
Hashes for indexed_zstd-1.1.1-cp35-cp35m-manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 75d0a10a7fb6049957a3dbec986e502b7c25a672d8b8e9062bc1ba66d0c53118 |
|
MD5 | b69ebb003d3413b6236dfd8c19e288c1 |
|
BLAKE2b-256 | f3ae06a13d756398412e41c5b9d784e5024d6b72d84eb0d201d07c2712edf084 |
Close
Hashes for indexed_zstd-1.1.1-cp35-cp35m-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7693a35852a3691960133e5f34a1a7e49fdc17926552ce59e591024ae79dbd0e |
|
MD5 | 06db5d1a44cad6d5313797f280a28f82 |
|
BLAKE2b-256 | 7c5497e60f037a7d68a8c1bf828880d3a895702b59f5ea70bf1e142a195bf82e |