Fast random access to zstd files
Reason this release was yanked:
superseded by 1.2.2
Project description
indexed_zstd
This module provides an IndexedZstdFile class, which can be used to seek inside zstd files without having to decompress them first.
It's shamelessy based on indexed_bzip2, which was refactored to support zstd instead of bzip2 using libzstd-seek.
Kudos to the author for its work.
Seeking inside a block is only emulated, so IndexedZstdFile will only speed up seeking when there are more than one block, which sadly requires a bit of care in zstd.
Usage
Example 1
from indexed_zstd import IndexedZstdFile
file = IndexedZstdFile( "example.zst" )
# You can now use it like a normal file
file.seek( 123 )
data = file.read( 100 )
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
indexed_zstd-1.2.1.tar.gz
(60.4 kB
view hashes)
Built Distributions
Close
Hashes for indexed_zstd-1.2.1-cp39-cp39-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4e9adab6918d6747a8b3d8949f9c7feed93d3ae7429a5341cafd67b469fdd7a2 |
|
MD5 | 5cb272a5bfa308729255a31f576ce33e |
|
BLAKE2b-256 | f93b6cb6ef6e56cfce4034c7689ef84fadc2c2bc38009250bf1045812aa1a380 |
Close
Hashes for indexed_zstd-1.2.1-cp39-cp39-manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 90114184f3b9c80b767947d68dee14cb3cafbcbfe471d41671367a7f1ec28fff |
|
MD5 | a7e912da15e12fa90db4b3dde2931874 |
|
BLAKE2b-256 | ef8a574d63b2719975a18df9a23617e6540055066acfc8aa24dc4a2557d8f146 |
Close
Hashes for indexed_zstd-1.2.1-cp39-cp39-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9a05b4f27edd75c05fe76bf388b173f3b9859fe4878150acecd30d104361d708 |
|
MD5 | 8827a900ec0d7deaeaa71ba9dc9fc498 |
|
BLAKE2b-256 | f9200b2120fcd7ff07809559cd404385ae9100c5517796b4ca0599f80c047d4f |
Close
Hashes for indexed_zstd-1.2.1-cp38-cp38-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 03c5111fb2c0506c448e0033ad6b8e4090121d4fea09188f878b9260f0390732 |
|
MD5 | 3b69140307567201477006d823a5f0d3 |
|
BLAKE2b-256 | 6085374de5eedaf17babce6e725ed0627f0dabfd5349ba8857e996c7cdcd9762 |
Close
Hashes for indexed_zstd-1.2.1-cp38-cp38-manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a2c19c4a54eff1300128a3e4b09d66076611fa0ee6192d7b9d2ea126f83138a4 |
|
MD5 | c5714cdc2e16208b99833f0bbe26b800 |
|
BLAKE2b-256 | 8239f223d2c5d61d1827060757f0253809cd297bead4259bd433888bf6ca6ead |
Close
Hashes for indexed_zstd-1.2.1-cp38-cp38-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bf1a205cbbe352a9189dbc8f62eb2539fe159ccc72ae13b8ebef020245d36260 |
|
MD5 | 6fd99c0a83e9735b6311164dc3d9ef28 |
|
BLAKE2b-256 | 13769068dde3d5cd44fc6012092f9c9092cdfb52f557b82b46df1f1954b1ba62 |
Close
Hashes for indexed_zstd-1.2.1-cp37-cp37m-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ebf531abc5744ccfc7ffc8022643a791e0689877326e1e08fafc40f64a7362cd |
|
MD5 | 651f04fd5a2b7ccb66b8d86cc3e5ed41 |
|
BLAKE2b-256 | 3c2739a5437deef0a81d98e37d65974b3c223b8af0813cc6c7485019cb8c5b0d |
Close
Hashes for indexed_zstd-1.2.1-cp37-cp37m-manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 52bd837e050db872206f1e9e277b899ebfbd76945bf3723a68819b47eb4dbfbc |
|
MD5 | e482a954647d36269360cb61df6fdd98 |
|
BLAKE2b-256 | ea4e5011533a01bfaf9e9a4c5ff2707a9c5147612c960327b10f86bb7a25b898 |
Close
Hashes for indexed_zstd-1.2.1-cp37-cp37m-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 03f1c6a5f44809a58a82670297bc71c8149629560d0ff9b4876ad05a78cd63b1 |
|
MD5 | e58914635fb2c87e188cca0ba956f38d |
|
BLAKE2b-256 | 208c7534b28dcc0321e19ea6870ec3a489e5aa7ddf0cc7f9f35dbbe2180b6c32 |
Close
Hashes for indexed_zstd-1.2.1-cp36-cp36m-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9aa2ff8ac59f4f026708f707e3509db00b4a12f1b919b19dd7d542192ef5c8f9 |
|
MD5 | b7bb1a030db92227cfa3dd714a6b8951 |
|
BLAKE2b-256 | 4e8569989aa315c5257971a778d6191c5968a946f9ad86fdeeb8b5640f96df80 |
Close
Hashes for indexed_zstd-1.2.1-cp36-cp36m-manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fb1c2926137bc94dad8686f5f5f9e0c1dec1fd268b0db28797a1fc65b7551c30 |
|
MD5 | ecc21320a7560fc17c7999030e8c85fe |
|
BLAKE2b-256 | fadc40940bd4f320c3f86012961b199595035b4ca6a2ae70db165e06110d0803 |
Close
Hashes for indexed_zstd-1.2.1-cp36-cp36m-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3be198b8f101f694c95adcfe7fe8f78d7224e4994137e44a152116fe05a8378c |
|
MD5 | 5a64b933bf8b6e136873586956a32259 |
|
BLAKE2b-256 | d8ebede8f90ebbc75a1335df5e80b5c9e130405d8c1c3c71ae1d36f94fe308de |
Close
Hashes for indexed_zstd-1.2.1-cp35-cp35m-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f2902cf8e4806b1fd9775fc9f8bd17abd6d70b59d8859a3cad38e4db42cf9ea7 |
|
MD5 | aa85489389aa40ed61eb9377dd3a0127 |
|
BLAKE2b-256 | ab36bbbea5c0050121c7de25d0b359c5b0cc51728a8208762b2e796e871562e1 |
Close
Hashes for indexed_zstd-1.2.1-cp35-cp35m-manylinux2010_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e7983b7d3160db08a32477beb598a1a945b79fef0378fbb1837490f75047b086 |
|
MD5 | c68d7b4edd732c79c8c6251fb6c6aa2f |
|
BLAKE2b-256 | a14fe48de34505dc7053ccc1f3c0b7c180bd90b3cc6ccf4167ceb03220f067f3 |
Close
Hashes for indexed_zstd-1.2.1-cp35-cp35m-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 48158054d3d2822a282cc8099771befb2eb94e646a6987d724feaf3eaddfa652 |
|
MD5 | 442a8fedb8f7ece2ed45e09bba47db3b |
|
BLAKE2b-256 | 0e3bd13ee4160a35e3567d6618300acf414b8f05c640b8f78e61f93b1f05279c |