Skip to main content

Cython wrapper around Google's Snappy compression library, with pure-Cython implementations of the framing2 (.sz) and Hadoop framing formats and CRC32C.

Project description

You probably want python-snappy

Hadoop framing compatibility

There is one case where you might prefer this library: reading Hadoop snappy streams.

The Hadoop snappy format allows a "block" to contain one or more subblocks. Real Hadoop writers (BlockCompressorStream) emit multi-subblock blocks when an input exceeds the configured buffer size.

  • pysnappy's HadoopDecompressor handles both single-subblock and multi-subblock blocks.
  • python-snappy's HadoopStreamDecompressor only handles single-subblock blocks; on multi-subblock input it silently returns the first subblock and stashes the rest in an internal buffer that is never surfaced. Data loss with no error.

For the encoder, pysnappy emits multi-subblock blocks by default (respecting the buffer_size argument). Pass single_subblock=True to the HadoopCompressor constructor to emit one subblock per call, which is byte-shape-compatible with python-snappy's encoder and slightly faster.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pysnappy-0.8.0.tar.gz (15.0 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

pysnappy-0.8.0-cp313-cp313-musllinux_1_2_x86_64.whl (1.1 MB view details)

Uploaded CPython 3.13musllinux: musl 1.2+ x86-64

pysnappy-0.8.0-cp313-cp313-musllinux_1_2_aarch64.whl (1.1 MB view details)

Uploaded CPython 3.13musllinux: musl 1.2+ ARM64

pysnappy-0.8.0-cp313-cp313-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (132.3 kB view details)

Uploaded CPython 3.13manylinux: glibc 2.24+ x86-64manylinux: glibc 2.28+ x86-64

pysnappy-0.8.0-cp313-cp313-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl (123.1 kB view details)

Uploaded CPython 3.13manylinux: glibc 2.24+ ARM64manylinux: glibc 2.28+ ARM64

pysnappy-0.8.0-cp312-cp312-musllinux_1_2_x86_64.whl (1.1 MB view details)

Uploaded CPython 3.12musllinux: musl 1.2+ x86-64

pysnappy-0.8.0-cp312-cp312-musllinux_1_2_aarch64.whl (1.1 MB view details)

Uploaded CPython 3.12musllinux: musl 1.2+ ARM64

pysnappy-0.8.0-cp312-cp312-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (132.4 kB view details)

Uploaded CPython 3.12manylinux: glibc 2.24+ x86-64manylinux: glibc 2.28+ x86-64

pysnappy-0.8.0-cp312-cp312-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl (123.4 kB view details)

Uploaded CPython 3.12manylinux: glibc 2.24+ ARM64manylinux: glibc 2.28+ ARM64

pysnappy-0.8.0-cp311-cp311-musllinux_1_2_x86_64.whl (1.1 MB view details)

Uploaded CPython 3.11musllinux: musl 1.2+ x86-64

pysnappy-0.8.0-cp311-cp311-musllinux_1_2_aarch64.whl (1.1 MB view details)

Uploaded CPython 3.11musllinux: musl 1.2+ ARM64

pysnappy-0.8.0-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (135.5 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.24+ x86-64manylinux: glibc 2.28+ x86-64

pysnappy-0.8.0-cp311-cp311-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl (127.9 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.24+ ARM64manylinux: glibc 2.28+ ARM64

File details

Details for the file pysnappy-0.8.0.tar.gz.

File metadata

  • Download URL: pysnappy-0.8.0.tar.gz
  • Upload date:
  • Size: 15.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for pysnappy-0.8.0.tar.gz
Algorithm Hash digest
SHA256 457f58362668040c15a74263a482b3f2ff81cf64a5738a05550c99ba192a5337
MD5 93d0f841eef7e1c4e92f537c1bbd811b
BLAKE2b-256 5be2e864c3c2d72d0d1b884deb7b39d17ebefd11543a7c51b32d4a08c4f59acb

See more details on using hashes here.

Provenance

The following attestation bundles were made for pysnappy-0.8.0.tar.gz:

Publisher: release.yml on aeroevan/pysnappy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pysnappy-0.8.0-cp313-cp313-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for pysnappy-0.8.0-cp313-cp313-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 dc2783023d129d7daee7cbf698a370ed51d6cd98ca2ef95f92e4b30a70491147
MD5 61afdb044aa504fb87f11486b2cfcecb
BLAKE2b-256 0915a21d174fc8de3b9e78126aa37cfe74154b8760d141a0bf47a67a84d2b87b

See more details on using hashes here.

Provenance

The following attestation bundles were made for pysnappy-0.8.0-cp313-cp313-musllinux_1_2_x86_64.whl:

Publisher: release.yml on aeroevan/pysnappy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pysnappy-0.8.0-cp313-cp313-musllinux_1_2_aarch64.whl.

File metadata

File hashes

Hashes for pysnappy-0.8.0-cp313-cp313-musllinux_1_2_aarch64.whl
Algorithm Hash digest
SHA256 59e6fcbc9f84ac31b35d021cb9a80e09b7d8f4011ed90b4e63fabf1c229d14fa
MD5 bb084abc51e1462a0ee3f1958d5d7b97
BLAKE2b-256 f8a13cc3a6139c5884d5022f14b7da7fb8463af9f6ec8a84720a57da28150370

See more details on using hashes here.

Provenance

The following attestation bundles were made for pysnappy-0.8.0-cp313-cp313-musllinux_1_2_aarch64.whl:

Publisher: release.yml on aeroevan/pysnappy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pysnappy-0.8.0-cp313-cp313-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for pysnappy-0.8.0-cp313-cp313-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 17debc4cf9a93413afbc1187077276686bd099cc726db782f90c98f3d82d6a93
MD5 f0c218a4a75e72cdfc1d13cd28662ea5
BLAKE2b-256 aaac3b0a17af5e93f07e437a826ed27cb412da5cd058b123fd203b1fc5242cd1

See more details on using hashes here.

Provenance

The following attestation bundles were made for pysnappy-0.8.0-cp313-cp313-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl:

Publisher: release.yml on aeroevan/pysnappy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pysnappy-0.8.0-cp313-cp313-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for pysnappy-0.8.0-cp313-cp313-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 e50c5a020f9039a98ebe6ff3a0fd0221559407549436da5a3a5254dacced4539
MD5 fb199f905108f70334703c5fda4fee21
BLAKE2b-256 6c837379af370cbe9fa7a2ae8c90aa01e6391477bd3c6648a03ab82e99cefc44

See more details on using hashes here.

Provenance

The following attestation bundles were made for pysnappy-0.8.0-cp313-cp313-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release.yml on aeroevan/pysnappy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pysnappy-0.8.0-cp312-cp312-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for pysnappy-0.8.0-cp312-cp312-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 ac6491fd3e7501791ae38cd0770a79b60adb534b82c488bb9e1fff81e5894fde
MD5 c61fed396086f98f3d517eb09c15a3dc
BLAKE2b-256 e1beed6db8831a7b37b9f3a0669f30fec85222fb771602763a679b09c2db8d79

See more details on using hashes here.

Provenance

The following attestation bundles were made for pysnappy-0.8.0-cp312-cp312-musllinux_1_2_x86_64.whl:

Publisher: release.yml on aeroevan/pysnappy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pysnappy-0.8.0-cp312-cp312-musllinux_1_2_aarch64.whl.

File metadata

File hashes

Hashes for pysnappy-0.8.0-cp312-cp312-musllinux_1_2_aarch64.whl
Algorithm Hash digest
SHA256 a8d0c0cc78892166ec6527f62f032f23bdb20c882bcb016b4cc12da871483833
MD5 8238dff0d12a07e6c9bd45661fc5c536
BLAKE2b-256 8fb1a62c33e4798afbd243e9ed69f91fb35defc96653af49acca6fa6e692a685

See more details on using hashes here.

Provenance

The following attestation bundles were made for pysnappy-0.8.0-cp312-cp312-musllinux_1_2_aarch64.whl:

Publisher: release.yml on aeroevan/pysnappy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pysnappy-0.8.0-cp312-cp312-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for pysnappy-0.8.0-cp312-cp312-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 568fc186ba5db1abb7d5371392eef355539e8752ab68efb2461b32b81accc8d5
MD5 41f98c1857a8622adea760ae16f80be3
BLAKE2b-256 258e61ddc838b7ba6041a86f59a913b1a8cea76da648d2afcd3939b740e6f2a4

See more details on using hashes here.

Provenance

The following attestation bundles were made for pysnappy-0.8.0-cp312-cp312-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl:

Publisher: release.yml on aeroevan/pysnappy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pysnappy-0.8.0-cp312-cp312-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for pysnappy-0.8.0-cp312-cp312-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 e6291bec631321e2071b91b81c92202a7d3908788b996e9aa97527bec14bc6bd
MD5 84c015808a088af9e8d4a63c67ac0df8
BLAKE2b-256 b3a0b485c2fc39df8b1376f04e10333cd4047f0c588e9d3aaa550ff3a571ed26

See more details on using hashes here.

Provenance

The following attestation bundles were made for pysnappy-0.8.0-cp312-cp312-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release.yml on aeroevan/pysnappy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pysnappy-0.8.0-cp311-cp311-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for pysnappy-0.8.0-cp311-cp311-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 c443ee13b6e7776abc3d69e52bc7949b3c11bc75eb9c7d91285869d61bb16ee6
MD5 dc7f43c398c9422d2187b945e3ed8f3e
BLAKE2b-256 76423810119763d19df76cb19b7bfb212838457791a7dd3a1eb52692e85e36f7

See more details on using hashes here.

Provenance

The following attestation bundles were made for pysnappy-0.8.0-cp311-cp311-musllinux_1_2_x86_64.whl:

Publisher: release.yml on aeroevan/pysnappy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pysnappy-0.8.0-cp311-cp311-musllinux_1_2_aarch64.whl.

File metadata

File hashes

Hashes for pysnappy-0.8.0-cp311-cp311-musllinux_1_2_aarch64.whl
Algorithm Hash digest
SHA256 46b1922b0e6f8673f3367d1703c4bf850476d0572a1d46a2435ff4514213ea5c
MD5 b734b7c7bf7152b3cc084438410faaf6
BLAKE2b-256 ca71a2fc0b6f88b6934a9c8c6df8f32ecb67bb83dc4556faded1195bce4a8f77

See more details on using hashes here.

Provenance

The following attestation bundles were made for pysnappy-0.8.0-cp311-cp311-musllinux_1_2_aarch64.whl:

Publisher: release.yml on aeroevan/pysnappy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pysnappy-0.8.0-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for pysnappy-0.8.0-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 1ac49347d73944ac3fe0a108666d4350076829a41a83de6397027413fb0d9573
MD5 77b7d5f4a9dc1679e86cd7e4d9d952e5
BLAKE2b-256 3ef7cbaed0f78e9551a96f6582f9826c675350192b077eaa472a19a53e9847e8

See more details on using hashes here.

Provenance

The following attestation bundles were made for pysnappy-0.8.0-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl:

Publisher: release.yml on aeroevan/pysnappy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pysnappy-0.8.0-cp311-cp311-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for pysnappy-0.8.0-cp311-cp311-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 f646328d89c09edd488dc6647dda92b3fa06e0cac4b903590ecb2c6d783318f9
MD5 709b566f84541a47f7feea0069477699
BLAKE2b-256 8c56eac4732cb1b5f1520f03a5fa3c13580f6c07a1c554742fc841da7223a7a0

See more details on using hashes here.

Provenance

The following attestation bundles were made for pysnappy-0.8.0-cp311-cp311-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release.yml on aeroevan/pysnappy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page