Skip to main content

Cython wrapper around Google's Snappy compression library, with pure-Cython implementations of the framing2 (.sz) and Hadoop framing formats and CRC32C.

Project description

You probably want python-snappy

Hadoop framing compatibility

There is one case where you might prefer this library: reading Hadoop snappy streams.

The Hadoop snappy format allows a "block" to contain one or more subblocks. Real Hadoop writers (BlockCompressorStream) emit multi-subblock blocks when an input exceeds the configured buffer size.

  • pysnappy's HadoopDecompressor handles both single-subblock and multi-subblock blocks.
  • python-snappy's HadoopStreamDecompressor only handles single-subblock blocks; on multi-subblock input it silently returns the first subblock and stashes the rest in an internal buffer that is never surfaced. Data loss with no error.

For the encoder, pysnappy emits multi-subblock blocks by default (respecting the buffer_size argument). Pass single_subblock=True to the HadoopCompressor constructor to emit one subblock per call, which is byte-shape-compatible with python-snappy's encoder and slightly faster.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pysnappy-0.8.2.tar.gz (24.8 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

pysnappy-0.8.2-cp313-cp313-musllinux_1_2_x86_64.whl (1.1 MB view details)

Uploaded CPython 3.13musllinux: musl 1.2+ x86-64

pysnappy-0.8.2-cp313-cp313-musllinux_1_2_aarch64.whl (1.1 MB view details)

Uploaded CPython 3.13musllinux: musl 1.2+ ARM64

pysnappy-0.8.2-cp313-cp313-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (133.7 kB view details)

Uploaded CPython 3.13manylinux: glibc 2.24+ x86-64manylinux: glibc 2.28+ x86-64

pysnappy-0.8.2-cp313-cp313-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl (124.5 kB view details)

Uploaded CPython 3.13manylinux: glibc 2.24+ ARM64manylinux: glibc 2.28+ ARM64

pysnappy-0.8.2-cp312-cp312-musllinux_1_2_x86_64.whl (1.1 MB view details)

Uploaded CPython 3.12musllinux: musl 1.2+ x86-64

pysnappy-0.8.2-cp312-cp312-musllinux_1_2_aarch64.whl (1.1 MB view details)

Uploaded CPython 3.12musllinux: musl 1.2+ ARM64

pysnappy-0.8.2-cp312-cp312-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (133.7 kB view details)

Uploaded CPython 3.12manylinux: glibc 2.24+ x86-64manylinux: glibc 2.28+ x86-64

pysnappy-0.8.2-cp312-cp312-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl (124.7 kB view details)

Uploaded CPython 3.12manylinux: glibc 2.24+ ARM64manylinux: glibc 2.28+ ARM64

pysnappy-0.8.2-cp311-cp311-musllinux_1_2_x86_64.whl (1.1 MB view details)

Uploaded CPython 3.11musllinux: musl 1.2+ x86-64

pysnappy-0.8.2-cp311-cp311-musllinux_1_2_aarch64.whl (1.1 MB view details)

Uploaded CPython 3.11musllinux: musl 1.2+ ARM64

pysnappy-0.8.2-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (136.9 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.24+ x86-64manylinux: glibc 2.28+ x86-64

pysnappy-0.8.2-cp311-cp311-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl (129.1 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.24+ ARM64manylinux: glibc 2.28+ ARM64

File details

Details for the file pysnappy-0.8.2.tar.gz.

File metadata

  • Download URL: pysnappy-0.8.2.tar.gz
  • Upload date:
  • Size: 24.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for pysnappy-0.8.2.tar.gz
Algorithm Hash digest
SHA256 ce58803a1c47b8fa7d258cb08149117aab492cbf12f152923da7bf19d05aab1c
MD5 5cf38e7cf0f44ed57378cc2de0850bac
BLAKE2b-256 f783ca20993d6c07901d4375a8bb6d168fcb7e9f73dc65d51fb9f2a5ee898402

See more details on using hashes here.

Provenance

The following attestation bundles were made for pysnappy-0.8.2.tar.gz:

Publisher: release.yml on aeroevan/pysnappy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pysnappy-0.8.2-cp313-cp313-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for pysnappy-0.8.2-cp313-cp313-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 bdfe13d7dcb6bb960778d326060648006e8bc9c506f000d7de6ac883388fbd6c
MD5 6b3c8bfd08e4274a7e123dddb73e597f
BLAKE2b-256 bed844657e97093863be228424ec91cf1a87211b04d6f1705370587d6c3d0cbd

See more details on using hashes here.

Provenance

The following attestation bundles were made for pysnappy-0.8.2-cp313-cp313-musllinux_1_2_x86_64.whl:

Publisher: release.yml on aeroevan/pysnappy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pysnappy-0.8.2-cp313-cp313-musllinux_1_2_aarch64.whl.

File metadata

File hashes

Hashes for pysnappy-0.8.2-cp313-cp313-musllinux_1_2_aarch64.whl
Algorithm Hash digest
SHA256 98d5afd56bc54cf0cb5a17a7bcb8c81773f5e391a55a44645a97fb5f1e14a43c
MD5 15e8beecf48e4f82e141c79b2f2eb373
BLAKE2b-256 070c797b0f1cb95a3370438277a5e1bdabf1da6a49c8bda34ad0e4d6e593fd89

See more details on using hashes here.

Provenance

The following attestation bundles were made for pysnappy-0.8.2-cp313-cp313-musllinux_1_2_aarch64.whl:

Publisher: release.yml on aeroevan/pysnappy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pysnappy-0.8.2-cp313-cp313-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for pysnappy-0.8.2-cp313-cp313-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 69ef4c2c9a5da1b8bb543a4291d3e8bf9ada51cbb1537be900f58a267cb698dc
MD5 32e38d43055e7176e61490cdadabe71b
BLAKE2b-256 e417b2f9185da83ed6bda61fd60d61d1cb2460588bd06febfbc92babb956c419

See more details on using hashes here.

Provenance

The following attestation bundles were made for pysnappy-0.8.2-cp313-cp313-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl:

Publisher: release.yml on aeroevan/pysnappy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pysnappy-0.8.2-cp313-cp313-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for pysnappy-0.8.2-cp313-cp313-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 7171b1f154ffd7177dc53654c9b86531bd782432961261994dca9a47158b242c
MD5 b122fd02421b240c45dd74f9430ba3e9
BLAKE2b-256 ad1f2f11a0b7151bb9dc9df012d3d0db4d1e544993d58c64ed2b606ab9223622

See more details on using hashes here.

Provenance

The following attestation bundles were made for pysnappy-0.8.2-cp313-cp313-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release.yml on aeroevan/pysnappy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pysnappy-0.8.2-cp312-cp312-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for pysnappy-0.8.2-cp312-cp312-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 991e141f817742669575fe872f57e9903594fcc7d900077871517947e34c3846
MD5 007385bc4b1a4d15bf7eccda38d84bd9
BLAKE2b-256 ede201461230beecd42e31e2232c13d590b328a67497ac47f6621cba0945e3c8

See more details on using hashes here.

Provenance

The following attestation bundles were made for pysnappy-0.8.2-cp312-cp312-musllinux_1_2_x86_64.whl:

Publisher: release.yml on aeroevan/pysnappy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pysnappy-0.8.2-cp312-cp312-musllinux_1_2_aarch64.whl.

File metadata

File hashes

Hashes for pysnappy-0.8.2-cp312-cp312-musllinux_1_2_aarch64.whl
Algorithm Hash digest
SHA256 9a41593a20192804727976d798ddbdd6de392fd8fa8f656fc263f4ebc738598c
MD5 4dda8d1cf2a089c0fd69d55da3ea1bdf
BLAKE2b-256 73b1d75594f369912e562748e151207b221c5d5ae5944c17fef78ff5ed6f0114

See more details on using hashes here.

Provenance

The following attestation bundles were made for pysnappy-0.8.2-cp312-cp312-musllinux_1_2_aarch64.whl:

Publisher: release.yml on aeroevan/pysnappy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pysnappy-0.8.2-cp312-cp312-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for pysnappy-0.8.2-cp312-cp312-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 66e671655c581ac85394ef81a69519e88b112a031d73587dd8c99913b33e3a55
MD5 38461b40387278ae8c400be3fca4f5a5
BLAKE2b-256 20cbbe7f4c7df07cc1e7ee3f210fc97e089c965905962320ec800e71ca38001a

See more details on using hashes here.

Provenance

The following attestation bundles were made for pysnappy-0.8.2-cp312-cp312-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl:

Publisher: release.yml on aeroevan/pysnappy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pysnappy-0.8.2-cp312-cp312-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for pysnappy-0.8.2-cp312-cp312-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 45c4790818616147c6a99b87b06ff48731b931a3cf7ce157d6a3bada12c32b6e
MD5 2a3d51c136a546478d7c22c232a9d226
BLAKE2b-256 7c71b99739bbc2c053a132baec11d4570d4d0ac15cbbd9566eb44cc54ca29d5e

See more details on using hashes here.

Provenance

The following attestation bundles were made for pysnappy-0.8.2-cp312-cp312-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release.yml on aeroevan/pysnappy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pysnappy-0.8.2-cp311-cp311-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for pysnappy-0.8.2-cp311-cp311-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 87ee11280d3225630b90935ff3b854d0c48f718a31cc83e51e825c0e1729de58
MD5 5d6da2e18c36366afe60320982fab6ee
BLAKE2b-256 f25df13de05b4aca15d27e0a4f1efb5fc2ad35014ef9a3c352e4dc2130c3699a

See more details on using hashes here.

Provenance

The following attestation bundles were made for pysnappy-0.8.2-cp311-cp311-musllinux_1_2_x86_64.whl:

Publisher: release.yml on aeroevan/pysnappy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pysnappy-0.8.2-cp311-cp311-musllinux_1_2_aarch64.whl.

File metadata

File hashes

Hashes for pysnappy-0.8.2-cp311-cp311-musllinux_1_2_aarch64.whl
Algorithm Hash digest
SHA256 966b9f0ce1437dd61649a01e68bad9b1be1aff9e7c6853ccde214872ec02732f
MD5 5278285fc7fac98668e856de03508a90
BLAKE2b-256 fe57ee01965d2db51da10d51a7308551665a9b7009e40239c2d67745d4815467

See more details on using hashes here.

Provenance

The following attestation bundles were made for pysnappy-0.8.2-cp311-cp311-musllinux_1_2_aarch64.whl:

Publisher: release.yml on aeroevan/pysnappy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pysnappy-0.8.2-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.

File metadata

File hashes

Hashes for pysnappy-0.8.2-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl
Algorithm Hash digest
SHA256 8c189bff9fcad9ff0d2278927948f3125f061f32bcec73dca240a0193185e855
MD5 0d4a21a333a1c723cf8d15ac321aa663
BLAKE2b-256 40f01b17c4c44e7e3cd0ff87d24e75c3622db97c6294843f463523c8e5ee8a18

See more details on using hashes here.

Provenance

The following attestation bundles were made for pysnappy-0.8.2-cp311-cp311-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl:

Publisher: release.yml on aeroevan/pysnappy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pysnappy-0.8.2-cp311-cp311-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for pysnappy-0.8.2-cp311-cp311-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 b5af97934e468e71e662896b53e942a60fe090038b5242c81979ac650b333e6c
MD5 b3ad4673ff8854d496c748a391030495
BLAKE2b-256 f67662818e2ee99bd6b47f9a3f7786f3d1e1e8ca4a6cf4106c20c23317cd6c88

See more details on using hashes here.

Provenance

The following attestation bundles were made for pysnappy-0.8.2-cp311-cp311-manylinux_2_24_aarch64.manylinux_2_28_aarch64.whl:

Publisher: release.yml on aeroevan/pysnappy

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page