Skip to main content

No project description provided

Project description

sqlite-zstd

THIS IS A FORK OF THE ORIGINAL sqlite-zsts REPOSITORY FOR THE SAKE OF PUBLISHING TO PYPI

Extension for sqlite that provides transparent dictionary-based row-level compression for sqlite. This basically allows you to compress entries in a sqlite database almost as well as if you were compressing the whole DB file, but while retaining random access.

See also the announcement blog post for some motivation, benchmarks and ramblings: https://phiresky.github.io/blog/2022/sqlite-zstd

Depending on the data, this can reduce the size of the database by 80% while keeping performance mostly the same (or even improving it, since the data to be read from disk is smaller).

Note that a compression VFS such as https://github.com/mlin/sqlite_zstd_vfs might be suited better depending on the use case. That has very different tradeoffs and capabilities, but the end result is similar.

Install

pip install sqlite-zstd-build

Usage

import sqlite3
import sqlite_zstd

conn = sqlite3.connect(':memory:')
sqlite_zstd.load(conn)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sqlite_zstd_build-0.3.2.41.tar.gz (2.4 kB view details)

Uploaded Source

Built Distributions

sqlite_zstd_build-0.3.2.41-cp312-cp312-musllinux_1_1_x86_64.whl (1.2 MB view details)

Uploaded CPython 3.12 musllinux: musl 1.1+ x86-64

sqlite_zstd_build-0.3.2.41-cp312-cp312-musllinux_1_1_aarch64.whl (1.1 MB view details)

Uploaded CPython 3.12 musllinux: musl 1.1+ ARM64

sqlite_zstd_build-0.3.2.41-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.17+ x86-64

sqlite_zstd_build-0.3.2.41-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (1.0 MB view details)

Uploaded CPython 3.12 manylinux: glibc 2.17+ ARM64

sqlite_zstd_build-0.3.2.41-cp311-cp311-musllinux_1_1_x86_64.whl (1.2 MB view details)

Uploaded CPython 3.11 musllinux: musl 1.1+ x86-64

sqlite_zstd_build-0.3.2.41-cp311-cp311-musllinux_1_1_aarch64.whl (1.1 MB view details)

Uploaded CPython 3.11 musllinux: musl 1.1+ ARM64

sqlite_zstd_build-0.3.2.41-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ x86-64

sqlite_zstd_build-0.3.2.41-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (1.0 MB view details)

Uploaded CPython 3.11 manylinux: glibc 2.17+ ARM64

sqlite_zstd_build-0.3.2.41-cp310-cp310-musllinux_1_1_x86_64.whl (1.2 MB view details)

Uploaded CPython 3.10 musllinux: musl 1.1+ x86-64

sqlite_zstd_build-0.3.2.41-cp310-cp310-musllinux_1_1_aarch64.whl (1.1 MB view details)

Uploaded CPython 3.10 musllinux: musl 1.1+ ARM64

sqlite_zstd_build-0.3.2.41-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ x86-64

sqlite_zstd_build-0.3.2.41-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (1.0 MB view details)

Uploaded CPython 3.10 manylinux: glibc 2.17+ ARM64

sqlite_zstd_build-0.3.2.41-cp39-cp39-musllinux_1_1_x86_64.whl (1.2 MB view details)

Uploaded CPython 3.9 musllinux: musl 1.1+ x86-64

sqlite_zstd_build-0.3.2.41-cp39-cp39-musllinux_1_1_aarch64.whl (1.1 MB view details)

Uploaded CPython 3.9 musllinux: musl 1.1+ ARM64

sqlite_zstd_build-0.3.2.41-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ x86-64

sqlite_zstd_build-0.3.2.41-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (1.0 MB view details)

Uploaded CPython 3.9 manylinux: glibc 2.17+ ARM64

File details

Details for the file sqlite_zstd_build-0.3.2.41.tar.gz.

File metadata

  • Download URL: sqlite_zstd_build-0.3.2.41.tar.gz
  • Upload date:
  • Size: 2.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.11.9

File hashes

Hashes for sqlite_zstd_build-0.3.2.41.tar.gz
Algorithm Hash digest
SHA256 9da3ff9987dbf47f13aa07280debe57f32322d98c982e9055d4216df1d9bed9f
MD5 80f45db19e84eb729b2d734089860113
BLAKE2b-256 76393a4ec79c7979e938c1ac0ec75202f215b214702f7ab50774eff57f81ac56

See more details on using hashes here.

File details

Details for the file sqlite_zstd_build-0.3.2.41-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for sqlite_zstd_build-0.3.2.41-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 d95351b1d3bbb335618a60b7f3395a71d7a0acce7ad8cf4ef2e1070db88e7bf1
MD5 9fbee1a41b8be7dc533cde9bd036891c
BLAKE2b-256 610dd58e23b35a1b0f29a3bcd9050d7ebd86edc19815eb65f0dcd1e51f79c334

See more details on using hashes here.

File details

Details for the file sqlite_zstd_build-0.3.2.41-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for sqlite_zstd_build-0.3.2.41-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 095e8e915684b6bf033922bfefbbe6b55281933eef2c523651536607630e4514
MD5 907570d29a6611ffc5750ee1e8e95022
BLAKE2b-256 280b35457caea6a99e3e67d8bccbd8818dfee4908531bdab41df24234f33e4f8

See more details on using hashes here.

File details

Details for the file sqlite_zstd_build-0.3.2.41-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for sqlite_zstd_build-0.3.2.41-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 b4dc9e7368f8e81e8b6f556eb49a7d2d8a8c641afdb01f08be3699a4f0e82391
MD5 97da90e91c6933a81ab7af0de730332f
BLAKE2b-256 7fc4a1e72136aa877e4acda16a95286e6a651d63b592ee2a5b1c04b1ea55161e

See more details on using hashes here.

File details

Details for the file sqlite_zstd_build-0.3.2.41-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for sqlite_zstd_build-0.3.2.41-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 052bd77f0d32217bf7e70a0da98abd73b92c8bb6d8d133cc1cbbe956d92a944f
MD5 9e25cda659540c5b75eec48f09097b7f
BLAKE2b-256 ed9b480613f1f6dafbaea6704781d4e7b746c64322ba8cd440066ee9bd8d1a65

See more details on using hashes here.

File details

Details for the file sqlite_zstd_build-0.3.2.41-cp312-cp312-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for sqlite_zstd_build-0.3.2.41-cp312-cp312-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 4085bb508d4161b6848d15792f7af1330f9615cd57d91acc7767a6d6502f200d
MD5 d4d8b02b6b0f5dfc732a56460b74b1c3
BLAKE2b-256 c12e9f5eac72ace171ec8701d8b719f7e56b3a782657ca0d2f23fc02a6d46bc9

See more details on using hashes here.

File details

Details for the file sqlite_zstd_build-0.3.2.41-cp312-cp312-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for sqlite_zstd_build-0.3.2.41-cp312-cp312-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 5fdb0564b8e2b4090e96e4ee12e40485206bedec46c05d16f7db564f8d0186c4
MD5 b77a51d400f00905183b4e017aea42a0
BLAKE2b-256 371eb23768933d104c805363db9c6183ed67c861a40cd1cdd16fe68e08597a1a

See more details on using hashes here.

File details

Details for the file sqlite_zstd_build-0.3.2.41-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for sqlite_zstd_build-0.3.2.41-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 a4bc702e480039d9d782120da800c137e0a7fe9acb6ea9a62b8fb4dee457f585
MD5 d9c17516d9c5b01dd2595f01ed1130be
BLAKE2b-256 d82bb965edac3c44359bcc0b61c9da44cf68814494a0419b1ba365ba6564e6bd

See more details on using hashes here.

File details

Details for the file sqlite_zstd_build-0.3.2.41-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for sqlite_zstd_build-0.3.2.41-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 d23f78473b25c9aca78f4c621a599ae5d0176db8f9bf7ec4b89ebcc96e9c2452
MD5 8097c743351d2a2af92419ac9fa59b8f
BLAKE2b-256 caba1299af5015bc9e5bcec0173289fd382cdf634e45b7f186468ec965f2ff7e

See more details on using hashes here.

File details

Details for the file sqlite_zstd_build-0.3.2.41-cp311-cp311-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for sqlite_zstd_build-0.3.2.41-cp311-cp311-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 8cc24cdbd6095f2ab9fdba53610a2fa9f7afac143e0b3c5a5d54cb02c966d301
MD5 2f36cfd2b4e76807f52a506107fc5241
BLAKE2b-256 26a48d8005e316208fd03c9b297082bbaf108042c844ad6b76c2358ff01e0e38

See more details on using hashes here.

File details

Details for the file sqlite_zstd_build-0.3.2.41-cp311-cp311-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for sqlite_zstd_build-0.3.2.41-cp311-cp311-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 bb299727369ff095f8dbb6c448087a1c0922311ba49722d1526f5badb13b3773
MD5 ea701d472c58e735d9012df48383ce5f
BLAKE2b-256 764d362b6e6d63d3c194ef5b0da95a7640e4bcc0f63b98b5ba5d75b210b9f98c

See more details on using hashes here.

File details

Details for the file sqlite_zstd_build-0.3.2.41-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for sqlite_zstd_build-0.3.2.41-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 fb255bf1fdf3d438c6a47d284d8d589365007a9785f635310f41a5ef7b890c3d
MD5 a585ed32b94bdda93f5339462921eda1
BLAKE2b-256 3a45eef5bfe91688e62b24d0b51148f505b8b6c6c6dfa88173620f906ba2c850

See more details on using hashes here.

File details

Details for the file sqlite_zstd_build-0.3.2.41-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for sqlite_zstd_build-0.3.2.41-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 a391f1e607805a1062b58d8719afffed09341ea5593f43a1ac86634d549a0013
MD5 5e9c3367da800fc3f87f298f84a7881a
BLAKE2b-256 2056e92108ac3cadf90a464f75a2618273e397ebb91b7931579db8b9a23d7d91

See more details on using hashes here.

File details

Details for the file sqlite_zstd_build-0.3.2.41-cp310-cp310-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for sqlite_zstd_build-0.3.2.41-cp310-cp310-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 cb8af9a848996f5776264cf1d5f1b7ce51a0da8a336339e2ea60d6d856da4b6f
MD5 6e6332c1330157de4039fd7310b7e832
BLAKE2b-256 fcb06ccd258a85d659c129a8b216795a513958c5a05bb46455b97c1b6ae86eb8

See more details on using hashes here.

File details

Details for the file sqlite_zstd_build-0.3.2.41-cp310-cp310-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for sqlite_zstd_build-0.3.2.41-cp310-cp310-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 a5ff978ba912eb9b262cb857cd29b07e804018d6ede58882e9c7291dbb75fab5
MD5 6f302c7a50cdb3d9fea07b8835b49650
BLAKE2b-256 88b85a1604db1ce4483c530a270e24d947ce4e3d5d81410ad59d1c0d34cc9327

See more details on using hashes here.

File details

Details for the file sqlite_zstd_build-0.3.2.41-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for sqlite_zstd_build-0.3.2.41-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 ad80a2bd25587b25583cf657381659856638954b38fe2ffc850f7e6e2d9c9303
MD5 f49189431e4174e74b4f569f3e2f2e9a
BLAKE2b-256 4bf73c834aa7515d29ccb69bddfc10ba7adc3c885ae8e662fc29316506eaf233

See more details on using hashes here.

File details

Details for the file sqlite_zstd_build-0.3.2.41-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for sqlite_zstd_build-0.3.2.41-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 682fa417d93651ab47a300f35c8013ec60f40b293352b5159ea3431a295d3abd
MD5 ca4989ad3b9bfa3ab72f6ccc6a808db7
BLAKE2b-256 0a1dad0089c39f8454cdf2ad17e1a532725d2265d147e60a306dfb530dd20c9c

See more details on using hashes here.

File details

Details for the file sqlite_zstd_build-0.3.2.41-cp39-cp39-musllinux_1_1_x86_64.whl.

File metadata

File hashes

Hashes for sqlite_zstd_build-0.3.2.41-cp39-cp39-musllinux_1_1_x86_64.whl
Algorithm Hash digest
SHA256 1530f781d3cb7bb606fdf86d1cd2cd9b3caec81f241caeb4488ec9db39d28d93
MD5 4f585e123741d0078844f1a1594ababc
BLAKE2b-256 fa83bf58fe36efdb1102ba5874447125c51c735c75240af98a2183b1b0e3477f

See more details on using hashes here.

File details

Details for the file sqlite_zstd_build-0.3.2.41-cp39-cp39-musllinux_1_1_aarch64.whl.

File metadata

File hashes

Hashes for sqlite_zstd_build-0.3.2.41-cp39-cp39-musllinux_1_1_aarch64.whl
Algorithm Hash digest
SHA256 b3d23d359dfdbfb90b2d116082323bb85f312b697531f41cd0fd1e1a6bcf0b73
MD5 41d2bc8ded3e6b98ebcc1b97118ea8c8
BLAKE2b-256 be0197157da806b399606c25e6ee2a4da551f5c26663afa95dc536f254c61189

See more details on using hashes here.

File details

Details for the file sqlite_zstd_build-0.3.2.41-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for sqlite_zstd_build-0.3.2.41-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 aff7eec5bfea171bcff30608d6e54e552609d2dfb0baf3c4366b24f923f42512
MD5 0872488b66bfbb2bf1f4ba7796882564
BLAKE2b-256 fd02a1ab1691739865fec515dafd23721eb9cdcb24bf2e5e3958ef9064d23017

See more details on using hashes here.

File details

Details for the file sqlite_zstd_build-0.3.2.41-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for sqlite_zstd_build-0.3.2.41-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 3602857003276bf3b1215e04ebfbeb734b0087160f38b0de0e380f28b6b46812
MD5 881e08db394f2ee38cdbe0253d491149
BLAKE2b-256 0e896ed5349964bb772afb258c24f95c2fa1ca77cdb4f711d5e11971a4b9deb7

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page