Skip to main content

Simple Python Storage Engine

Light weight key value storage engine optimized for write heavy workloads.

Overview

This project is an LSM-tree based key-value storage engine implemented in Python, optimized for write-heavy workloads.

It is a persistent key-value store featuring:

  • A Write Ahead Log (WAL) for atomicity and durability.
  • An in-memory Memtable using SortedDict.
  • Persistent Sorted String Tables (SSTables).
  • Asynchronous, leveled compaction handled by a background worker thread (introduced in v1.0.0).
  • Metadata generation for created collections
  • Bloom filter functionality to prevent unnecessary disk operations for keys that we know dont exist in the collection
  • Storage engine is behind a FastAPI server and can be communicated with using REST APIs.
  • Supports range queries from start_key to end_key

Getting Started

  • Detailed documentation and explanation of each component is available in the docs folder.

Contributing

Contributions, issues and feature requests are welcome! Contributing ideas

  • Implement a proper testing suite for different components. Unit tests, Integration Tests
  • Thread safety for multi threaded programs
  • UI features along with CLI and library utilisation. and many more, ideas are always welcome!

LICENSE

This project is licensed under the MIT License. See the LICENSE file for details.

Metadata

Release files for lsm-storage-engine-key-value-store 1.2.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for lsm-storage-engine-key-value-store 1.2.3
File Size Uploaded Provenance
lsm_storage_engine_key_value_store-1.2.3.tar.gz 24.0 kB Without provenance Details

Built distribution (wheel)

Table of built distributions (wheels) for lsm-storage-engine-key-value-store 1.2.3
File Interpreter ABI Platform
lsm_storage_engine_key_value_store-1.2.3-py3-none-any.whl Python 3 none any Details

Total release size: 51.1 kB

Release files / lsm_storage_engine_key_value_store-1.2.3.tar.gz

Download URL lsm_storage_engine_key_value_store-1.2.3.tar.gz
Size 24.0 kB
Tags Source
SHA-256 checksum
How to use checksums
c9b0b6742e97ddc1b2c4cb1879ac445fc7bf10480445b8eec39cb6f52c81ff96
BLAKE2b-256 checksum
How to use checksums
4581cb5bdbed67e884b08fc10fb34b1138268cc8b636d00eb5483522bce2b41b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.0.1 CPython/3.12.6

Release files / lsm_storage_engine_key_value_store-1.2.3-py3-none-any.whl

Download URL lsm_storage_engine_key_value_store-1.2.3-py3-none-any.whl
Size 27.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
16f4d403adfc2a10fd122191074b75d8bbe2b40729d40d0bbbdd20ebb5adda3e
BLAKE2b-256 checksum
How to use checksums
c12c638e463d26a818990856f9b7fbb2d719953ab79edc0ca06bff0f513ac8a7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.0.1 CPython/3.12.6

Security for lsm-storage-engine-key-value-store 1.2.3

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page