Skip to main content

LQFT Engine: Native Disk Persistence & Cold Start Deserialization (v5.0 Stable)

Project description

Log-Quantum Fractal Tree (LQFT) 🚀

Python 3.12 C-Engine Systems Architecture License

📌 Project Overview

The Log-Quantum Fractal Tree (LQFT) is a high-performance, scale-invariant data structure engine designed for massive data deduplication and persistent state management. It synthesizes Hash Array Mapped Trie (HAMT) routing with Merkle-DAG structural folding to provide deterministic $O(1)$ search latency and sub-linear $O(\Sigma)$ space complexity.

By offloading core associative logic to a native C-Extension, the LQFT bypasses the Python Global Interpreter Lock (GIL) and provides significant memory reduction for versioned, redundant, or patterned datasets.


🧠 Core Architecture (v0.5.0 Enterprise Release)

1. Scale-Invariant Time Complexity: $O(1)$

The LQFT utilizes a fixed 64-bit hash space partitioned into 13 levels. Unlike standard balanced trees that grow in height as data increases ($O(\log N)$), the LQFT's pathing is physically capped.

  • Deterministic Latency: Every search or insertion requires exactly 13 pointer hops.
  • Scale-Invariance: Performance remains constant whether the dataset contains 10^3 or 10^9 items.

2. Entropy-Based Space Complexity: $O(\Sigma)$

Utilizing a global C-Registry, the engine implements structural interning. Nodes are identified by the cryptographic hash of their contents and child pointers (Merkle-DAG).

  • Structural Folding: Identical sub-trees are shared physically in memory across different branches or versions.

3. Native Disk Persistence (New in v0.5.0)

The LQFT now functions as a true Database Engine. It can serialize its entire memory layout directly to disk as a dense binary file.

  • Pointer Reconstruction: Rebuilds C-Pointers instantly from disk on boot.
  • Process Isolation: Survives system reboots and RAM clears.

🚀 Performance Benchmarks

Environment: Python 3.12 | GCC -O3 (Native C-Extension)

Metric Result
Search Latency (p50) ~500 ns
Read Throughput ~1.8 Million ops/sec
Space Efficiency Up to 1,500x reduction in versioned graph simulations
Stability Automatic Reference Counting (ARC) with Zero-Footprint GC

🛠️ Getting Started

Installation

The engine requires a C compiler (GCC/MinGW or MSVC) to build the native extension.

# Clone the repository
git clone [https://github.com/ParjadM/Log-Quantum-Fractal-Tree-LQFT-.git](https://github.com/ParjadM/Log-Quantum-Fractal-Tree-LQFT-.git)
cd Log-Quantum-Fractal-Tree-LQFT-

# Build the native C-extension
python setup.py build_ext --inplace

Basic Usage

The LQFT provides a Pythonic interface to its high-performance C-backend.

from lqft_engine import AdaptiveLQFT

# Initialize the Adaptive Wrapper
db = AdaptiveLQFT(migration_threshold=50000)

# Native insertion (Type Safe & Memory Guarded)
db.insert("user_001", "enterprise_payload")

# Sub-microsecond native search
result = db.search("user_001")
print(result) # "enterprise_payload"

# --- Phase 1: Disk Persistence ---
# Save the entire Merkle-DAG to a binary file
db.save_to_disk("production_state.bin")

# Clear RAM completely
db.clear()

# Cold Start Deserialization (Instant Reconstruction)
db.load_from_disk("production_state.bin")

⚖️ License

This project is licensed under the MIT License - see the LICENSE.md file for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lqft_python_engine-0.5.0.tar.gz (10.9 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

lqft_python_engine-0.5.0-cp312-cp312-win_amd64.whl (18.8 kB view details)

Uploaded CPython 3.12Windows x86-64

lqft_python_engine-0.5.0-cp312-cp312-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (15.0 kB view details)

Uploaded CPython 3.12manylinux: glibc 2.17+ x86-64manylinux: glibc 2.5+ x86-64

lqft_python_engine-0.5.0-cp312-cp312-macosx_11_0_arm64.whl (16.0 kB view details)

Uploaded CPython 3.12macOS 11.0+ ARM64

lqft_python_engine-0.5.0-cp312-cp312-macosx_10_9_x86_64.whl (15.8 kB view details)

Uploaded CPython 3.12macOS 10.9+ x86-64

lqft_python_engine-0.5.0-cp311-cp311-win_amd64.whl (18.8 kB view details)

Uploaded CPython 3.11Windows x86-64

lqft_python_engine-0.5.0-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (15.0 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ x86-64manylinux: glibc 2.5+ x86-64

lqft_python_engine-0.5.0-cp311-cp311-macosx_11_0_arm64.whl (16.0 kB view details)

Uploaded CPython 3.11macOS 11.0+ ARM64

lqft_python_engine-0.5.0-cp311-cp311-macosx_10_9_x86_64.whl (15.8 kB view details)

Uploaded CPython 3.11macOS 10.9+ x86-64

lqft_python_engine-0.5.0-cp310-cp310-win_amd64.whl (18.8 kB view details)

Uploaded CPython 3.10Windows x86-64

lqft_python_engine-0.5.0-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (15.0 kB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ x86-64manylinux: glibc 2.5+ x86-64

lqft_python_engine-0.5.0-cp310-cp310-macosx_11_0_arm64.whl (16.0 kB view details)

Uploaded CPython 3.10macOS 11.0+ ARM64

lqft_python_engine-0.5.0-cp310-cp310-macosx_10_9_x86_64.whl (15.8 kB view details)

Uploaded CPython 3.10macOS 10.9+ x86-64

lqft_python_engine-0.5.0-cp39-cp39-win_amd64.whl (18.8 kB view details)

Uploaded CPython 3.9Windows x86-64

lqft_python_engine-0.5.0-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (15.0 kB view details)

Uploaded CPython 3.9manylinux: glibc 2.17+ x86-64manylinux: glibc 2.5+ x86-64

lqft_python_engine-0.5.0-cp39-cp39-macosx_11_0_arm64.whl (16.0 kB view details)

Uploaded CPython 3.9macOS 11.0+ ARM64

lqft_python_engine-0.5.0-cp39-cp39-macosx_10_9_x86_64.whl (15.8 kB view details)

Uploaded CPython 3.9macOS 10.9+ x86-64

lqft_python_engine-0.5.0-cp38-cp38-win_amd64.whl (18.7 kB view details)

Uploaded CPython 3.8Windows x86-64

lqft_python_engine-0.5.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (29.9 kB view details)

Uploaded CPython 3.8manylinux: glibc 2.17+ x86-64manylinux: glibc 2.5+ x86-64

lqft_python_engine-0.5.0-cp38-cp38-macosx_11_0_arm64.whl (16.3 kB view details)

Uploaded CPython 3.8macOS 11.0+ ARM64

lqft_python_engine-0.5.0-cp38-cp38-macosx_10_9_x86_64.whl (16.0 kB view details)

Uploaded CPython 3.8macOS 10.9+ x86-64

File details

Details for the file lqft_python_engine-0.5.0.tar.gz.

File metadata

  • Download URL: lqft_python_engine-0.5.0.tar.gz
  • Upload date:
  • Size: 10.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for lqft_python_engine-0.5.0.tar.gz
Algorithm Hash digest
SHA256 e3cbea6870e246109c76a3c5f3ef85de7d96b151420709e5e56d34764925a8b8
MD5 d69a679e249f6ef1cfc8e54069eebc40
BLAKE2b-256 426463f5adca18d8695e0283d059c520011de3c7b01812d0736afd76b1f4273f

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.5.0-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.5.0-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 2330e5808dc2366369b318df09bdff63a95d989834ed246b674a9291eb1d5ec4
MD5 329b8b28498f3e5a15a08c37d9935d52
BLAKE2b-256 73602cfd931666dc3b69a17bcbccf5dc3dbf3a02a0e69bca0380574f86379c3e

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.5.0-cp312-cp312-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.5.0-cp312-cp312-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 118702deb1f197752031c05005d6c4cf285e7b737ad0c8dc45b30d1d56599919
MD5 0ef324687278f9d762766782fa783579
BLAKE2b-256 ee67eaa3b5b3fbdca9a3979b1adfcae59e2e47ac753f3c161cb42901392701fa

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.5.0-cp312-cp312-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.5.0-cp312-cp312-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 83bf53b64e7b55fbfaf2faa852b6a50248744ff230a1f65125370797c178c79d
MD5 42d6c8a062a50a56115aa47d9098a9fa
BLAKE2b-256 db472f083facc7374b261a4640d1e468867013c481b1a235c24fb9225817a44c

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.5.0-cp312-cp312-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.5.0-cp312-cp312-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 2ec4d39d12069b9465891e1c852ad04b5e3a26017eb3b9e46b38d50f6916b9e1
MD5 968d04af17aad1afc604b9d80db75620
BLAKE2b-256 9df6231e1149708852145da7f6433fc1eef343bfb3875762209d3523db378115

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.5.0-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.5.0-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 204e3fb473193cab999751f397c3c711c2ed5d14b75480c9e65bb68ed79452f9
MD5 96118322525fb984812b7fd281e93c41
BLAKE2b-256 4ab59b5f2ef458376aac6931056fecb7a096ce527563eacd371db79943bb382d

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.5.0-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.5.0-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 99b0b35516e6c745cecf43d4a51f751ed2d2d69081aa4526221e1e4ffaf19862
MD5 f7cea5bb855460c66db039a7cd246367
BLAKE2b-256 fba50596263b78fdef0db89c8c932b4200030934d9259b8fb42cdb9ff5dac460

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.5.0-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.5.0-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 b9aeb80fc1537229b2f1f24ab1ce77e1be6519bdd4433c8dc5d925550c89f450
MD5 44d8132bfb7338f841882bd8890b12c0
BLAKE2b-256 5a85a987a01e21259c1c86b6a23625a53562f87310e7aa3991824ef6ea02af49

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.5.0-cp311-cp311-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.5.0-cp311-cp311-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 52dc3e010f7b404597e9fc391deec930d7591cae6fc37a869832475d7a02f5cf
MD5 741e56c48c4534be02dbb892325de7eb
BLAKE2b-256 3541d378627a33ce131921bf0a9928c07430d92781fb81bcea6972cb2b36a0fa

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.5.0-cp310-cp310-win_amd64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.5.0-cp310-cp310-win_amd64.whl
Algorithm Hash digest
SHA256 f47b2a519441f4ca10b1847396c43d022f1c92e12c77cf7b4a5342c2ead224c5
MD5 fdfbadcc41e01032b392bed33fee2b19
BLAKE2b-256 e3309729f330db0f4685184f9d9a016558d3ff2e5ba8ff3665096b4cd73aa5db

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.5.0-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.5.0-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 6426c22ada215c2b2809957f3777c691b31bd758932963946a31573f7bffbf72
MD5 e39215586257e68b30b8a12bbe3358c6
BLAKE2b-256 9509a2bf1e5ed100cabeb2c938e53a47b4277994f0e6b3b443360bbcb3f11713

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.5.0-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.5.0-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 01111005ee2ff9723373066b5851666097112d0bbd9da1848b7690c234a5db31
MD5 67e3e816f319134386a6274337efb1d0
BLAKE2b-256 e0b2c75784798e03da60db380da20747127a8c6b7abc8e5d47c3e8c43c7d4c8c

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.5.0-cp310-cp310-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.5.0-cp310-cp310-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 46cb133112ac5085c3679cb18991532c4ae4cf4dbd4cad2e008c8e043054ff04
MD5 8121eaaf2191f6105608db00d8dcc127
BLAKE2b-256 67cd628b16278edbe0670ae7ffbee58ae1beb74e0c1b17296052c7f37a464f24

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.5.0-cp39-cp39-win_amd64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.5.0-cp39-cp39-win_amd64.whl
Algorithm Hash digest
SHA256 f9335ed296850fa9778ca18807afe3a541b9f02ae187776b82784c2c186ac5f4
MD5 81319cfe570abdd9316208e80cede81d
BLAKE2b-256 537a1696a0dd16a4e39b50493d09ae77ce5e4dda02c5708908beafd5e05b2050

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.5.0-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.5.0-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 d1c479db4a9f7bdaaf33208361d77afe5262e46549ab0874e8c31538e195b069
MD5 403a3365f205fe7da89340cfd9fbed12
BLAKE2b-256 66c7fd77e382dd39f7fd42a4870a58a0f5093388bf1f9307a9c8d6e89127fa77

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.5.0-cp39-cp39-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.5.0-cp39-cp39-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 651b90d6a8ab3e63a329ef4120a908ef4c600d68f27b1f0270a1f019d9486adc
MD5 d8cd76f947453fa14ac7c626607db8f8
BLAKE2b-256 a72e3f50ba9df2d042deca6076ea5888109cc9a693d62b3a1bb7d18754b76527

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.5.0-cp39-cp39-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.5.0-cp39-cp39-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 1424a2932b18fdd35ab3979199655710dee66efefaed354d29ad70d30ca98243
MD5 14a2e6e143400b882c4ad93b3d1bddab
BLAKE2b-256 575bcc446861ce4fa43be9832a9bb5c8c5602f6d759a6606b46ff0383294f406

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.5.0-cp38-cp38-win_amd64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.5.0-cp38-cp38-win_amd64.whl
Algorithm Hash digest
SHA256 ec4bb0d83ea73b8936d86912f3f62a6f7d08b287c299090a02fd33393c4a048d
MD5 48388403ba8d1b365281df8f0088cc5c
BLAKE2b-256 c3e59ee0dbad417d70b0a80b95d69667f8ba85f09bb88ae71264c580f3579970

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.5.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.5.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 571d9774e401c6c7a7be602c135196a55b3b3390ea9fd7b1cf901ba7af7c6a92
MD5 ea0ba8bf807cfbe97e6c6cb47c6eceb0
BLAKE2b-256 6062d4cce4be68d6e42a70816c4baa2c629b00c9ad75680adb5fbb8d4797675e

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.5.0-cp38-cp38-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.5.0-cp38-cp38-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 90e86d4c052cc951d1303aad11de487fde2e9f74e5e5a7f505d9e98d0d2f9fa9
MD5 57b17341067b188fb7a0e4f2ac8b64c2
BLAKE2b-256 37eadad8e2deb6144eec0f707bc62c3c64a554355af0adb4d19b98832f7364f4

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.5.0-cp38-cp38-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.5.0-cp38-cp38-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 0a5c96d09f530ad4d489d75578f488174ffb0f3034660c177ad304f3c2aba561
MD5 d716a6fdb0f9777e5b35d49165d86a3a
BLAKE2b-256 26cd1627b18c363c5734138db2d101eb718549080619a0c49a389ce69eeedf0c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page