LQFT Engine: Native Disk Persistence & Cold Start Deserialization (v5.0 Stable)
Project description
Log-Quantum Fractal Tree (LQFT) 🚀
📌 Project Overview
The Log-Quantum Fractal Tree (LQFT) is a high-performance, scale-invariant data structure engine designed for massive data deduplication and persistent state management. It synthesizes Hash Array Mapped Trie (HAMT) routing with Merkle-DAG structural folding to provide deterministic $O(1)$ search latency and sub-linear $O(\Sigma)$ space complexity.
By offloading core associative logic to a native C-Extension, the LQFT bypasses the Python Global Interpreter Lock (GIL) and provides significant memory reduction for versioned, redundant, or patterned datasets.
🧠 Core Architecture (v0.5.0 Enterprise Release)
1. Scale-Invariant Time Complexity: $O(1)$
The LQFT utilizes a fixed 64-bit hash space partitioned into 13 levels. Unlike standard balanced trees that grow in height as data increases ($O(\log N)$), the LQFT's pathing is physically capped.
- Deterministic Latency: Every search or insertion requires exactly 13 pointer hops.
- Scale-Invariance: Performance remains constant whether the dataset contains 10^3 or 10^9 items.
2. Entropy-Based Space Complexity: $O(\Sigma)$
Utilizing a global C-Registry, the engine implements structural interning. Nodes are identified by the cryptographic hash of their contents and child pointers (Merkle-DAG).
- Structural Folding: Identical sub-trees are shared physically in memory across different branches or versions.
3. Native Disk Persistence (New in v0.5.0)
The LQFT now functions as a true Database Engine. It can serialize its entire memory layout directly to disk as a dense binary file.
- Pointer Reconstruction: Rebuilds C-Pointers instantly from disk on boot.
- Process Isolation: Survives system reboots and RAM clears.
🚀 Performance Benchmarks
Environment: Python 3.12 | GCC -O3 (Native C-Extension)
| Metric | Result |
|---|---|
| Search Latency (p50) | ~500 ns |
| Read Throughput | ~1.8 Million ops/sec |
| Space Efficiency | Up to 1,500x reduction in versioned graph simulations |
| Stability | Automatic Reference Counting (ARC) with Zero-Footprint GC |
🛠️ Getting Started
Installation
The engine requires a C compiler (GCC/MinGW or MSVC) to build the native extension.
# Clone the repository
git clone [https://github.com/ParjadM/Log-Quantum-Fractal-Tree-LQFT-.git](https://github.com/ParjadM/Log-Quantum-Fractal-Tree-LQFT-.git)
cd Log-Quantum-Fractal-Tree-LQFT-
# Build the native C-extension
python setup.py build_ext --inplace
Basic Usage
The LQFT provides a Pythonic interface to its high-performance C-backend.
from lqft_engine import AdaptiveLQFT
# Initialize the Adaptive Wrapper
db = AdaptiveLQFT(migration_threshold=50000)
# Native insertion (Type Safe & Memory Guarded)
db.insert("user_001", "enterprise_payload")
# Sub-microsecond native search
result = db.search("user_001")
print(result) # "enterprise_payload"
# --- Phase 1: Disk Persistence ---
# Save the entire Merkle-DAG to a binary file
db.save_to_disk("production_state.bin")
# Clear RAM completely
db.clear()
# Cold Start Deserialization (Instant Reconstruction)
db.load_from_disk("production_state.bin")
⚖️ License
This project is licensed under the MIT License - see the LICENSE.md file for details.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distributions
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file lqft_python_engine-0.5.0.tar.gz.
File metadata
- Download URL: lqft_python_engine-0.5.0.tar.gz
- Upload date:
- Size: 10.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e3cbea6870e246109c76a3c5f3ef85de7d96b151420709e5e56d34764925a8b8
|
|
| MD5 |
d69a679e249f6ef1cfc8e54069eebc40
|
|
| BLAKE2b-256 |
426463f5adca18d8695e0283d059c520011de3c7b01812d0736afd76b1f4273f
|
File details
Details for the file lqft_python_engine-0.5.0-cp312-cp312-win_amd64.whl.
File metadata
- Download URL: lqft_python_engine-0.5.0-cp312-cp312-win_amd64.whl
- Upload date:
- Size: 18.8 kB
- Tags: CPython 3.12, Windows x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2330e5808dc2366369b318df09bdff63a95d989834ed246b674a9291eb1d5ec4
|
|
| MD5 |
329b8b28498f3e5a15a08c37d9935d52
|
|
| BLAKE2b-256 |
73602cfd931666dc3b69a17bcbccf5dc3dbf3a02a0e69bca0380574f86379c3e
|
File details
Details for the file lqft_python_engine-0.5.0-cp312-cp312-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.
File metadata
- Download URL: lqft_python_engine-0.5.0-cp312-cp312-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
- Upload date:
- Size: 15.0 kB
- Tags: CPython 3.12, manylinux: glibc 2.17+ x86-64, manylinux: glibc 2.5+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
118702deb1f197752031c05005d6c4cf285e7b737ad0c8dc45b30d1d56599919
|
|
| MD5 |
0ef324687278f9d762766782fa783579
|
|
| BLAKE2b-256 |
ee67eaa3b5b3fbdca9a3979b1adfcae59e2e47ac753f3c161cb42901392701fa
|
File details
Details for the file lqft_python_engine-0.5.0-cp312-cp312-macosx_11_0_arm64.whl.
File metadata
- Download URL: lqft_python_engine-0.5.0-cp312-cp312-macosx_11_0_arm64.whl
- Upload date:
- Size: 16.0 kB
- Tags: CPython 3.12, macOS 11.0+ ARM64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
83bf53b64e7b55fbfaf2faa852b6a50248744ff230a1f65125370797c178c79d
|
|
| MD5 |
42d6c8a062a50a56115aa47d9098a9fa
|
|
| BLAKE2b-256 |
db472f083facc7374b261a4640d1e468867013c481b1a235c24fb9225817a44c
|
File details
Details for the file lqft_python_engine-0.5.0-cp312-cp312-macosx_10_9_x86_64.whl.
File metadata
- Download URL: lqft_python_engine-0.5.0-cp312-cp312-macosx_10_9_x86_64.whl
- Upload date:
- Size: 15.8 kB
- Tags: CPython 3.12, macOS 10.9+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2ec4d39d12069b9465891e1c852ad04b5e3a26017eb3b9e46b38d50f6916b9e1
|
|
| MD5 |
968d04af17aad1afc604b9d80db75620
|
|
| BLAKE2b-256 |
9df6231e1149708852145da7f6433fc1eef343bfb3875762209d3523db378115
|
File details
Details for the file lqft_python_engine-0.5.0-cp311-cp311-win_amd64.whl.
File metadata
- Download URL: lqft_python_engine-0.5.0-cp311-cp311-win_amd64.whl
- Upload date:
- Size: 18.8 kB
- Tags: CPython 3.11, Windows x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
204e3fb473193cab999751f397c3c711c2ed5d14b75480c9e65bb68ed79452f9
|
|
| MD5 |
96118322525fb984812b7fd281e93c41
|
|
| BLAKE2b-256 |
4ab59b5f2ef458376aac6931056fecb7a096ce527563eacd371db79943bb382d
|
File details
Details for the file lqft_python_engine-0.5.0-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.
File metadata
- Download URL: lqft_python_engine-0.5.0-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
- Upload date:
- Size: 15.0 kB
- Tags: CPython 3.11, manylinux: glibc 2.17+ x86-64, manylinux: glibc 2.5+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
99b0b35516e6c745cecf43d4a51f751ed2d2d69081aa4526221e1e4ffaf19862
|
|
| MD5 |
f7cea5bb855460c66db039a7cd246367
|
|
| BLAKE2b-256 |
fba50596263b78fdef0db89c8c932b4200030934d9259b8fb42cdb9ff5dac460
|
File details
Details for the file lqft_python_engine-0.5.0-cp311-cp311-macosx_11_0_arm64.whl.
File metadata
- Download URL: lqft_python_engine-0.5.0-cp311-cp311-macosx_11_0_arm64.whl
- Upload date:
- Size: 16.0 kB
- Tags: CPython 3.11, macOS 11.0+ ARM64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
b9aeb80fc1537229b2f1f24ab1ce77e1be6519bdd4433c8dc5d925550c89f450
|
|
| MD5 |
44d8132bfb7338f841882bd8890b12c0
|
|
| BLAKE2b-256 |
5a85a987a01e21259c1c86b6a23625a53562f87310e7aa3991824ef6ea02af49
|
File details
Details for the file lqft_python_engine-0.5.0-cp311-cp311-macosx_10_9_x86_64.whl.
File metadata
- Download URL: lqft_python_engine-0.5.0-cp311-cp311-macosx_10_9_x86_64.whl
- Upload date:
- Size: 15.8 kB
- Tags: CPython 3.11, macOS 10.9+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
52dc3e010f7b404597e9fc391deec930d7591cae6fc37a869832475d7a02f5cf
|
|
| MD5 |
741e56c48c4534be02dbb892325de7eb
|
|
| BLAKE2b-256 |
3541d378627a33ce131921bf0a9928c07430d92781fb81bcea6972cb2b36a0fa
|
File details
Details for the file lqft_python_engine-0.5.0-cp310-cp310-win_amd64.whl.
File metadata
- Download URL: lqft_python_engine-0.5.0-cp310-cp310-win_amd64.whl
- Upload date:
- Size: 18.8 kB
- Tags: CPython 3.10, Windows x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
f47b2a519441f4ca10b1847396c43d022f1c92e12c77cf7b4a5342c2ead224c5
|
|
| MD5 |
fdfbadcc41e01032b392bed33fee2b19
|
|
| BLAKE2b-256 |
e3309729f330db0f4685184f9d9a016558d3ff2e5ba8ff3665096b4cd73aa5db
|
File details
Details for the file lqft_python_engine-0.5.0-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.
File metadata
- Download URL: lqft_python_engine-0.5.0-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
- Upload date:
- Size: 15.0 kB
- Tags: CPython 3.10, manylinux: glibc 2.17+ x86-64, manylinux: glibc 2.5+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
6426c22ada215c2b2809957f3777c691b31bd758932963946a31573f7bffbf72
|
|
| MD5 |
e39215586257e68b30b8a12bbe3358c6
|
|
| BLAKE2b-256 |
9509a2bf1e5ed100cabeb2c938e53a47b4277994f0e6b3b443360bbcb3f11713
|
File details
Details for the file lqft_python_engine-0.5.0-cp310-cp310-macosx_11_0_arm64.whl.
File metadata
- Download URL: lqft_python_engine-0.5.0-cp310-cp310-macosx_11_0_arm64.whl
- Upload date:
- Size: 16.0 kB
- Tags: CPython 3.10, macOS 11.0+ ARM64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
01111005ee2ff9723373066b5851666097112d0bbd9da1848b7690c234a5db31
|
|
| MD5 |
67e3e816f319134386a6274337efb1d0
|
|
| BLAKE2b-256 |
e0b2c75784798e03da60db380da20747127a8c6b7abc8e5d47c3e8c43c7d4c8c
|
File details
Details for the file lqft_python_engine-0.5.0-cp310-cp310-macosx_10_9_x86_64.whl.
File metadata
- Download URL: lqft_python_engine-0.5.0-cp310-cp310-macosx_10_9_x86_64.whl
- Upload date:
- Size: 15.8 kB
- Tags: CPython 3.10, macOS 10.9+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
46cb133112ac5085c3679cb18991532c4ae4cf4dbd4cad2e008c8e043054ff04
|
|
| MD5 |
8121eaaf2191f6105608db00d8dcc127
|
|
| BLAKE2b-256 |
67cd628b16278edbe0670ae7ffbee58ae1beb74e0c1b17296052c7f37a464f24
|
File details
Details for the file lqft_python_engine-0.5.0-cp39-cp39-win_amd64.whl.
File metadata
- Download URL: lqft_python_engine-0.5.0-cp39-cp39-win_amd64.whl
- Upload date:
- Size: 18.8 kB
- Tags: CPython 3.9, Windows x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
f9335ed296850fa9778ca18807afe3a541b9f02ae187776b82784c2c186ac5f4
|
|
| MD5 |
81319cfe570abdd9316208e80cede81d
|
|
| BLAKE2b-256 |
537a1696a0dd16a4e39b50493d09ae77ce5e4dda02c5708908beafd5e05b2050
|
File details
Details for the file lqft_python_engine-0.5.0-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.
File metadata
- Download URL: lqft_python_engine-0.5.0-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
- Upload date:
- Size: 15.0 kB
- Tags: CPython 3.9, manylinux: glibc 2.17+ x86-64, manylinux: glibc 2.5+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
d1c479db4a9f7bdaaf33208361d77afe5262e46549ab0874e8c31538e195b069
|
|
| MD5 |
403a3365f205fe7da89340cfd9fbed12
|
|
| BLAKE2b-256 |
66c7fd77e382dd39f7fd42a4870a58a0f5093388bf1f9307a9c8d6e89127fa77
|
File details
Details for the file lqft_python_engine-0.5.0-cp39-cp39-macosx_11_0_arm64.whl.
File metadata
- Download URL: lqft_python_engine-0.5.0-cp39-cp39-macosx_11_0_arm64.whl
- Upload date:
- Size: 16.0 kB
- Tags: CPython 3.9, macOS 11.0+ ARM64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
651b90d6a8ab3e63a329ef4120a908ef4c600d68f27b1f0270a1f019d9486adc
|
|
| MD5 |
d8cd76f947453fa14ac7c626607db8f8
|
|
| BLAKE2b-256 |
a72e3f50ba9df2d042deca6076ea5888109cc9a693d62b3a1bb7d18754b76527
|
File details
Details for the file lqft_python_engine-0.5.0-cp39-cp39-macosx_10_9_x86_64.whl.
File metadata
- Download URL: lqft_python_engine-0.5.0-cp39-cp39-macosx_10_9_x86_64.whl
- Upload date:
- Size: 15.8 kB
- Tags: CPython 3.9, macOS 10.9+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
1424a2932b18fdd35ab3979199655710dee66efefaed354d29ad70d30ca98243
|
|
| MD5 |
14a2e6e143400b882c4ad93b3d1bddab
|
|
| BLAKE2b-256 |
575bcc446861ce4fa43be9832a9bb5c8c5602f6d759a6606b46ff0383294f406
|
File details
Details for the file lqft_python_engine-0.5.0-cp38-cp38-win_amd64.whl.
File metadata
- Download URL: lqft_python_engine-0.5.0-cp38-cp38-win_amd64.whl
- Upload date:
- Size: 18.7 kB
- Tags: CPython 3.8, Windows x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
ec4bb0d83ea73b8936d86912f3f62a6f7d08b287c299090a02fd33393c4a048d
|
|
| MD5 |
48388403ba8d1b365281df8f0088cc5c
|
|
| BLAKE2b-256 |
c3e59ee0dbad417d70b0a80b95d69667f8ba85f09bb88ae71264c580f3579970
|
File details
Details for the file lqft_python_engine-0.5.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.
File metadata
- Download URL: lqft_python_engine-0.5.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
- Upload date:
- Size: 29.9 kB
- Tags: CPython 3.8, manylinux: glibc 2.17+ x86-64, manylinux: glibc 2.5+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
571d9774e401c6c7a7be602c135196a55b3b3390ea9fd7b1cf901ba7af7c6a92
|
|
| MD5 |
ea0ba8bf807cfbe97e6c6cb47c6eceb0
|
|
| BLAKE2b-256 |
6062d4cce4be68d6e42a70816c4baa2c629b00c9ad75680adb5fbb8d4797675e
|
File details
Details for the file lqft_python_engine-0.5.0-cp38-cp38-macosx_11_0_arm64.whl.
File metadata
- Download URL: lqft_python_engine-0.5.0-cp38-cp38-macosx_11_0_arm64.whl
- Upload date:
- Size: 16.3 kB
- Tags: CPython 3.8, macOS 11.0+ ARM64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
90e86d4c052cc951d1303aad11de487fde2e9f74e5e5a7f505d9e98d0d2f9fa9
|
|
| MD5 |
57b17341067b188fb7a0e4f2ac8b64c2
|
|
| BLAKE2b-256 |
37eadad8e2deb6144eec0f707bc62c3c64a554355af0adb4d19b98832f7364f4
|
File details
Details for the file lqft_python_engine-0.5.0-cp38-cp38-macosx_10_9_x86_64.whl.
File metadata
- Download URL: lqft_python_engine-0.5.0-cp38-cp38-macosx_10_9_x86_64.whl
- Upload date:
- Size: 16.0 kB
- Tags: CPython 3.8, macOS 10.9+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
0a5c96d09f530ad4d489d75578f488174ffb0f3034660c177ad304f3c2aba561
|
|
| MD5 |
d716a6fdb0f9777e5b35d49165d86a3a
|
|
| BLAKE2b-256 |
26cd1627b18c363c5734138db2d101eb718549080619a0c49a389ce69eeedf0c
|