Skip to main content

LQFT Engine: Billion-Scale Persistence & Vectorized 13M-Search (v0.9.4 Stable)

Project description

Log-Quantum Fractal Tree (LQFT) 🚀

Python 3.12 C-Engine Memory Arena Hardware License

📌 Project Overview

The Log-Quantum Fractal Tree (LQFT) is a high-performance, scale-invariant data structure engine designed for massive data deduplication and persistent state management. It synthesizes Hash Array Mapped Trie (HAMT) routing with Merkle-DAG structural folding to provide deterministic $O(1)$ search latency and sub-linear $O(\Sigma)$ space complexity.

By offloading core associative logic to a native C-Extension, the LQFT completely bypasses the Python Global Interpreter Lock (GIL), providing true hardware concurrency and significant memory reduction for versioned, redundant, or patterned datasets.


🧠 Core Architecture (v0.9.4 Multi-Language Core Prep)

1. Custom Memory Arena (Slab Allocator)

Standard C malloc() introduces significant OS metadata overhead (up to 16 bytes per allocation). In v0.9.0, the LQFT utilizes a Custom Slab Allocator. The engine requests memory in 16KB "Arena Chunks" and performs O(1) bump-allocation internally, crushing the memory footprint down to ~104 bytes per node.

2. Intrinsic Free-List & ARC

When a branch is overwritten, the engine natively reclaims memory using an intrinsic linked-list. "Dead" nodes repurpose their own internal pointers to form an infinite recycle bin, avoiding expensive calls to the Operating System's free() method.

3. O(1) Cryptographic Fast-Path

Branch hash recalculation during Deletion and Updates utilizes mathematical XOR inverses (Parent ^ (Old_Child * Prime) ^ (New_Child * Prime)). This eliminates the standard 32-way branch loop, providing sub-microsecond structural folding.


🚀 Silicon Performance Report (v0.9.2)

Environment: Python 3.12 | GCC -O3 | MinGW64 | 16-Core Parallel Architecture

Metric Result
Raw Memory Density ~104.6 bytes per node (Eliminated 288-byte bloat)
Search Latency (p50) ~500 ns (Deterministic 13-hop limit)
Raw Write Speed 313,433 ops/sec (Zero-Copy Buffer Protocol)
Multi-Thread Scaling Optimistic Concurrency (Read-Copy-Update)

🛠️ Getting Started

Installation

# Clone the repository
git clone [https://github.com/ParjadM/Log-Quantum-Fractal-Tree-LQFT-.git](https://github.com/ParjadM/Log-Quantum-Fractal-Tree-LQFT-.git)
cd Log-Quantum-Fractal-Tree-LQFT-

# Build the native C-extension
python setup.py build_ext --inplace

High-Speed Usage (Zero-Copy)

import lqft_c_engine
import array

# Prepare raw 64-bit buffer
raw_buffer = array.array('Q', [0x1, 0x2, 0x3])
lqft_c_engine.insert_batch_raw(bytes(raw_buffer), "enterprise_payload")

# Sub-microsecond search
result = lqft_c_engine.search(0x1)
print(result) # "enterprise_payload"

# Safe memory arena reclamation
lqft_c_engine.free_all()

⚖️ License

MIT License - Parjad Minooei (2026).

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lqft_python_engine-0.9.4.tar.gz (10.2 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

lqft_python_engine-0.9.4-cp312-cp312-win_amd64.whl (16.6 kB view details)

Uploaded CPython 3.12Windows x86-64

lqft_python_engine-0.9.4-cp312-cp312-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (37.0 kB view details)

Uploaded CPython 3.12manylinux: glibc 2.17+ x86-64manylinux: glibc 2.5+ x86-64

lqft_python_engine-0.9.4-cp312-cp312-macosx_11_0_arm64.whl (13.6 kB view details)

Uploaded CPython 3.12macOS 11.0+ ARM64

lqft_python_engine-0.9.4-cp312-cp312-macosx_10_9_x86_64.whl (13.3 kB view details)

Uploaded CPython 3.12macOS 10.9+ x86-64

lqft_python_engine-0.9.4-cp311-cp311-win_amd64.whl (16.6 kB view details)

Uploaded CPython 3.11Windows x86-64

lqft_python_engine-0.9.4-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (37.7 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.17+ x86-64manylinux: glibc 2.5+ x86-64

lqft_python_engine-0.9.4-cp311-cp311-macosx_11_0_arm64.whl (13.6 kB view details)

Uploaded CPython 3.11macOS 11.0+ ARM64

lqft_python_engine-0.9.4-cp311-cp311-macosx_10_9_x86_64.whl (13.3 kB view details)

Uploaded CPython 3.11macOS 10.9+ x86-64

lqft_python_engine-0.9.4-cp310-cp310-win_amd64.whl (16.6 kB view details)

Uploaded CPython 3.10Windows x86-64

lqft_python_engine-0.9.4-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (36.5 kB view details)

Uploaded CPython 3.10manylinux: glibc 2.17+ x86-64manylinux: glibc 2.5+ x86-64

lqft_python_engine-0.9.4-cp310-cp310-macosx_11_0_arm64.whl (13.6 kB view details)

Uploaded CPython 3.10macOS 11.0+ ARM64

lqft_python_engine-0.9.4-cp310-cp310-macosx_10_9_x86_64.whl (13.3 kB view details)

Uploaded CPython 3.10macOS 10.9+ x86-64

File details

Details for the file lqft_python_engine-0.9.4.tar.gz.

File metadata

  • Download URL: lqft_python_engine-0.9.4.tar.gz
  • Upload date:
  • Size: 10.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for lqft_python_engine-0.9.4.tar.gz
Algorithm Hash digest
SHA256 f030290770711fc17b14381f56065af41f520518fdc306af0d182c701873a874
MD5 5ea20adeff91783d2dc63600e492b442
BLAKE2b-256 cc043ade974fb77fb5880ccbc4462bafe9b0cde1c9a6b5366917b2830d66594d

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.9.4-cp312-cp312-win_amd64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.9.4-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 99df53b5f7e101d10d7b26e9c85400ccccb4e31a0c37c8c3e78bb2d7370a9f9a
MD5 e85a31ee9ec0ce46ce726889100be10c
BLAKE2b-256 0cbfe7d0e59d6aa4abf9265477e5f1bb5ed0d4dccaea786313dd0b7bb17bdde6

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.9.4-cp312-cp312-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.9.4-cp312-cp312-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 57d01d372258b9458b80be0664cfc5392ccf07555ac4085624dd945f09a8bec7
MD5 6d673d7daa59781860abebb269a1d335
BLAKE2b-256 c4adb8ed7e7ec5acfdb30e695480f84e8f1e45106d177c001af7243f000e2ade

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.9.4-cp312-cp312-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.9.4-cp312-cp312-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 a3ebc38216192016f2d4e307cb3e82373fe7db93142e8e5f1c981436fcdc98c1
MD5 648150e5dba51a1a4eedbd6efd556c87
BLAKE2b-256 a9863054dbd8ef20b8c3059099ed65fa060675ffe1d6489943290fcbeb0d739c

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.9.4-cp312-cp312-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.9.4-cp312-cp312-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 167a38d825de860ef17be621bdeedf47b66176fde11ac4b8455c5e5f1222a4e8
MD5 d1619805e7f9cb6f11eec3cc4bd921dd
BLAKE2b-256 6ec09b582b2a0ef96b09afdd46087eb623d7aebbc5aa22362532f621b186cb59

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.9.4-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.9.4-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 91226954fe95450d2d03cfd2b12849fda88f3f07e2e945664f426cd8adaf5784
MD5 121121cf464a9cd0ebc4dc28015acc26
BLAKE2b-256 71d663bec5fa65527d3a5fdf7d26dcf8e7ac48e267c2825564a17330c5ff15b7

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.9.4-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.9.4-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 d5f51f87d7d932a0c4257a78738abccee84047804ffd8efeafd6f313e5a5264d
MD5 06c34f03fd3a89b18c53f705ee586046
BLAKE2b-256 f0cb307dd71e1f60cdeef389696c08a27842c0cd14db1c0b09641809aceb3ca8

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.9.4-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.9.4-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 928b5545046e28b73dcce912bca8ba6be9f8159531d4437d8ff114b83b379b40
MD5 4b4f6fb9a04ae8d65a88330fb031aab4
BLAKE2b-256 74ee847d39b2a7a5eba3f0d432aba1505217eefb9b48b7216c1b4a79d9479280

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.9.4-cp311-cp311-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.9.4-cp311-cp311-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 58a6fbe92253130bb09c8694da6d79e04266f07644f9a901920c30ccf0cca7ff
MD5 d7d2f5a2029c0e8b557af455981f01ee
BLAKE2b-256 7897bbaaf258a4d940651abf2ec1538ce4b27a75007fc91040cba07877845075

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.9.4-cp310-cp310-win_amd64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.9.4-cp310-cp310-win_amd64.whl
Algorithm Hash digest
SHA256 9cd7d179cb110d2931564f40fd7722c7a708fc7974ff4e0cd6cbb1123eb92019
MD5 198584aa7070892d4ab88c9243764969
BLAKE2b-256 a195de5ea683af31a1e3a92ce255c80d1a989a42095ea5adf9fcdb7231fccc2c

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.9.4-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.9.4-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 a222cee2b41541b1b8ef4250762cbb068daa7286da7d82443dc96ee6635d79d3
MD5 6e2a6dae3d52d55a12e1d5171b0d4cef
BLAKE2b-256 4106d34cf604278ce0967fbf70fd9427aff05822795b426325aa33196f31f2c2

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.9.4-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.9.4-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 94b4bb0f3f38e16434c62d4527bc2e97d27085d046bcefc7b2ab54db6a8cfc6f
MD5 70a4fd113baefc6a65329145f6baaa97
BLAKE2b-256 ee2e33d0fe9bf3d7d3bba70de6dc22d54aaa4a3e2e5631b4f7023be2aaf1fdbc

See more details on using hashes here.

File details

Details for the file lqft_python_engine-0.9.4-cp310-cp310-macosx_10_9_x86_64.whl.

File metadata

File hashes

Hashes for lqft_python_engine-0.9.4-cp310-cp310-macosx_10_9_x86_64.whl
Algorithm Hash digest
SHA256 59df51a08b273495d1e995a5c9fcacb96fc6f44278d0f231b61d9c9d9c503bfe
MD5 3bb8e14833da7f32a26ca360a1fc6d68
BLAKE2b-256 32db0f0e7961a871d5a941b0b66d43974b1f3ef52fd1cdcc2c18fa154d13a1e5

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page