pylitestream 0.1.0

An ultra-lightweight data streaming library designed to prevent Out-of-Memory crashes on mobile IDEs like Pydroid 3.

PyLiteStream

An ultra-lightweight, memory-optimized streaming library engineered explicitly for resource-constrained environments like mobile IDEs (Pydroid 3, Termux).

The Problem

Loading large datasets (2GB+) into standard Python data structures causes immediate application crashes on mobile hardware due to extreme memory spikes.

The Solution

PyLiteStream utilizes custom stateful generators and forced garbage collection to parse massive data assets sequentially in strict, isolated memory packets, ensuring total memory stability.

How To Use

from pylitestream import PyLiteStreamer

# Open any massive database file safely in 10MB blocks
optimizer = PyLiteStreamer("giant_database.txt", chunk_size_mb=10)

for index, packet in optimizer.stream_packets():
    print(f"Processing packet {index}")