A data processesing and storing helper based on LevelDB
Project description
Pypeline is designed to simplify the creation and management of large data. It has a friendly and easy-to-master API backed by the power of LevelDB. This allows it to manage datasets too large to fit in RAM without sacrificing data access performance.
Pypeline is great for:
Exploring datasets without eating all your RAM
Transforming data with maps, filters and reductions
Stopping you from losing or overwriting your data (unless you explicitly ask it to)
It’s also super easy to export a dataset from Pypeline to Pandas for further analysis.
Links
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
pypeline-db-0.2.2.tar.gz
(5.3 kB
view hashes)