Skip to main content
This is a pre-production deployment of Warehouse. Changes made here affect the production instance of PyPI (pypi.python.org).
Help us improve Python packaging - Donate today!

utilities for managing nested lists of lists of scipy.sparse matrices

Project Description

coo_utils works with numpy and scipy.sparse (2D only) to store compressed multidimensional arrays both in memory and on disks. This can DRASTICALLY reduce the space required.

In reality, what is stored is a list-of-lists containing sparse matrix nodes in the scipy.sparse.coo_matrix format. The storage format can either be normal or differenced (helpful for same-value blocks data).

Some terms used in the code:

CooHD: list (or deeply nested list(s)) of scipy.sparse.coo_matrix’s (HD means higher-dimensional)

nnzs: An array with the same shape as the nested lists in the cooHD (aka without the 2 coo_matrix dimensions) that gives the length of each coo_matrix (nnz) at each node of the tree

RCD: A sparse array represented as a flat row-column-data matrix. Multi-dimensional shape data is recoverable using the nnzs array

The disk storage format uses the RCD fomat for maximum simplicity:

*_rcd.npy - The rcd matrix stored in the .npy format (int32)

*_nnzs.npy - The nnzs array store in .npy format (int)

*_shape.txt - a simple text file with the full shape of the array in comma-separated plain text

Release History

Release History

This version
History Node

0.1.2.1

Download Files

Download Files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

File Name & Checksum SHA256 Checksum Help Version File Type Upload Date
coo_utils-0.1.2.1.tar.gz (3.0 kB) Copy SHA256 Checksum SHA256 Source Mar 13, 2014

Supported By

WebFaction WebFaction Technical Writing Elastic Elastic Search Pingdom Pingdom Monitoring Dyn Dyn DNS Sentry Sentry Error Logging CloudAMQP CloudAMQP RabbitMQ Heroku Heroku PaaS Kabu Creative Kabu Creative UX & Design Fastly Fastly CDN DigiCert DigiCert EV Certificate Rackspace Rackspace Cloud Servers DreamHost DreamHost Log Hosting