scipy.sparse support on h5py
Project description
h5max
handles storing and loading of scipy.sparse
data structures in h5py
file objects that are not natively supported. It assumes a simple data structure where information of individual samples are stored according to the index they occupy within datasets.
Installation
pip install h5max
Usage
import h5py
import h5max
import numpy as np
fh = h5py.File('my_data.h5', 'w')
a = np.zeros((100,100))
b = np.zeros((1000,50))
a[7,1] = 1
b[1,0] = 10
Ms = [a, b]
# store both a, b
h5max.store_sparse(fh, Ms, format='csr')
# load only a (index 0)
a_out = h5max.load_sparse(fh, 0, format='csr')
# load [a,b]
Ms_out = h5max.load_sparse(fh, [0, 1], format='csr')
fh.close()
Package features
- Support for
csr
,csc
,coo
sparse types - Support for
bsr
,dia
,dok
,lil
sparse types - Support for overwriting
- Flexible data loading and saving (both as sparse and numpy arrays.)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
h5max-0.3.0.tar.gz
(47.5 kB
view hashes)
Built Distribution
h5max-0.3.0-py3-none-any.whl
(3.7 kB
view hashes)