Deep Learning experiments from University of Chicago.
Project description
deepdish
Deep learning and data science tools from the University of Chicago.
Installation
Make sure that you have Cython and Numpy installed. Then run:
pip install deepdish
Main feature
The primary feature of deepdish is its ability to save and load all kinds of data as HDF5. It can save any Python data structure, offering the same ease of use as pickling or numpy.save. However, it improves by also offering:
Interoperability between languages (HDF5 is a popular standard)
Easy to inspect the content from the command line (using h5ls or our specialized tool ddls)
Highly compressed storage (thanks to a PyTables backend)
Native support for scipy sparse matrices and pandas DataFrame, Series and Panel
Ability to partially read files, even slices of arrays
An example:
import deepdish as dd
d = {
'foo': np.ones((10, 20)),
'sub': {
'bar': 'a string',
'baz': 1.23,
},
}
dd.io.save('test.h5', d)
This can be reconstructed using dd.io.load('test.h5'), or inspected through the command line using either a standard tool:
$ h5ls test.h5 foo Dataset {10, 20} sub Group
Or, better yet, our custom tool ddls (or python -m deepdish.io.ls):
$ ddls test.h5 /foo array (10, 20) [float64] /sub dict /sub/bar 'a string' (8) [unicode] /sub/baz 1.23 [float64]
Read more at Saving and loading data.
Documentation
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for deepdish-0.3.2-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1ce91f1115229da3f80a17e89b6eb8ff16f59158a71abbcd2b10bc0f4636c60a |
|
MD5 | b8522091af9e13ace0cc56c60eee4890 |
|
BLAKE2b-256 | 10c128f9bc0a56b1dd695862e7c9af2d453877a844e5cba37b4a986ec1cf0a7d |