Persistent importable archival of python objects to disk
Project description
Persistent archival of python objects in an importable format.
This package provides a method for archiving python objects to disk for long-term persistent storage. The archives are importable python packages with large data stored in HDF5 files using the h5py package (if it is installed). The original goal was to overcomes several disadvatages of pickles:
Archives are relatively stable to code changes. Unlike pickles, changing the underlying code for a class will not change the ability to read an archive if the API does not change.
In the presence of API changes, the archives can be edited by hand to fix them since they are simply python code. (Note: for reliability, the generated code is highly structured and not so “pretty”, but can still be edited or debugged in the case of errors due to API changes.)
Efficient storage of large arrays.
Documentation: http://persist.readthedocs.org
Source: https://bitbucket.org/mforbes/persist
Issues: https://bitbucket.org/mforbes/persist/issues
Installing
This package can be installed from from the bitbucket project:
pip install hg+https://bitbucket.org/mforbes/persist