A solution for handling big, multidimensional timeseries data from environmental sensors in HPC applications.
Project description
HDF5eis Python API (read H-D-F-Size)
A solution for handling big, multidimensional timeseries data from environmental sensors in HPC applications.
HDF5eis is designed to
- store primitive timeseries data with any number of dimensions;
- store auxiliary and meta data in columnar format or as UTF-8 encoded byte streams alongside timeseries data;
- provide a single point of fast access to diverse data distributed across many files; and
- simultaneously leverage existing technology and minimize external dependencies.
import hdf5eis
with hdf5eis.File("demo.hdf5", mode="w") as demo_file:
# Add some random multidimensional timeseries data to the demo.hdf5 file.
first_sample_time = "2022-01-01T00:00:00Z"
sampling_rate = 100
demo_file.timeseries.add(
np.random.rand(32, 16, 8, 16, 32, 1000),
first_sample_time,
sampling_rate,
tag="random"
)
# Data can be efficiently retrieved using hybrid dictionary (with regular expression parsing)
# and array metaphors.
start_time, end_time = "2022-01-01T00:01:00Z", "2022-01-01T00:02:00Z"
sliced_data = demo_file.timeseries["rand*", 8:12, ..., 0, start_time: end_time]
Installation
>$ pip install hdf5eis
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
HDF5eis-0.1.1rc2.tar.gz
(13.0 kB
view hashes)
Built Distribution
HDF5eis-0.1.1rc2-py3-none-any.whl
(13.6 kB
view hashes)
Close
Hashes for HDF5eis-0.1.1rc2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 81bd55c35b2d0dc7e051ca2fc67a9203cb9c22932418f9556c29ab20a739801e |
|
MD5 | 082cd059b3aaa48238509ebe88c83ac6 |
|
BLAKE2b-256 | 421c5ca89e4847c4340421357bf1fce8c4ad0bea96e746d1393c7607de259568 |