multidimio 0.0.2

Cloud-native, scalable, and user-friendly multi dimensional energy data!

"MDIO" is a library to work with large multi-dimensional energy datasets. The primary motivation behind MDIO is to represent multi-dimensional time series data in a format that makes it easier to use in resource assesment, machine learning, and data processing workflows.

Features

Shared Features

• Abstractions for common energy data types (see below).
• Cloud native chunked storage based on Zarr and fsspec.
• Lossy and lossless data compression using Blosc and ZFP.
• Distributed reads and writes using Dask.
• Powerful command-line-interface (CLI) based on Click

Domain Specific Features

• Oil & Gas Data
  • Import and export 2D - 5D seismic data types stored in SEG-Y.
  • Import seismic interpretation, horizon, data (experimental).
  • Optimized chunking logic for various seismic types.
• Wind Resource Assessment
  • Numerical weather prediction models with arbitrary metadata.
  • Optimized chunking logic for time-series analysis and mapping.
  • Xarray interface.

Requirements

• TODO

Installation

You can install MDIO via pip from PyPI:

pip install multidimio

You can also install some optional dependencies (extras) like this:

pip install multidimio[distributed]
pip install multidimio[cloud]
pip install multidimio[lossy]

distributed installs Dask for parallel, distributed processing.
cloud installs fsspec backed I/O libraries for AWS' S3, Google's GCS, and Azure ABS.
lossy will install the ZFPY library for lossy chunk compression.

Usage

Please see the Command-line Reference for details.

Contributing

Contributions are very welcome. To learn more, see the Contributor Guide.

License

Distributed under the terms of the Apache 2.0 license, MDIO is free and open source software.

Issues

If you encounter any problems, please file an issue along with a detailed description.

Credits

This project was generated from @cjolowicz's Hypermodern Python Cookiecutter template.