Skip to main content

ML package for data cubes

Project description

ml4xcube: Machine Learning Toolkits for Data Cubes

Welcome to ml4xcube, a comprehensive Python-based toolkit designed for researchers and developers in the field of machine learning with an emphasis on xarray data cubes. Our toolkit is engineered to provide specialized and robust support for data cube management and analysis, operating with the state-of-the-art machine learning libraries (1) scikit-learn, (2) PyTorch and (3) TensorFlow.

Installation

Get started with ml4xcube effortlessly by installing it directly through pip:

pip install ml4xcube

or Conda:

conda install -c conda-forge ml4xcube

Make sure you have Python version 3.8 or higher.

If you're planning to use ml4xcube with TensorFlow or PyTorch, set up these frameworks properly in your Conda environment.

Features

  • Data preprocessing and normalization/standardization functions
  • Gap filling features
  • Dataset creation and train-/ test split sampling techniques
  • Trainer classes for sklearn, TensorFlow and PyTorch
  • Distributed training framework compatible with PyTorch
  • chunk utilities for working with data cubes

Usage

To use ml4xcube in your project, simply import the necessary module:

from ml4xcube.preprocessing import normalize, standardize
from ml4xcube.training.pytorch import Trainer
# Other imports...

You can then call the functions directly:

# Normalizing data
normalized_data = normalize(your_data, data_min, data_max)

# Trainer instance
trainer = Trainer(
    model           = reg_model,
    train_data      = train_loader,
    test_data       = test_loader,
    optimizer       = optimizer,
    best_model_path = best_model_path,
    early_stopping  = True,
    patience        = 3,
    epochs          = epochs
)

# Start training
reg_model = trainer.train()

License

ml4xcube is released under the MIT License. See the LICENSE file for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ml4xcube-1.0.1.tar.gz (38.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ml4xcube-1.0.1-py3-none-any.whl (48.3 kB view details)

Uploaded Python 3

File details

Details for the file ml4xcube-1.0.1.tar.gz.

File metadata

  • Download URL: ml4xcube-1.0.1.tar.gz
  • Upload date:
  • Size: 38.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.10.5

File hashes

Hashes for ml4xcube-1.0.1.tar.gz
Algorithm Hash digest
SHA256 71940469581071621384ba9b9f6ff89e4494612595de4392c4f6932c8741fb3c
MD5 9b38f81bbf550c637dda3f4c6698cd17
BLAKE2b-256 35b856129ef4cb0ecfca5fdadbf98977434dbda42c16eb20a612bfb1304cfd7b

See more details on using hashes here.

File details

Details for the file ml4xcube-1.0.1-py3-none-any.whl.

File metadata

  • Download URL: ml4xcube-1.0.1-py3-none-any.whl
  • Upload date:
  • Size: 48.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.10.5

File hashes

Hashes for ml4xcube-1.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 1407e8cd2397a31df93d9a4cdc82b5d9a9e0b355a378dd456cd95c11b163f0e3
MD5 b04d0851755a6f2b9edbc38f482fecf2
BLAKE2b-256 b0df6a3a5cfbf765927180965b3abd18c009f2214e068f8c98ed2191458be3ad

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page