Skip to main content

ML package for data cubes

Project description

ml4xcube: Machine Learning Toolkits for Data Cubes

Welcome to ml4xcube, a comprehensive Python-based toolkit designed for researchers and developers in the field of machine learning with an emphasis on xarray data cubes. Our toolkit is engineered to provide specialized and robust support for data cube management and analysis, operating with the state-of-the-art machine learning libraries (1) scikit-learn, (2) PyTorch and (3) TensorFlow.

Installation

Get started with ml4xcube effortlessly by installing it directly through pip:

pip install ml4xcube

or Conda:

conda install -c conda-forge ml4xcube

Make sure you have Python version 3.8 or higher.

If you're planning to use ml4xcube with TensorFlow or PyTorch, set up these frameworks properly in your Conda environment.

Features

  • Data preprocessing and normalization/standardization functions
  • Gap filling features
  • Dataset creation and train-/ test split sampling techniques
  • Trainer classes for sklearn, TensorFlow and PyTorch
  • Distributed training framework compatible with PyTorch
  • chunk utilities for working with data cubes

Usage

To use ml4xcube in your project, simply import the necessary module:

from ml4xcube.preprocessing import normalize, standardize
from ml4xcube.training.pytorch import Trainer
# Other imports...

You can then call the functions directly:

# Normalizing data
normalized_data = normalize(your_data, data_min, data_max)

# Trainer instance
trainer = Trainer(
    model           = reg_model,
    train_data      = train_loader,
    test_data       = test_loader,
    optimizer       = optimizer,
    best_model_path = best_model_path,
    early_stopping  = True,
    patience        = 3,
    epochs          = epochs
)

# Start training
reg_model = trainer.train()

License

ml4xcube is released under the MIT License. See the LICENSE file for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ml4xcube-1.1.0.tar.gz (48.2 kB view details)

Uploaded Source

Built Distribution

ml4xcube-1.1.0-py3-none-any.whl (59.0 kB view details)

Uploaded Python 3

File details

Details for the file ml4xcube-1.1.0.tar.gz.

File metadata

  • Download URL: ml4xcube-1.1.0.tar.gz
  • Upload date:
  • Size: 48.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.10.5

File hashes

Hashes for ml4xcube-1.1.0.tar.gz
Algorithm Hash digest
SHA256 6a61432b4878f7ac45fe59ff3b5e8859f096e8c7b32d8be8d03b95cf88c446d5
MD5 cbd8a0f89e9b1a7e5a1aaf049c96bf73
BLAKE2b-256 78c670e97110eda44369beb0d13a4171a756385d1d0b78e32b41aec8c91560a8

See more details on using hashes here.

File details

Details for the file ml4xcube-1.1.0-py3-none-any.whl.

File metadata

  • Download URL: ml4xcube-1.1.0-py3-none-any.whl
  • Upload date:
  • Size: 59.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.10.5

File hashes

Hashes for ml4xcube-1.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 0f4f0242c426ee845296d0c1bc373a2907f13bce3921fbb42d7bb9defbecf26d
MD5 88a2a43979b8f17f0dccfd9ff1ca1a50
BLAKE2b-256 06b428648bf909f81689263030055f73b711f81490ea7b98f239d34add7799fb

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page