Skip to main content

ML package for data cubes

Project description

ml4xcube: Machine Learning Toolkits for Data Cubes

Welcome to ml4xcube, a comprehensive Python-based toolkit designed for researchers and developers in the field of machine learning with an emphasis on xarray data cubes. Our toolkit is engineered to provide specialized and robust support for data cube management and analysis, operating with the state-of-the-art machine learning libraries (1) scikit-learn, (2) PyTorch and (3) TensorFlow.

Installation

Get started with ml4xcube effortlessly by installing it directly through pip:

pip install ml4xcube

or Conda:

conda install -c conda-forge ml4xcube

Make sure you have Python version 3.8 or higher.

If you're planning to use ml4xcube with TensorFlow or PyTorch, set up these frameworks properly in your Conda environment.

Features

  • Data preprocessing and normalization/standardization functions
  • Gap filling features
  • Dataset creation and train-/ test split sampling techniques
  • Trainer classes for sklearn, TensorFlow and PyTorch
  • Distributed training framework compatible with PyTorch
  • chunk utilities for working with data cubes

Usage

To use ml4xcube in your project, simply import the necessary module:

from ml4xcube.preprocessing import normalize, standardize
from ml4xcube.training.pytorch import Trainer
# Other imports...

You can then call the functions directly:

# Normalizing data
normalized_data = normalize(your_data, data_min, data_max)

# Trainer instance
trainer = Trainer(
    model           = reg_model,
    train_data      = train_loader,
    test_data       = test_loader,
    optimizer       = optimizer,
    best_model_path = best_model_path,
    early_stopping  = True,
    patience        = 3,
    epochs          = epochs
)

# Start training
reg_model = trainer.train()

License

ml4xcube is released under the MIT License. See the LICENSE file for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ml4xcube-1.0.0.tar.gz (49.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ml4xcube-1.0.0-py3-none-any.whl (66.7 kB view details)

Uploaded Python 3

File details

Details for the file ml4xcube-1.0.0.tar.gz.

File metadata

  • Download URL: ml4xcube-1.0.0.tar.gz
  • Upload date:
  • Size: 49.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.10.5

File hashes

Hashes for ml4xcube-1.0.0.tar.gz
Algorithm Hash digest
SHA256 8d634573e3e5a352dd4e36f5c6787c436e0da575a501a0037b1a257d571d264e
MD5 1cbae501955f5a9c9589a4cc9c3ce760
BLAKE2b-256 e6ab1f619bf7066a327c002db8c5f884957bca39fb7262bfeee6f6cd84781117

See more details on using hashes here.

File details

Details for the file ml4xcube-1.0.0-py3-none-any.whl.

File metadata

  • Download URL: ml4xcube-1.0.0-py3-none-any.whl
  • Upload date:
  • Size: 66.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.10.5

File hashes

Hashes for ml4xcube-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 b8f0f20846f819262fbb22de6d454223d059a54cf70959f53deaa3a15705fb2a
MD5 658d5b6b9f712606aeb5798836866a61
BLAKE2b-256 bc3551a4534e7e04e6efeaae5da5fb12afe4a1f9675dd4f8090c2d47c4c38a99

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page