Skip to main content

A modular framework for registering and running haphazard datasets and models.

Project description

Haphazard

A Python package for haphazard dataset and model management.
Provides a standardized interface for loading datasets and models, running experiments, and extending with custom datasets or models.


Table of Contents


Installation

Install via pip (after packaging):

pip install haphazard

Or for local development:

git clone <repo_url>
cd haphazard
pip install -e .

Project Structure

The Haphazard package has a modular layout:

haphazard/
├── __init__.py                    # Top-level package
├── data/                          # Dataset related modules
│   ├── __init__.py
│   ├── base_dataset.py            # Abstract BaseDataset class
│   ├── mask.py
│   └── datasets/   
│       ├── __init__.py            # All dataset implementations
│       ├── dummu_dataset/
│       ├── magic04/
│       ├── dry_bean/
│       └── gas/
├── models/                        # Model related modules
│   ├── __init__.py
│   ├── base_model.py              # Abstract BaseModel class
│   └── model_zoo/                 # All model implementations
│       ├── __init__.py
│       ├── dummu_model/
│       ├── olvf/
│       ├── olifl/
│       └── ovfm/
└── utils/                         # Optional helper functions
    └── ...

Notes:

  • data/base_dataset.py defines BaseDataset.
  • data/datasets/ contains registered datasets; each dataset is a submodule with __init__.py.
  • models/base_model.py defines BaseModel.
  • models/model_zoo/ contains registered models; each model is a submodule with __init__.py.
  • utils/ is optional, for shared helpers.

This layout allows dynamic registration of datasets and models via decorators.


Quick Start

from haphazard import load_dataset, load_model

# Load dataset
dataset = load_dataset("dummy", n_samples=100, n_features=10)

# Load model
model = load_model("dummy")

# Run model
outputs = model(dataset)
print(outputs)

Datasets

  • All datasets must inherit from BaseDataset.
  • Example dataset: DummyDataset.
  • Main interface:
from haphazard import load_dataset

dataset = load_dataset("dummy", base_path="./data")
x, y = dataset.load_data()
mask = dataset.load_mask(scheme="probabilistic", availability_prob=0.5)

Dataset Attributes

  • name : str — Dataset name.
  • task : "classification" | "regression".
  • haphazard_type : "controlled" | "intrinsic".
  • n_samples, n_features : int.
  • num_classes : int (for classification).

Available Datasets (does not include raw files)

  • Dummy ("dummy"): For testing and prototyping.
  • Magic04 ("magic04"): Binary classification
  • Dry Bean ("dry_bean"): Multi-class classification
  • GAS ("gas"): Multi-class classification

Models

  • All models must inherit from BaseModel.
  • Example model: DummyModel.
  • Main interface:
from haphazard import load_model

model = load_model("dummy")
outputs = model(dataset)

Output

  • Classification: labels, preds, logits, time_taken, is_logit.
  • Regression: targets, preds, time_taken.

Available Models

  • Dummy ("dummy"): For testing and prototyping.
  • OLVF ("olvf"): Supports binary and multi-class classification.
  • OLIFL ("olifl"): Supports binary and multi-class classification.

Versions

v1.0.3

  • Added model DynFo

NOTE:

  • DynFo requires an initial buffer.
  • If no initial buffer size is provided, it is set to 1.
  • The length of the output labels/preds/logits is reduced by the initial buffer size.

v1.0.2

  • Added model OVFM

v1.0.0

(Considered to be the base version, ignore versions before this)

  • Includes models 'OLVF' and 'OLIFL' natively.
  • Includes datasets 'Magic04', 'Dry Bean' and 'Gas'. (Does not include raw files to read from, please use base_path argument to point to relevant path containing the raw files).

Contributing

Haphazard is designed for easy extensibility. You can add new datasets and models.

Adding a new dataset

  1. Create a new folder under haphazard/data/datasets/, e.g., my_dataset/.
  2. Add __init__.py:
from ...base_dataset import BaseDataset
from ...datasets import register_dataset
import numpy as np

@register_dataset("my_dataset")
class MyDataset(BaseDataset):
    def __init__(self, base_path="./", **kwargs):
        self.name = "my_dataset"
        self.haphazard_type = "controlled"
        self.task = "classification"
        super().__init__(base_path=base_path, **kwargs)

    def read_data(self, base_path="./"):
        # Load or generate x, y
        x = np.random.random((100, 10))
        y = np.random.randint(0, 2, 100)
        return x, y
  1. The dataset is automatically registered and can be loaded with load_dataset("my_dataset").

Adding a new model

  1. Create a new folder under haphazard/models/model_zoo/, e.g., my_model/.
  2. Add __init__.py:
from ...base_model import BaseModel, BaseDataset
from ...model_zoo import register_model
import numpy as np

@register_model("my_model")
class MyModel(BaseModel):
    def __init__(self, **kwargs):
        self.name = "MyModel"
        self.tasks = {"classification", "regression"}
        self.deterministic = True
        self.hyperparameters = set()
        super().__init__(**kwargs)

    def fit(self, dataset: BaseDataset, mask_params=None, model_params=None, seed=42):
        # Dummy implementation
        x, y = dataset.load_data()
        mask = dataset.load_mask(**mask_params)
        preds = np.random.randint(0, 2, size=y.shape[0])
        if dataset.task == "classification":
            return {
                "labels": y,
                "preds": preds,
                "logits": preds.astype(float),
                "time_taken": 0.0,
                "is_logit": True
            }
        elif dataset.task == "regression":
            return {
                "targets": y,
                "preds": preds,
                "time_taken": 0.0,
            }
  1. The model is automatically registered and can be loaded with load_model("my_model").

License

MIT License.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

haphazard-1.0.3.tar.gz (54.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

haphazard-1.0.3-py3-none-any.whl (81.2 kB view details)

Uploaded Python 3

File details

Details for the file haphazard-1.0.3.tar.gz.

File metadata

  • Download URL: haphazard-1.0.3.tar.gz
  • Upload date:
  • Size: 54.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.10

File hashes

Hashes for haphazard-1.0.3.tar.gz
Algorithm Hash digest
SHA256 7c36a628f35ab4ca86ea477ebbf2e61db7333c56835df7dd580e8709fe4a12ad
MD5 38453be8f1ab0d4ecbe69413d6574cc6
BLAKE2b-256 ad786f6e1b1e93a90323d3363d6c69cc65c8daf9a4a5a005d9298894c181860d

See more details on using hashes here.

File details

Details for the file haphazard-1.0.3-py3-none-any.whl.

File metadata

  • Download URL: haphazard-1.0.3-py3-none-any.whl
  • Upload date:
  • Size: 81.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.10

File hashes

Hashes for haphazard-1.0.3-py3-none-any.whl
Algorithm Hash digest
SHA256 4c7aca1a1dbf1297fc050c2dee6e4a102dd45e8eca773e4cbf939cea40b2e0f1
MD5 1c9f2f9f456f89322ea31f370bf36daf
BLAKE2b-256 0c96518ea42e8752f83658c6c22a41a6ac0d7263a02baa6083962c49a0092c29

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page