Skip to main content

Image dataset format benchmark

Project description

This package runs different image format benchmarks for dataset ML tasks

Installation

Make sure you have some system deps installed:

sudo apt install pkg-config libhdf5-dev
python3.11 -m venv venv --upgrade-deps
source venv/bin/activate
python -m pip install -U -r requirements_dev.txt

# For running on Nvidia GPU:
python -m pip install -U torch torchvision

# For running on CPU:
python -m pip install -U torch torchvision torchaudio --extra-index-url https://download.pytorch.org/whl/cpu

# For some reason h5py fails to install Cython while it needs it
python -m pip install -U Cython

python setup.py develop

Running dataset format benchmark

python -m dataset_format_benchmark --data-root /path/to/datasets/

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dataset-format-benchmark-0.0.12.tar.gz (45.5 kB view hashes)

Uploaded Source

Built Distribution

dataset_format_benchmark-0.0.12-py2.py3-none-any.whl (45.8 kB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page