Skip to main content

Image dataset format benchmark

Project description

This package runs different image format benchmarks for dataset ML tasks

Installation

Make sure you have some system deps installed:

sudo apt install pkg-config libhdf5-dev
python3.11 -m venv venv --upgrade-deps
source venv/bin/activate
python -m pip install -U -r requirements_dev.txt

# For running on Nvidia GPU:
python -m pip install -U torch torchvision

# For running on CPU:
python -m pip install -U torch torchvision torchaudio --extra-index-url https://download.pytorch.org/whl/cpu

# For some reason h5py fails to install Cython while it needs it
python -m pip install -U Cython

python setup.py develop

Running dataset format benchmark

python -m dataset_format_benchmark --data-root /path/to/datasets/

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dataset-format-benchmark-0.0.13.tar.gz (45.9 kB view details)

Uploaded Source

Built Distribution

dataset_format_benchmark-0.0.13-py2.py3-none-any.whl (45.8 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file dataset-format-benchmark-0.0.13.tar.gz.

File metadata

File hashes

Hashes for dataset-format-benchmark-0.0.13.tar.gz
Algorithm Hash digest
SHA256 082e957cff81046f35adf3807f930f1ffe094d7b5187cb0c28ba6d75103d88db
MD5 b8f039762c9cbc6ba60ae925600eacbc
BLAKE2b-256 9ae6e483b333bd80eed64f867a0907b64964adfdb4782d3f312cb19440fbcbbb

See more details on using hashes here.

File details

Details for the file dataset_format_benchmark-0.0.13-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for dataset_format_benchmark-0.0.13-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 4bb36102380d87d5e21726b399ef0c165e9fcee4564fc9a3835944981b597f4a
MD5 e40dc6fc6e8183ceaa10343b33207b70
BLAKE2b-256 6084819990dec4c376f910efb95c3a090e71aa076d5008e763514437b10ac3e3

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page