Skip to main content

A toolbox for pre-processing and formatting image datasets.

Project description

imgparallel

A toolbox for pre-processing and formatting image datasets.

imgparallel is a command line interface and python library for processing image datasets stored as individual files. Currently the tool exists as an MVP, supporting very minimal transforms and limited flexibility.

Installation

From PyPI

pip install imgparallel

From Source

git clone https://github.com/jackson-waschura/imgparallel.git
cd imgparallel/
pip install -e .

Examples

Here is an example usage which resizes all images from test_data/input_images to 512x512 then saves them to test_data/output_images as jpegs.

imgparallel --src test_data/input_images --dst test_data/output_images --resize 512x512 --format jpg --proc_per_stage 1

The CLI can also be invoked like this:

python3 imgparallel/cli.py --src test_data/input_images --dst test_data/output_images --resize 512x512 --format jpg --proc_per_stage 1

To Do

  • Implement a simple MVP CLI tool for reformatting an image dataset (image format, resize)
  • Evaluate the output of running the tool
  • Implement sanity checks / tests for permissions before running the pipeline.
  • Add an alias / script into the package so it can be run by name from anywhere
  • Implement tests to evaluate correctness of the tool
  • Use wheel and twine to publish the MVP tool
  • Draft a design for more complex transforms (multiple resolution outputs, cropping, etc)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

imgparallel-0.1.0.tar.gz (9.6 kB view details)

Uploaded Source

Built Distribution

imgparallel-0.1.0-py3-none-any.whl (11.7 kB view details)

Uploaded Python 3

File details

Details for the file imgparallel-0.1.0.tar.gz.

File metadata

  • Download URL: imgparallel-0.1.0.tar.gz
  • Upload date:
  • Size: 9.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.8.10

File hashes

Hashes for imgparallel-0.1.0.tar.gz
Algorithm Hash digest
SHA256 9864cb9248feeb2c561540c17b155b1018687e5e5c47d002486b458ac69857b6
MD5 646a19b740b5c5b9785ed93ad73d74d8
BLAKE2b-256 3bcd8e892025e986f204113206140840b61c53ce279f51e7c72388f3fb6dcada

See more details on using hashes here.

File details

Details for the file imgparallel-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: imgparallel-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 11.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.8.10

File hashes

Hashes for imgparallel-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 fa0836c63f0d8d876ee569b257436e58ec2d91aa5d07656206f66719368526b5
MD5 2ce1740a67a98f6b0f3a37929173766f
BLAKE2b-256 9db2b41e4891b4f3db0d349ef2e35fbcc58e4add5af8a3b7b1b0e7f4a9772325

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page