Skip to main content

A minimalist Python project for deep learning experiment management. It uses Ray for core distributed environment and backend setup, and provides basic, no-frills tracking for models, optimizers, and LR schedulers.

Project description

Main codecov

TinyExp

A simple Python project for deep learning experiment management.

TinyExp lets you launch experiments with one click: the file you edit becomes the entrypoint to your experiment.

Usage

pip install tinyexp
  1. Run mnist example(By default, It will trained on CPU)
import tinyexp
from tinyexp.examples.mnist_exp import Exp, store_and_run_exp
store_and_run_exp(Exp)
  1. or:
python tinyexp/examples/mnist_exp.py
  1. Run mnist example with overridden config:
python tinyexp/examples/mnist_exp.py dataloader_cfg.train_batch_size_per_device=16

see all available configs:

python tinyexp/examples/mnist_exp.py mode=help

see all available configs with overridden configs:

python tinyexp/examples/mnist_exp.py mode=help dataloader_cfg.train_batch_size_per_device=16

More Examples

  1. ImageNet ResNet-50 Example with Extremely Fast Data Loading (By default, all available GPUs will be used.)
# export IMAGENET_HOME=yours_imagenet_dir

import tinyexp
from tinyexp.examples.resnet_exp import ResNetExp, store_and_run_exp
store_and_run_exp(ResNetExp)

Develop

  1. prepare env
# 1. clone repo
git clone https://github.com/HKUST-SAIL/tinyexp.git
# 2. Set Up Your Development Environment, This will also generate your `uv.lock` file
make install
source .venv/bin/activate
  1. After development, checking whether the code is standardized
# Initially, the CI/CD pipeline might be failing due to formatting issues. To resolve those run:
uv run pre-commit run -a

License

MIT License. See LICENSE.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tinyexp-0.0.1.tar.gz (25.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tinyexp-0.0.1-py3-none-any.whl (26.1 kB view details)

Uploaded Python 3

File details

Details for the file tinyexp-0.0.1.tar.gz.

File metadata

  • Download URL: tinyexp-0.0.1.tar.gz
  • Upload date:
  • Size: 25.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.16

File hashes

Hashes for tinyexp-0.0.1.tar.gz
Algorithm Hash digest
SHA256 6f41431b0d9b10ab9e8e2add6c8f7e5f00c531376f481bb253774f3206782174
MD5 0a91fcf8fb9e6acfc5f25cd7e322dd48
BLAKE2b-256 3613f75e742f238fc581f9f0b58f8889575957b394886af3cec96993e9fbcc34

See more details on using hashes here.

File details

Details for the file tinyexp-0.0.1-py3-none-any.whl.

File metadata

  • Download URL: tinyexp-0.0.1-py3-none-any.whl
  • Upload date:
  • Size: 26.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.16

File hashes

Hashes for tinyexp-0.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 04167246fb3c5ce78d222ea3c53649a08a3c4e35245223bf971e3d12dbe06666
MD5 b407247e60fb9c20d27c6512655bd339
BLAKE2b-256 325ffe52b64da4b67049f37152a815fce91a5b6b77199b70cee6dc69b030f2ac

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page