Skip to main content

This is a pipeline that is driven by configuration files for model running based on PyTorch Lightning.

Project description

Pipelight: The Easiest Pipeline for Training, Validation and Test Based on PyTorch Lightning

License: MIT Python Version PyTorch Version PyTorch Lightning Version

Pipelight is a pipeline that is driven by configuration files for model running based on PyTorch Lightning.

Key Features

  • Reproducible Pipelines: Built-in experiment tracking and deterministic training
  • Configuration-Driven Workflows: Define experiments through YAML configs with PyTorch Lightning integration

Installation

pip install pipelight

Quick Start

Configuration-Based Execution

Copy pipelight/configs as a template to the project folder, and enter this folder. All YAML files can be modified to meet the task requirements.

For training and validation, just run:

python -m pipelight.run --train configs/train.yaml --val configs/val.yaml -m {model config} -r configs/running/runner.yaml -n experiment_01

After that, run the following to test:

python -m pipelight.run --test configs/test.yaml -m {model config} -r configs/running/runner.yaml -n experiment_01

Make sure the name of the experiment should be kept the same.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pipelight-0.0.1b5.tar.gz (23.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pipelight-0.0.1b5-py3-none-any.whl (25.6 kB view details)

Uploaded Python 3

File details

Details for the file pipelight-0.0.1b5.tar.gz.

File metadata

  • Download URL: pipelight-0.0.1b5.tar.gz
  • Upload date:
  • Size: 23.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.18

File hashes

Hashes for pipelight-0.0.1b5.tar.gz
Algorithm Hash digest
SHA256 31d3623c564d22eb67296f17264e6699ae5d2345926d2294cc1dca62f2da6929
MD5 a5d9cf4068f90666f71666215d9c38ec
BLAKE2b-256 66a0a60323337e3e88906ab03d09c47cfdd78e155fc15077e577b5d37b5725b4

See more details on using hashes here.

File details

Details for the file pipelight-0.0.1b5-py3-none-any.whl.

File metadata

  • Download URL: pipelight-0.0.1b5-py3-none-any.whl
  • Upload date:
  • Size: 25.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.18

File hashes

Hashes for pipelight-0.0.1b5-py3-none-any.whl
Algorithm Hash digest
SHA256 19a851a1056b965e0e4ce3e0fb0f74c945f78fe1a62d84ce37aaf64bce79c2cb
MD5 22a1cf462368ae6283be727108612608
BLAKE2b-256 ebf82725c5324e08ac7e2800385275fcc5640fc144011bd8713e282af65aadf5

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page