Skip to main content

This is a pipeline that is driven by configuration files for model running based on PyTorch Lightning.

Project description

Pipelight: The Easiest Pipeline for Training, Validation and Test Based on PyTorch Lightning

License: MIT Python Version PyTorch Version PyTorch Lightning Version

Pipelight is a pipeline that is driven by configuration files for model running based on PyTorch Lightning.

Key Features

  • Reproducible Pipelines: Built-in experiment tracking and deterministic training
  • Configuration-Driven Workflows: Define experiments through YAML configs with PyTorch Lightning integration

Installation

pip install pipelight

Quick Start

Configuration-Based Execution

Copy pipelight/configs as a template to the project folder, and enter this folder. All YAML files can be modified to meet the task requirements.

For training and validation, just run:

python -m pipelight.run --train configs/train.yaml --val configs/val.yaml -m {model config} -r configs/running/runner.yaml -n experiment_01

After that, run the following to test:

python -m pipelight.run --test configs/test.yaml -m {model config} -r configs/running/runner.yaml -n experiment_01

Make sure the name of the experiment should be kept the same.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pipelight-0.0.1b4.tar.gz (22.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pipelight-0.0.1b4-py3-none-any.whl (23.9 kB view details)

Uploaded Python 3

File details

Details for the file pipelight-0.0.1b4.tar.gz.

File metadata

  • Download URL: pipelight-0.0.1b4.tar.gz
  • Upload date:
  • Size: 22.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.0

File hashes

Hashes for pipelight-0.0.1b4.tar.gz
Algorithm Hash digest
SHA256 a255da2068c3896a72d09451ebb2ea958221e444120ceb19e4d3aa5d4851e349
MD5 af57e9b3c43310aae2c9ab801efc5713
BLAKE2b-256 ffef65543df9270418b05c4f6778d740091b48fb095ea6d6b310677bf628455f

See more details on using hashes here.

File details

Details for the file pipelight-0.0.1b4-py3-none-any.whl.

File metadata

  • Download URL: pipelight-0.0.1b4-py3-none-any.whl
  • Upload date:
  • Size: 23.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.0

File hashes

Hashes for pipelight-0.0.1b4-py3-none-any.whl
Algorithm Hash digest
SHA256 5f616e2d4e3ef0026d47811c7412e91883d363c318207ac91457c14fcabae5fa
MD5 f3afead7f0be9574a41c4455968e3672
BLAKE2b-256 b0d52132ad489009cc9fde9f3aa845250357144f72509a54c6c62f8db7facdc4

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page