Skip to main content

Dynamic Pipeline

PyPI Latest Release Github Issues License Last Commit Python Version

Author: Tony Dong

Dynamic Pipeline is a high-level API toolkit to help data scientists building models in ensemble way, and automating Machine Learning workflow with simple codes.

Comparing other popular "AutoML or Automatic Machine Learning" APIs, Dynamic Pipeline is designed as an omni-ensembled ML workflow optimizer with higher-level API targeting to avoid manual repetitive train-along-evaluate experiments in general pipeline building.

To achieve that, Dynamic Pipeline applies Pipeline Cluster Traversal Experiments algorithm to assemble all cross-matching pipelines covering major tasks of Machine Learning workflow, and apply traversal-experiment to search the optimal model. Besides, by modularizing all key pipeline components in reuseable packages, it allows all components to be custom tunable along with high scalability.

The core concept in Dynamic Pipeline is Pipeline Cluster Traversal Experiments, which is a theory, first raised by Tony Dong during Genpact 2020 GVector Conference, to optimize and automate Machine Learning Workflow using ensemble pipelines algorithm.

Comparing other automatic or classic machine learning workflow's repetitive experiments using single pipeline, Pipeline Cluster Traversal Experiments is more powerful, with larger coverage scope, to find the best model without manual intervention, and also more flexible with elasticity to cope with unseen data due to its ensemble designs in each component.

Documentation: https://dynamic-pipeline.readthedocs.io/

Installation

pip install dynapipe

License:

MIT 漏Tony Dong

Metadata

Release files for dynapipe 0.2.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for dynapipe 0.2.3
File Size Uploaded
dynapipe-0.2.3.tar.gz 19.4 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for dynapipe 0.2.3
File Interpreter ABI Platform
dynapipe-0.2.3-py3-none-any.whl Python 3 none any Details

Total release size: 42.9 kB

Release files / dynapipe-0.2.3.tar.gz

Download URL dynapipe-0.2.3.tar.gz
Size 19.4 kB
Tags Source
SHA-256 checksum
How to use checksums
b384a7f760d1ae635a9458b9624e5904a7946c3fa53fbd004d9a9141307fb8cc
BLAKE2b-256 checksum
How to use checksums
b6149311e05e9783314235c04406bde4806b2edf077f1b925f06de0c371efa7f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/49.2.0 requests-toolbelt/0.9.1 tqdm/4.48.0 CPython/3.8.4

Release files / dynapipe-0.2.3-py3-none-any.whl

Download URL dynapipe-0.2.3-py3-none-any.whl
Size 23.6 kB
Tags Python 3
SHA-256 checksum
How to use checksums
0ececbe2c4baa878930e14b32e5f1e0bec312e97e3ef0f800b34d9a417c0c2b2
BLAKE2b-256 checksum
How to use checksums
14286dd669c08a1fa8ec62d660c73b49666673b6ac0215244f49395c9411c201
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/49.2.0 requests-toolbelt/0.9.1 tqdm/4.48.0 CPython/3.8.4

Release history Release notifications | RSS feed

This release

0.2.3 This release

2 release files

0.2.2

2 release files

0.2.1

2 release files

0.2.0

2 release files

0.1.3

2 release files

0.0.12

2 release files

0.0.8

2 release files

0.0.7

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page