Utility for running data and ML pipelines
Project description
TaskChain
Install
pip install taskchain
From source
git clone https://github.com/flowerchecker/taskchain
cd taskchain
poetry install
Changelog
unpublished
- allow to define multiple input task using regexp
1.2.1
- fixes
1.2.0
- remove redundant module
taskchain.task
- add support for task exclusion, just use
exluded_tasks
in your config - add tools for testing, check
taskchain.utils.testing
- finish documentation
- remove some redundant methods
1.1.1
- improve chain representation in jupyter
- add
tasks_df
parameter to chains - add support for
uses
in contexts (same syntax as in configs) - improve create_readable_filenames
- use config name as default name
- better verbose mode
force
method of both Chain and Task now supportsdelete_data
parameter which delete persisted data- it defaults to
False
- be careful with this
- it defaults to
- add Makefile
1.1.0
- release to PIP
1.0.3
- more types can be used for
run
method, e.g.dict
orDict[str, int]
- forbid some names of parameters with special meaning in configs (
uses
,tasks
, ...) - you should import from
taskchain
instead oftaskchain.taks
, later is deprecated and will be removed- use
from taskchain import Task, Config, Chain
orimport taskchain as tc; tc.Task
- use
- MultiChain are now more robust, you can use them with configs with context, and it will work correctly
Development
Release new version to PIP
make version-patch
# OR
make version-minor
make publish
Develop docs
run server which dynamically serves docs web.
make docs-develop
Build docs
Create documentation as static files.
make docs-build
Build docs
Builds documentation and deploys it to GitHub Pages
make make docs-publish
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
taskchain-1.4.0.tar.gz
(31.2 kB
view hashes)
Built Distribution
taskchain-1.4.0-py3-none-any.whl
(36.5 kB
view hashes)
Close
Hashes for taskchain-1.4.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 31c5cac4e231e0220b116561568416653c45f3619d3be64fdc55ee2a352de6c1 |
|
MD5 | 9cbcc858d7bb2babff5ee2fb5cb1aa66 |
|
BLAKE2b-256 | df1f64819ffc9740383179c8abe7efa5e331aab821ae39858d545e089e05e547 |