taskchain 1.4.0

Utility for running data and ML pipelines

TaskChain

Documentation

Install

pip install taskchain

From source

git clone https://github.com/flowerchecker/taskchain
cd taskchain
poetry install

Changelog

unpublished

• allow to define multiple input task using regexp

1.2.1

• fixes

1.2.0

• remove redundant module taskchain.task
• add support for task exclusion, just use exluded_tasks in your config
• add tools for testing, check taskchain.utils.testing
• finish documentation
• remove some redundant methods

1.1.1

• improve chain representation in jupyter
• add tasks_df parameter to chains
• add support for uses in contexts (same syntax as in configs)
• improve create_readable_filenames
  • use config name as default name
  • better verbose mode
• force method of both Chain and Task now supports delete_data parameter which delete persisted data
  • it defaults to False
  • be careful with this
• add Makefile

1.1.0

• release to PIP

1.0.3

• more types can be used for run method, e.g. dict or Dict[str, int]
• forbid some names of parameters with special meaning in configs (uses, tasks, ...)
• you should import from taskchain instead of taskchain.taks, later is deprecated and will be removed
  • use from taskchain import Task, Config, Chain or import taskchain as tc; tc.Task
• MultiChain are now more robust, you can use them with configs with context, and it will work correctly

Development

Release new version to PIP

make version-patch
# OR
make version-minor

make publish

Develop docs

run server which dynamically serves docs web.

make docs-develop

Build docs

Create documentation as static files.

make docs-build

Build docs

Builds documentation and deploys it to GitHub Pages

make make docs-publish