In its highest aspirations, pytask tries to be pytest as a build system. It’s main purpose is to facilitate reproducible research by automating workflows in research projects. Its features include:
Automatic discovery of tasks.
Lazy evaluation. If a task, its dependencies, and its products have not changed, do not execute it.
Debug mode. Jump into the debugger if a task fails, get feedback quickly, and be more productive.
Select tasks via expressions. Run only a subset of tasks with expressions and marker expressions known from pytest.
Easily extensible with plugins. pytask’s architecture is based on pluggy, a plugin management framework, so that you can adjust pytask to your needs. Plugins are, for example, available for parallelization, LaTeX, R, and Stata. Read here how you can use plugins.
Installation
pytask is available on PyPI for Python >= 3.6.1 and on Anaconda.org for Python >= 3.7. Install the package with
$ pip install pytask
# or
$ conda install -c conda-forge pytaskColor support is automatically available on non-Windows platforms. On Windows, please, use Windows Terminal which can be, for example, installed via the Microsoft Store.
Usage
A task is a function which is detected if the module and the function name are prefixed with task_. Here is an example.
# Content of task_hello.py.
import pytask
@pytask.mark.produces("hello_earth.txt")
def task_hello_earth(produces):
produces.write_text("Hello, earth!")Here are some details:
Dependencies and products of a task are tracked via markers. For dependencies use @pytask.mark.depends_on and for products use @pytask.mark.produces. Use strings and pathlib.Path to specify the location. Pass multiple dependencies or products as a list or a dictionary for positional or key-based access.
With produces (and depends_on) as function arguments, you get access to the dependencies and products inside the function via pathlib.Path objects. Here, produces holds the path to "hello_earth.txt".
To execute the task, type the following command on the command-line
$ pytask
========================= Start pytask session =========================
Platform: linux -- Python 3.x.y, pytask 0.x.y, pluggy 0.x.y
Root: xxx
Collected 1 task(s).
.
====================== 1 succeeded in 1 second(s) ======================Demo
The demo walks you through the following steps.
Write an executable script which produces a text file like you would normally do without pytask.
Rewrite the script to a pytask task.
Execute the task.
Add a task which produces a second text file and another task which merges both text files.
Execute all three tasks.
Documentation
The documentation can be found under https://pytask-dev.readthedocs.io/en/latest with tutorials and guides for best practices.
Changes
Consult the release notes to find out about what is new.
License
pytask is distributed under the terms of the MIT license.
Acknowledgment
The license also includes a copyright and permission notice from pytest since some modules, classes, and functions are copied from pytest. Not to mention how pytest has inspired the development of pytask in general. Without the amazing work of Holger Krekel and pytest’s many contributors, this project would not have been possible. Thank you!
Citation
If you rely on pytask to manage your research project, please cite it with the following key to help others to discover the tool.
@Unpublished{Raabe2020,
Title = {A Python tool for managing scientific workflows.},
Author = {Tobias Raabe},
Year = {2020},
Url = {https://github.com/pytask-dev/pytask}
}1 maintainer
Metadata
1 maintainer
Release files for pytask 0.1.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| pytask-0.1.1.tar.gz | 66.5 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| pytask-0.1.1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 142.2 kB
Release files / pytask-0.1.1.tar.gz
| Download URL | pytask-0.1.1.tar.gz |
|---|---|
| Size | 66.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
090d466a7e6347e770b3a811b64b82995c22e6aa405fc3ebe231f242bad2aa9b
|
|
BLAKE2b-256 checksum How to use checksums |
d5ee08203a3bbf873ab0af0bb517fbfdadbd5e876255c6f3f9ccbfef72a4e1a2
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.2 importlib_metadata/4.6.4 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.2 CPython/3.9.6
|
Release files / pytask-0.1.1-py3-none-any.whl
| Download URL | pytask-0.1.1-py3-none-any.whl |
|---|---|
| Size | 75.7 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
c420b29cbcb5f8bf48807c869f62072a302fc7ac8f4eb608bb18177ff03a486d
|
|
BLAKE2b-256 checksum How to use checksums |
b3177e33f681199e99e07722c482250d75f851284329a669b20162e81655d508
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.2 importlib_metadata/4.6.4 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.2 CPython/3.9.6
|
