yadage - yaml based adage
This package reads and executes workflows adhering to the workflow JSON schemas defined at https://github.com/yadage/yadage-schemas such as the ones stored in the community repository https://github.com/yadage/yadage-workflows. For executing the individual steps it mainly uses the packtivity python bindings provided by https://github.com/yadage/packtivity.
Example Workflow
cat << 'EOF' > workflow.yml
stages:
- name: hello_world
dependencies: [init]
scheduler:
scheduler_type: singlestep-stage
parameters:
name: {step: init, output: name}
outputfile: '{workdir}/hello_world.txt'
step:
process:
process_type: 'string-interpolated-cmd'
cmd: 'echo Hello my Name is {name} | tee {outputfile}'
publisher:
publisher_type: 'frompar-pub'
outputmap:
outputfile: outputfile
environment:
environment_type: 'docker-encapsulated'
image: busybox
EOF
You can try this workflow via
yadage-run -p name="John Doe"
For more thorough examples, please see the documentation
Possible Backends:
Yadage can run on various backends such as multiprocessing pools, ipython clusters, or celery clusters. If human intervention is needed for certain steps, it can also be run interactively.
Published versions of related packages (main dependencies of yadage)
| package | version |
|---|---|
| packtivity |  |
| yadage-schemas |  |
| adage |  |
2 maintainers
Metadata
2 maintainers
Release files for yadage 0.21.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| yadage-0.21.0.tar.gz | 138.2 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| yadage-0.21.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 190.3 kB
Release files / yadage-0.21.0.tar.gz
| Download URL | yadage-0.21.0.tar.gz |
|---|---|
| Size | 138.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
578edfec61813b144700c54eddb2eb7c31a7a0968018d3d2192c7acf45566760
|
|
BLAKE2b-256 checksum How to use checksums |
680ac8853540a96f1ecd12daca05821ad0073413215e960085490b31f9e073cd
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.11.5
|
Release files / yadage-0.21.0-py3-none-any.whl
| Download URL | yadage-0.21.0-py3-none-any.whl |
|---|---|
| Size | 52.1 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
21e23a285f9c1cf00bb67c2d48cb136566ecfaaa548eb5964776d30ce60fef5c
|
|
BLAKE2b-256 checksum How to use checksums |
559c4078d4628aad03703d9b9feca3e2b8709de41dd96fc3992956cfc5b476fc
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.11.5
|
