Common workflow language testing framework
This is a testing tool for checking the output of Tools and Workflows described with the Common Workflow Language. Among other uses, it is used to run the CWL conformance tests.
This is written and tested for Python 2.7, 3.4, 3.5, 3.6, and 3.7
Install
Installing the official package from PyPi:
pip install cwltest
Or from source:
git clone https://github.com/common-workflow-language/cwltest.git cd cwltest && python setup.py install
Run on the command line
Simple command:
cwltest --test test-descriptions.yml --tool cwl-runner
Generate conformance badges using cwltest
To make badges that show the results of the conformance test, you can generate JSON files for https://badgen.net by using –badgedir option
To generate JSON files:
cwltest --test test-descriptions.yml --tool cwl-runner --badgedir badges
...
$ cat badges/command_line_tool.json | jq .
{
"subject": "[CWL] command_line_tool",
"status": "100%",
"color": "green"
}
Once you upload JSON file to a server, you make a badge by using a link like https://flat.badgen.net/https/path/to/generated/json.
Here is an example of markdown to add a badge:

Metadata
Release files for cwltest 1.0.20190228134645
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| cwltest-1.0.20190228134645.tar.gz | 14.4 kB | Details |
Built distributions (wheels)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| cwltest-1.0.20190228134645-py3-none-any.whl | Python 3 | none | any | Details |
| cwltest-1.0.20190228134645-py2-none-any.whl | Python 2 | none | any | Details |
Total release size: 53.5 kB
Release files / cwltest-1.0.20190228134645.tar.gz
| Download URL | cwltest-1.0.20190228134645.tar.gz |
|---|---|
| Size | 14.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
317a917d0ed18e5db9dab1069f32222625e350b35d53f36b5b7430538006eadb
|
|
BLAKE2b-256 checksum How to use checksums |
297e66638bd34bbd4d52c2da43e0f4dca07ff41b51e1bfd0efe38985a4fb8308
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/2.7.15+
|
Release files / cwltest-1.0.20190228134645-py3-none-any.whl
| Download URL | cwltest-1.0.20190228134645-py3-none-any.whl |
|---|---|
| Size | 19.6 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
65879dd264dd8563643c717a01c9e2191295cf97ca861832a62dd168a48841e0
|
|
BLAKE2b-256 checksum How to use checksums |
42ce5821cb6e38d5e8013e374952e4279c1a971ed5e88ac82d7515551b313372
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/2.7.15+
|
Release files / cwltest-1.0.20190228134645-py2-none-any.whl
| Download URL | cwltest-1.0.20190228134645-py2-none-any.whl |
|---|---|
| Size | 19.6 kB |
| Tags | Python 2 |
|
SHA-256 checksum How to use checksums |
1335f26f3bfa8be52f517c8a28a38e5f5527e80e40d1aeb3944d3c8e47e2a749
|
|
BLAKE2b-256 checksum How to use checksums |
26f16bd8cb6f288955b28d3e2647e1ece14df89162067a3cfcbd66771756af55
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/2.7.15+
|