Skip to main content

WOrkflow DEfinitions

Project description

npm version License: Apache

wode

WOrkflow DEfinitions - houses the definitions for:

  • Workflow - a workflow to be executed
  • Subworkflow - a logical collection of units of work defined by a unique Applidation, and Model
  • Units - one of the following:
    • AssertionUnit - assert an expression
    • AssignmentUnit - assign a value
    • ConditionUnit - evaluate a condition
    • IOUnit - Read or write data
    • ExecutionUnit - execute an ADe Application
    • MapUnit - create a dynamic number of units based on output of a previous unit
    • ReduceUnit - collect the results of a fanned out operation

Workflow configurations are processed at build time using build_workflows.js and compiled into a single JS file so that workflow configurations can be accessed in the browser runtime, not just in a NodeJS process.

The relevant data parameterizing supported entities is housed in the Standata repository.

Installation

For usage within a JavaScript project:

npm install @mat3ra/wode

For development:

git clone https://github.com/Exabyte-io/wode.git

Contributions

This repository is an open-source work-in-progress and we welcome contributions.

We regularly deploy the latest code containing all accepted contributions online as part of the Mat3ra.com platform, so contributors will see their code in action there.

See ESSE for additional context regarding the data schemas used here.

Useful commands for development:

# run linter without persistence
npm run lint

# run linter and save edits
npm run lint:fix

# compile the library
npm run transpile

# run tests
npm run test

Using Linter

Linter setup will prevent committing files that don't adhere to the code standard. It will attempt to fix what it can automatically prior to the commit in order to reduce diff noise. This can lead to "unexpected" behavior where a file that is staged for commit is not identical to the file that actually gets committed. This happens in the lint-staged directive of the package.json file (by using a husky pre-commit hook). For example, if you add extra whitespace to a file, stage it, and try to commit it, you will see the following:

  repo-js git:(feature/cool-feature)  git commit -m "Awesome feature works great" Preparing...
✔ Running tasks...
✖ Prevented an empty git commit!
✔ Reverting to original state because of errors...
✔ Cleaning up...

   lint-staged prevented an empty git commit.
  Use the --allow-empty option to continue, or check your task configuration

husky - pre-commit hook exited with code 1 (error)

The staged change may remain but will not have been committed. Then it will look like you still have a staged change to commit, but the pre-commit hook will not actually commit it for you, quite frustrating! Styling can be applied manually and fixed by running:

npm run lint:fix

In which case, you may need to then add the linter edits to your staging, which in the example above, puts the file back to identical with the base branch, resulting in no staged changes whatsoever.

Other

Workflow Spec

Workflows defined as configuration conform to the following specification:

  • Workflow: Object - The workflow configuration itself
    • name: String - a human readable name describing the functionality of the workflow
    • units: Array - a list of workflow units where each unit takes the following shape Not == Unit
      • name: String - the snake_case name of a subworkflow or another workflow that must exist
      • config: Optional[Object] - see Config defined below
      • type: String - one of:
        • subworkflow|workflow
          • Note: workflow units may specify mapUnit: true in their config
      • units: Optional[Array] - if type == workflow see above (recursively defined)
    • config: Optional[Object] - see Config defined below
  • Subworkflow: Object - a logical collection of workflow units
    • application: Object - an application specification
      • name: String - an application name recognized by ADe
      • version: Optional[String] - (often a semver) application version string supported by ADe
      • build: Optional[String] - application build string supported by ADe
    • method: Object - a method specification
      • name: String - a named method class exported from MeDe
      • config: Optional[Object] - see Config defined below
    • model: Object - a model specification
      • name: String - a named model class exported from MeDe
      • config: Optional[Object] - see Config defined below
    • config: Optional[Object] - see Config defined below
    • units: Array - a list of subworkflow units where each unit is a Unit defined below
  • Unit: Object - a unit of computational work in a workflow
    • type: String - one of:
      • execution|assignment|condition|io|processing|map|subworkflow|assertion
        • Note: optionally may have Builder appended to type to use unit builders instead of units directly
          • executionBuilder is the primary use case for this
    • config: Object - arguments to pass to constructor based on type
    • functions: Object - similar to Config.functions defined below
      • in the case of builders, functions are applied before calling build
    • attributes: Object - similar to Config.attributes defined below
      • in the case of builders, attributes are applied after calling build
  • Config: Object - custom configuration to apply to an entity
    • Note: functions and attributes may not be supported for all entities, please check the implementation
    • functions: Object - collection of functions defined on the entity to run
      • [key]: {{functionName}}: String - name of function to run
      • [value]: {{args}}: Any - arguments matching the call signature
    • attributes: Object - collection of attributes to assign to the entity on creation
      • [key]: {{attributeName}}: String - name of function to run
      • [value]: {{value}}: Any - value to assign to attribute
    • [key]: {{constructorArgument}}: String - parameter passed to constructor
    • [value]: {{constructorValue}}: Any - value for a given constructor parameter

Workflow Creation

The Workflow instances associated with the workflow configurations are built by the createWorkflows function traversing all three levels (workflow, subworkflow, unit): Workflow Generation Diagram

Links

  1. Workflows explained in Mat3ra documentation: https://docs.mat3ra.com/workflows/overview/

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mat3ra_wode-2025.11.26.post0.tar.gz (156.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

mat3ra_wode-2025.11.26.post0-py3-none-any.whl (5.5 kB view details)

Uploaded Python 3

File details

Details for the file mat3ra_wode-2025.11.26.post0.tar.gz.

File metadata

  • Download URL: mat3ra_wode-2025.11.26.post0.tar.gz
  • Upload date:
  • Size: 156.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/8.7.0 pkginfo/1.12.1.2 requests/2.32.5 requests-toolbelt/1.0.0 tqdm/4.67.1 CPython/3.10.13

File hashes

Hashes for mat3ra_wode-2025.11.26.post0.tar.gz
Algorithm Hash digest
SHA256 56d722e5d83a5a87ee9f0dd5bf588c3523a7c324a9ad95a32e44182f18bc9ea7
MD5 2521b87ead402788a400378ac4f5800a
BLAKE2b-256 f2a74aca4fdde34c9f47f64d5891b56d36b57de83c0bae2c128e180844af9072

See more details on using hashes here.

File details

Details for the file mat3ra_wode-2025.11.26.post0-py3-none-any.whl.

File metadata

  • Download URL: mat3ra_wode-2025.11.26.post0-py3-none-any.whl
  • Upload date:
  • Size: 5.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/8.7.0 pkginfo/1.12.1.2 requests/2.32.5 requests-toolbelt/1.0.0 tqdm/4.67.1 CPython/3.10.13

File hashes

Hashes for mat3ra_wode-2025.11.26.post0-py3-none-any.whl
Algorithm Hash digest
SHA256 0855924a83802a821051bae678fb88137ecbcb37908e00537988ff6ff3abf284
MD5 3d0986f5b5837be509f5429476ed548c
BLAKE2b-256 e4e24d48efd990478de60680f87c2b5ed5518a25054cf25fd8d501e842c57ed6

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page