pyleaf 1.0.1.1

ASCII-ART Data Analysis Pipeline Manager

pyleaf is the Python implementation of the Leaf system. The Leaf system is a pipeline (AKA data flow or data analysis protocol) management system that allows to design the pipeline as an ASCII-art diagram through a language called LGL (Leaf Graph Language, see https://github.com/franapoli/lglc).

Main Leaf features include:

• Thin, lightweight, code-independent Abstraction Layer.
• Data flow graph embedded directly into Python source code.
• Automatic creation and management of variables associated with node outputs.
• Automatic persistent storage and retrieval of node outputs.
• Session persistence (i.e. run half project, reboot machine, automatically start again from the last processed node).
• Lazy builds (avoid running nodes that are not necessary for the build of a requested resource).
• Multiprocessing (independent nodes run in parallel).
• Enforcement of code version consistency between nodes (i.e. automatically reprocess all nodes deriving from node A if node A is found to be changed).
• Automatic time and space requirements statistics.
• Automatic publishing (producing hypertext with visual representation of the protocol, processing statistics, link to node outputs, node documentation and source code).