Skip to main content

ASCII-ART Data Analysis Pipeline Manager

Project description

pyleaf is the Python implementation of the Leaf system. The Leaf system is a pipeline (AKA data flow or data analysis protocol) management system that allows to design the pipeline as an ASCII-art diagram through a language called LGL (Leaf Graph Language, see https://github.com/franapoli/lglc).

Main Leaf features include:

  • Thin, lightweight, code-independent Abstraction Layer.
  • Data flow graph embedded directly into Python source code.
  • Automatic creation and management of variables associated with node outputs.
  • Automatic persistent storage and retrieval of node outputs.
  • Session persistence (i.e. run half project, reboot machine, automatically start again from the last processed node).
  • Lazy builds (avoid running nodes that are not necessary for the build of a requested resource).
  • Multiprocessing (independent nodes run in parallel).
  • Enforcement of code version consistency between nodes (i.e. automatically reprocess all nodes deriving from node A if node A is found to be changed).
  • Automatic time and space requirements statistics.
  • Automatic publishing (producing hypertext with visual representation of the protocol, processing statistics, link to node outputs, node documentation and source code).

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for pyleaf, version 1.0.1.1
Filename, size File type Python version Upload date Hashes
Filename, size pyleaf-1.0.1.1.tar.gz (756.7 kB) File type Source Python version None Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring DigiCert DigiCert EV certificate Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page