Skip to main content

ASCII-ART Data Analysis Pipeline Manager

Project description

pyleaf is the Python implementation of the Leaf system. The Leaf system is a pipeline (AKA data flow or data analysis protocol) management system that allows to design the pipeline as an ASCII-art diagram through a language called LGL (Leaf Graph Language, see https://github.com/franapoli/lglc).

Main Leaf features include:

  • Thin, lightweight, code-independent Abstraction Layer.
  • Data flow graph embedded directly into Python source code.
  • Automatic creation and management of variables associated with node outputs.
  • Automatic persistent storage and retrieval of node outputs.
  • Session persistence (i.e. run half project, reboot machine, automatically start again from the last processed node).
  • Lazy builds (avoid running nodes that are not necessary for the build of a requested resource).
  • Multiprocessing (independent nodes run in parallel).
  • Enforcement of code version consistency between nodes (i.e. automatically reprocess all nodes deriving from node A if node A is found to be changed).
  • Automatic time and space requirements statistics.
  • Automatic publishing (producing hypertext with visual representation of the protocol, processing statistics, link to node outputs, node documentation and source code).

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
pyleaf-1.0.1.1.tar.gz (756.7 kB) Copy SHA256 hash SHA256 Source None Dec 28, 2013

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page