Skip to main content

Essential components of Script of Scripts (SoS)

Project description

Computationally intensive disciplines such as computational biology often requires one to exploit a variety of tools implemented in different programming languages, and to analyze large datasets on high performance computing systems. Although scientific workflow systems are powerful in organizing and executing large-scale data analysis processes, there are usually non-trivial learning curve and engineering overhead in creating and maintaining such workflows, making them unsuitable for data exploration and prototyping. To bridge the gap between interactive analysis and workflow systems, we developed Script of Scripts (SoS), a system with strong emphases on readability, practicality, and reproducibility for daily computational research. For exploratory analysis SoS provides a multi-language file format and scripting engine that centralizes all computations, and creates dynamic report documents for publishing and sharing. As a workflow engine, SoS provides an intuitive syntax to create workflows in process-oriented, outcome-oriented and mixed styles, as well as a unified interface to executing and managing tasks on a variety of computing platforms with automatic synchronization of files between isolated systems. In this paper we illustrate with real-world examples the use of SoS as both interactive analysis tool and pipeline platform for all stages of methods development and data analysis projects. In particular we demonstrate how SoS can easily be adopted based on existing scripts and pipelines, yet resulting in substantial improvement in terms of organization, readability and cross-platform computation management.

Please refer to http://vatlab.github.io/SOS/ for more details on SoS.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sos-essentials-0.9.9.3.tar.gz (2.8 kB view details)

Uploaded Source

Built Distribution

sos_essentials-0.9.9.3-py3-none-any.whl (4.2 kB view details)

Uploaded Python 3

File details

Details for the file sos-essentials-0.9.9.3.tar.gz.

File metadata

File hashes

Hashes for sos-essentials-0.9.9.3.tar.gz
Algorithm Hash digest
SHA256 a8939ecac8017988192bd5b72074b53b2d4dc2f8d2e69e263d634d879ed97529
MD5 807f8ed5f0b890e8929f2262b97c8c58
BLAKE2b-256 c99b42562f5b42497f8de7a6d4b011859fb0ba12e28ae0ce4782735ba76f300d

See more details on using hashes here.

File details

Details for the file sos_essentials-0.9.9.3-py3-none-any.whl.

File metadata

File hashes

Hashes for sos_essentials-0.9.9.3-py3-none-any.whl
Algorithm Hash digest
SHA256 3c74bef3f987994e9295e6010429a2839ba2cdbf64cfa58610d2d98058a492a8
MD5 9fabeabc202c28d563444e49be71c9b5
BLAKE2b-256 827668fa22325f99ceac28ecc687ede16160e1079fcebdf4ca9cb66e87bc346b

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page