Skip to main content

Fault tolerant analysis framework.

Project description

OKCompute

A framework to make analysis stages clear, self documenting, and fault tolerant.

See OKCompute Documentation for details.

Key Features

  • Graph of dependencies - Can figure out minimum analysis for set of outputs, or diagnose missing inputs
  • Minimum Boilerplate
  • Human Readable Reports - Generates HTML documentation implicitly inferred from code and comprehensive reports of what occured during a run
  • Support for Pandas dataframes with column validation
  • Can specify optional fields or a fallback value if a required field is missing
  • Full stack traces are logged in the run results if an exception occurs during analysis
  • Supports checking for intermediary results to avoid rerunning slow analysis steps
  • Makes writing unit tests extremely easy

TODO

  • Make generated documentation prettier
  • Better hashing of fields / metrics (avoid collisions based on string names)
  • Add way of specifying a list fields with name determined by data (thread names) with sub keys
  • Make helper functions to reduce boiler plate in saving / resuming from intermediary processing
  • Make reports returned by prune functions more consistent
  • Standardize config/input/output conventions
  • Should allow metric input/output be dicts?

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for okcompute, version 1.0.1
Filename, size File type Python version Upload date Hashes
Filename, size okcompute-1.0.1-py2-none-any.whl (11.0 kB) File type Wheel Python version py2 Upload date Hashes View
Filename, size okcompute-1.0.1-py3-none-any.whl (11.0 kB) File type Wheel Python version py3 Upload date Hashes View
Filename, size okcompute-1.0.1.tar.gz (10.0 kB) File type Source Python version None Upload date Hashes View

Supported by

Pingdom Pingdom Monitoring Google Google Object Storage and Download Analytics Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page