Fault tolerant analysis framework.
Project description
OKCompute
A framework to make analysis stages clear, self documenting, and fault tolerant.
See OKCompute Documentation for details.
Key Features
- Graph of dependencies - Can figure out minimum analysis for set of outputs, or diagnose missing inputs
- Minimum Boilerplate
- Human Readable Reports - Generates HTML documentation implicitly inferred from code and comprehensive reports of what occured during a run
- Support for Pandas dataframes with column validation
- Can specify optional fields or a fallback value if a required field is missing
- Full stack traces are logged in the run results if an exception occurs during analysis
- Supports checking for intermediary results to avoid rerunning slow analysis steps
- Makes writing unit tests extremely easy
TODO
- Make generated documentation prettier
- Better hashing of fields / metrics (avoid collisions based on string names)
- Add way of specifying a list fields with name determined by data (thread names) with sub keys
- Make helper functions to reduce boiler plate in saving / resuming from intermediary processing
- Make reports returned by prune functions more consistent
- Standardize config/input/output conventions
- Should allow metric input/output be dicts?
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
okcompute-1.0.1.tar.gz
(10.0 kB
view hashes)
Built Distributions
okcompute-1.0.1-py3-none-any.whl
(11.0 kB
view hashes)
okcompute-1.0.1-py2-none-any.whl
(11.0 kB
view hashes)
Close
Hashes for okcompute-1.0.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 916533f5f87bb51a120d3886301cc2c1b327a6be3d5f13546fc4c888e85175c4 |
|
MD5 | 65fdc8abe4d5c798b9062298ba9a2d44 |
|
BLAKE2b-256 | 5ab0032dc9a7ab5c4e5abb45b59ce3b12445b0c04245c0d70b5b2e2238730f9b |
Close
Hashes for okcompute-1.0.1-py2-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 741265731971fc935a3cdaa2eca4f1073488fd5c9f96720a1e05f026fc9f4913 |
|
MD5 | 09f1ae76d61732532d6c1db5c9b4e71f |
|
BLAKE2b-256 | 18bb8fe424fd84723ee4bc792a89f611ee8c8f1793129527353a2491af0bd88a |