Process shell commands over a distributed, asynchronous queue.
Project description
HyperShell is an elegant, cross-platform, high-performance computing utility for processing shell commands over a distributed, asynchronous queue. It is a highly scalable workflow automation tool for many-task scenarios.
There are several existing tools that serve a similar purpose, but lack some aspect that HyperShell provides (e.g., distributed, detailed logging, automated retries, super scale). Novel aspects of HyperShell include but are not limited to (1) cross-platform, (2) client-server design, (3) staggered launch for large scales, (4) persistent hosting of the server, and optionally (5) a database in-the-loop for restarts and persisting task metadata.
HyperShell is pure Python and has been tested on Linux, macOS, and Windows 10 in Python 3.9 environments. The server and clients don’t even need to use the same platform.
Installation
To install hyper-shell:
$ pip install hyper-shell
Documentation
Documentation is available at hyper-shell.readthedocs.io. For basic usage information on the command line use: hyper-shell --help. For a more comprehensive usage guide on the command line you can view the manual page with man hyper-shell.
Contributions
Contributions are welcome in the form of suggestions for additional features, pull requests with new features or bug fixes, etc. If you find bugs or have questions, open an Issue here. If and when the project grows, a code of conduct will be provided along side a more comprehensive set of guidelines for contributing; until then, just be nice.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for hyper_shell-2.0.0b8-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 43e32af0acce3e8a6a3e8552df3668b6ce17744d842cc868413314a8572d8e01 |
|
MD5 | 974d8a94fe8773da7411e7e0159acf66 |
|
BLAKE2b-256 | 5038f65522f46fda05a74d33ac8e69aedca0b7bbb6761163975f6cec142ac491 |