Skip to main content

ClusterWeb, a distributed system API for SSH and PBS systems

Project description

![alt text](./docs/source/images/logo_color.png?raw=true "Icon")

# ClusterWeb: Distributed System Python API

ClusterWeb is a Python library for creating compute clusters out of any devices that use SSH.

#### Documentation: <https://cluster-web.readthedocs.io/en/latest/>

### Compatiable Devices

- CPUs nodes
- Desktops
- GPUs workstations
- Laptops
- Raspberry Pi
- Android phones


### Requirements

- Python 3.6 or above
- SSH
- Linux or OSX
- pickle
- cloudpickle (host machine)


### Basic Usage:

```python
from clusterweb.pbs.qsub import Qsub
import time

def job(arg):
a,b = 0,1
for _ in range(int(arg)):
a,b = b,a+b
return a

q = Qsub(job,1e5)
q.push()
q.pull(thread=False)

print(q.result)
```


Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

clusterweb-0.0.0.2.tar.gz (15.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

clusterweb-0.0.0.2-py3-none-any.whl (22.2 kB view details)

Uploaded Python 3

File details

Details for the file clusterweb-0.0.0.2.tar.gz.

File metadata

  • Download URL: clusterweb-0.0.0.2.tar.gz
  • Upload date:
  • Size: 15.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.19.1 setuptools/39.1.0 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.6.7

File hashes

Hashes for clusterweb-0.0.0.2.tar.gz
Algorithm Hash digest
SHA256 b27ea4857e65f7af75b41e2a7224e75969b2202fe5877560e224c7e2a826972d
MD5 77d07497cb8d29c85a7c9305680e5dd6
BLAKE2b-256 46ebe013cc1d4ebbd5c7a3bef575b66a0c83e0a5d1240fbe92b0254d4a3afe36

See more details on using hashes here.

File details

Details for the file clusterweb-0.0.0.2-py3-none-any.whl.

File metadata

  • Download URL: clusterweb-0.0.0.2-py3-none-any.whl
  • Upload date:
  • Size: 22.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.19.1 setuptools/39.1.0 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.6.7

File hashes

Hashes for clusterweb-0.0.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 0f439a640af813b813cdbf21322d845cb9dd3cf0f7902f6424721b6ad0cc0879
MD5 1a500178155d46aed41a74cd06e352bf
BLAKE2b-256 d30d39fca827237318140ba6dfa3764fe18d5f65df1b9df3a1e36105b06cda56

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page