Utilities for expanding dask-jobqueue with appropriate settings for NCAR's clusters
Project description
Utilities for expanding dask-jobqueue with appropriate settings for NCAR’s clusters.
Supported clusters:
- Cheyenne
- Casper (DAV)
- CGD’s Hobart
Installation
ncar-jobqueue can be installed from PyPI with pip:
pip install ncar-jobqueue
Usage
Casper
>>> from ncar_jobqueue import NCARCluster >>> from dask.distributed import Client >>> cluster = NCARCluster() >>> cluster NCARCluster(cores=0, memory=0 B, workers=0/0, jobs=0/0) >>> cluster.scale(2) >>> cluster NCARCluster(cores=2, memory=50.00 GB, workers=2/2, jobs=2/2) >>> client = Client(cluster)
Cheyenne
>>> from ncar_jobqueue import NCARCluster >>> from dask.distributed import Client >>> cluster = NCARCluster() >>> cluster NCARCluster(cores=0, memory=0 B, workers=0/0, jobs=0/0) >>> cluster.scale(2) >>> cluster NCARCluster(cores=72, memory=218.00 GB, workers=2/2, jobs=2/2) >>> client = Client(cluster)
Hobart
>>> from ncar_jobqueue import NCARCluster >>> from dask.distributed import Client >>> cluster = NCARCluster() >>> cluster NCARCluster(cores=0, memory=0 B, workers=0/0, jobs=0/0) >>> cluster.scale(2) >>> cluster NCARCluster(cores=96, memory=192.00 GB, workers=2/2, jobs=2/2) >>> client = Client(cluster)
Release history Release notifications
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
| Filename, size | File type | Python version | Upload date | Hashes |
|---|---|---|---|---|
| Filename, size ncar_jobqueue-2019.10.16.1-py3-none-any.whl (10.1 kB) | File type Wheel | Python version py3 | Upload date | Hashes View hashes |
| Filename, size ncar-jobqueue-2019.10.16.1.tar.gz (9.9 kB) | File type Source | Python version None | Upload date | Hashes View hashes |
Close
Hashes for ncar_jobqueue-2019.10.16.1-py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 20876cf9bf7ac20362260e6c8ee081906865fb5376423e75d1c45749cc69e67b |
|
| MD5 | b4661a919b001ef7a749b05522a9af44 |
|
| BLAKE2-256 | a63529102889ac05b8488eccaf068551f7a71632070af758e422df560dadc564 |
Close
Hashes for ncar-jobqueue-2019.10.16.1.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 1ab97fee3bab3a735ebbe1df342b6301005c304fad937249bd450dd7a47db9bf |
|
| MD5 | 52a7208380f7e831c8f78b0c2d12e501 |
|
| BLAKE2-256 | 7b368e0cabe359ff6a7ff349fedbd6eab4e32f8c12f2225eb4fa458e99ec9d3d |
