Utilities for expanding dask-jobqueue with appropriate settings for NCAR's clusters
Project description
Utilities for expanding dask-jobqueue with appropriate settings for NCAR’s clusters.
Supported clusters:
Cheyenne
Casper (DAV)
CGD’s Hobart
Installation
ncar-jobqueue can be installed from PyPI with pip:
pip install ncar-jobqueueUsage
Casper
>>> from ncar_jobqueue import NCARCluster
>>> from dask.distributed import Client
>>> cluster = NCARCluster()
>>> cluster
NCARCluster(cores=0, memory=0 B, workers=0/0, jobs=0/0)
>>> cluster.scale(2)
>>> cluster
NCARCluster(cores=2, memory=50.00 GB, workers=2/2, jobs=2/2)
>>> client = Client(cluster)Cheyenne
>>> from ncar_jobqueue import NCARCluster
>>> from dask.distributed import Client
>>> cluster = NCARCluster()
>>> cluster
NCARCluster(cores=0, memory=0 B, workers=0/0, jobs=0/0)
>>> cluster.scale(2)
>>> cluster
NCARCluster(cores=72, memory=218.00 GB, workers=2/2, jobs=2/2)
>>> client = Client(cluster)Hobart
>>> from ncar_jobqueue import NCARCluster
>>> from dask.distributed import Client
>>> cluster = NCARCluster()
>>> cluster
NCARCluster(cores=0, memory=0 B, workers=0/0, jobs=0/0)
>>> cluster.scale(2)
>>> cluster
NCARCluster(cores=96, memory=192.00 GB, workers=2/2, jobs=2/2)
>>> client = Client(cluster)Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file ncar-jobqueue-2019.10.16.1.tar.gz.
File metadata
- Download URL: ncar-jobqueue-2019.10.16.1.tar.gz
- Upload date:
- Size: 9.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.32.2 CPython/3.7.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 1ab97fee3bab3a735ebbe1df342b6301005c304fad937249bd450dd7a47db9bf |
|
| MD5 | 52a7208380f7e831c8f78b0c2d12e501 |
|
| BLAKE2b-256 | 7b368e0cabe359ff6a7ff349fedbd6eab4e32f8c12f2225eb4fa458e99ec9d3d |
File details
Details for the file ncar_jobqueue-2019.10.16.1-py3-none-any.whl.
File metadata
- Download URL: ncar_jobqueue-2019.10.16.1-py3-none-any.whl
- Upload date:
- Size: 10.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.32.2 CPython/3.7.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 20876cf9bf7ac20362260e6c8ee081906865fb5376423e75d1c45749cc69e67b |
|
| MD5 | b4661a919b001ef7a749b05522a9af44 |
|
| BLAKE2b-256 | a63529102889ac05b8488eccaf068551f7a71632070af758e422df560dadc564 |
