This release is a pre-release and may not be stable for production use.
Gen2-connector enables Ray cluster to be deployed over IBM Gen2 infrastructure
Use of python virtual environment, e.g. virtualenv is greatly encouraged, to avoid installing Python packages globally which could break system tools or other projects
- Install gen2-connector on your machine
pip install gen2-connector
-
Configure ibm vpc
-
Create/Update security group to have SSH, Redis and Ray Dashboard ports open: 22, 8265 and 6379
-
Create cluster config file
- Use interactive
ibm-ray-configconfig tool to generate cluster.yaml configuration file
pip install ibm-ray-config ibm-ray-config -o cluster.yaml - Use interactive
-
Use generated file to bring ray cluster up, e.g
ray up cluster.yaml
- After finished, find cluster head node and worker nodes ips:
ray get-head-ip cluster.yaml
ray get-worker-ips cluster.yaml
- To get status of the cluster
ray status --address PUBLIC_HEAD_IP:6379
-
Use browser to open ray dashboard on PUBLIC_HEAD_IP:8265. Alternatively use
ray dashboardto forward ray cluster dashboard to your localhost. -
Submit example task
ray submit cluster.yaml templates/example.py
3 maintainers
Release files for gen2-connector 1.0.0b67
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| gen2-connector-1.0.0b67.tar.gz | 17.3 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| gen2_connector-1.0.0b67-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 35.7 kB
Release files / gen2-connector-1.0.0b67.tar.gz
| Download URL | gen2-connector-1.0.0b67.tar.gz |
|---|---|
| Size | 17.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
146716d87f8174e2afa1cbfdf3f64dce4a529a431be9893e29cb91b8234dfd97
|
|
BLAKE2b-256 checksum How to use checksums |
ebd913496f093abb79183d96bd0fc8c4f47fd8b0bc719b727d0d169e795f3399
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.1 CPython/3.10.6
|
Release files / gen2_connector-1.0.0b67-py3-none-any.whl
| Download URL | gen2_connector-1.0.0b67-py3-none-any.whl |
|---|---|
| Size | 18.3 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
bb6f3f2a4d7d513cfd24b56aa178842b66a3e28c28da0a7aeca2ddac103aeee3
|
|
BLAKE2b-256 checksum How to use checksums |
23ca07ac3d3e25529d1d44bb326b5f65f7f2db83b37e58e923dddf90a592b00e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.1 CPython/3.10.6
|
