IBM VPC connector for Ray
Project description
ibm-vpc-ray-connector enables Ray cluster to be deployed over IBM VPC infrastructure
Setup
Use of python virtual environment, e.g. virtualenv, is greatly encouraged to avoid installing Python packages globally, which could break system tools or other projects
- Install ibm-vpc-ray-connector on your machine
pip install ibm-vpc-ray-connector
-
Configure ibm vpc
-
Create/Update security group to have SSH, Redis and Ray Dashboard ports open: 22, 8265 and 6379
-
Create cluster config file
- Use interactive
ibm-ray-config
config tool to generate cluster.yaml configuration file
pip install ibm-ray-config ibm-ray-config -o cluster.yaml
- Use interactive
Usage
- Use generated file to bring ray cluster up, e.g
ray up cluster.yaml
.
- After finished, find cluster head node and worker nodes ips:
ray get-head-ip cluster.yaml
ray get-worker-ips cluster.yaml
- To get status of the cluster
ray status --address PUBLIC_HEAD_IP:6379
-
Use browser to open ray dashboard on PUBLIC_HEAD_IP:8265. Alternatively use
ray dashboard
to forward ray cluster dashboard to your localhost. -
Submit example task
ray submit cluster.yaml templates/example.py
Logs
Logs for the node_provider can be found under /tmp/connector_logs/
.
Logs of all levels will be written to connector_logs
.
The default log level for console output is INFO
.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file ibm-vpc-ray-connector-1.0.0b75.tar.gz
.
File metadata
- Download URL: ibm-vpc-ray-connector-1.0.0b75.tar.gz
- Upload date:
- Size: 17.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.10.6
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3ba218153a199f742739df5e1a16dc80235a6dff84f4b77b8b168e0a5f662d30 |
|
MD5 | 19b1ebaecc49eb48091659ce9774532b |
|
BLAKE2b-256 | fe49a5c1b304a3aa8e3882ad68ffa6a95dfc7aad1c9bd784dcb5685a4e0f6540 |
File details
Details for the file ibm_vpc_ray_connector-1.0.0b75-py3-none-any.whl
.
File metadata
- Download URL: ibm_vpc_ray_connector-1.0.0b75-py3-none-any.whl
- Upload date:
- Size: 19.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.10.6
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 42a7c0e2f7a8ea3554bcdede9ffc85c7c1df5c9977aab97de7e4e1bf9d963f27 |
|
MD5 | e33bcffab70255382e0f6190b913bfc5 |
|
BLAKE2b-256 | dea100a789834e2455367abcbef4c75f7bcf16601b45ca0b42899a56c452321d |