Ray gen2 node provider
Project description
Gen2-connector enables Ray cluster to be deployed over IBM Gen2 infrastructure
Use of python virtual environment, e.g. virtualenv is greatly encouraged, to avoid installing Python packages globally which could break system tools or other projects
-
Install Ray release 1.8.0 using
pip install ray[default]==1.8.0
-
Install gen2-connector on your machine
pip install gen2-connector
-
Configure ibm vpc
-
Create/Update security group to have SSH, Redis and Ray Dashboard ports open: 22, 8265 and 6379
-
Create cluster config file
- Use interactive
lithopscloud
config tool to generate cluster.yaml configuration file
pip install lithopscloud lithopscloud -o cluster.yaml
- Use interactive
-
Use generated file to bring ray cluster up, e.g
ray up cluster.yaml
- After finished, find cluster head node and worker nodes ips:
ray get-head-ip cluster.yaml
ray get-worker-ips cluster.yaml
- To get status of the cluster
ray status --address PUBLIC_HEAD_IP:6379
-
Use browser to open ray dashboard on PUBLIC_HEAD_IP:8265. Alternatively use
ray dashboard
to forward ray cluster dashboard to your localhost. -
Submit example task
ray submit cluster.yaml templates/example.py
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for gen2_connector-1.0.0b58-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c6f502bb710840545a0adb9e89bfa533dd1f8d3394e8ebfc3a289608c72cd78a |
|
MD5 | 680ac57a37dd77ca454c4f7207b16d72 |
|
BLAKE2b-256 | c35d8f5db9fe65b770257f64f0e5f66c96ca00e001d98693c7c051b8721c6f00 |