Ray gen2 node provider
Project description
Gen2-connector enables Ray cluster to be deployed over IBM Gen2 infrastructure
-
Install Ray release 1.4.1 using
pip install ray[default]==1.4.1
-
Install gen2-connector on your machine
pip install gen2-connector
-
Configure ibm vpc
-
Create/Update security group to have SSH, Redis and Ray Dashboard ports open: 22, 8265 and 6379
-
Create cluster config file
- Use interactive
vpc-config
tool to generate cluster.yaml configuration file
vpc-config --iam-api-key ${IAM_API_KEY} --format ray --filename cluster.yaml
-
Select security group from previous step when prompted
-
The output of the
vpc-config
is a cluster config yaml file, e.g
================================================= Cluster config file: /tmp/tmpkf0dztfk.yaml =================================================
- Alternatively, update cluster config manually based on defaults.yaml
- Use interactive
-
Use generated file to bring ray cluster up, e.g
ray up /tmp/tmpkf0dztfk.yaml
- After finished, find cluster head node and worker nodes ips:
ray get-head-ip /tmp/tmpkf0dztfk.yaml
ray get-worker-ips /tmp/tmpkf0dztfk.yaml
- To get status of the cluster
ray status --address PUBLIC_HEAD_IP:6379
-
Use browser to open ray dashboard on PUBLIC_HEAD_IP:8265. Alternatively use
ray dashboard
to forward ray cluster dashboard to your localhost. -
Submit example task
ray submit /tmp/tmpkf0dztfk.yaml templates/example.py
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for gen2_connector-1.0.0b42-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 599b424281534313a538811da7b51176eb2902a107477da0a61fd83e63b56c03 |
|
MD5 | fe19cefa2ce1864432abc09d0c05a6d2 |
|
BLAKE2b-256 | bb6b2d066ef5c7392a684aae144d45e4c893b88b5177fe88f78b364e163a4df4 |