Skip to main content

IBM VPC connector for Ray

Project description

ibm-vpc-ray-connector enables Ray cluster to be deployed over IBM VPC infrastructure

Setup

Use of python virtual environment, e.g. virtualenv, is greatly encouraged to avoid installing Python packages globally, which could break system tools or other projects

  1. Install ibm-vpc-ray-connector on your machine
pip install ibm-vpc-ray-connector
  1. Configure ibm vpc

  2. Create cluster config file

    • Use interactive ibm-ray-config config tool to generate cluster.yaml configuration file
    pip install ibm-ray-config
    ibm-ray-config -o cluster.yaml
    

Usage

  • Use generated file to bring ray cluster up, e.g ray up cluster.yaml.
  • After finished, find cluster head node and worker nodes ips:
ray get-head-ip cluster.yaml
ray get-worker-ips cluster.yaml
  • To get status of the cluster
ray status --address PUBLIC_HEAD_IP:6379
  • Use browser to open ray dashboard on PUBLIC_HEAD_IP:8265. Alternatively use ray dashboard to forward ray cluster dashboard to your localhost.

  • Submit example task ray submit cluster.yaml templates/example.py

Logs

Logs for the node_provider can be found under /tmp/connector_logs/.
Logs of all levels will be written to connector_logs.
The default log level for console output is INFO.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ibm-vpc-ray-connector-1.0.0b75.tar.gz (17.3 kB view details)

Uploaded Source

Built Distribution

ibm_vpc_ray_connector-1.0.0b75-py3-none-any.whl (19.1 kB view details)

Uploaded Python 3

File details

Details for the file ibm-vpc-ray-connector-1.0.0b75.tar.gz.

File metadata

File hashes

Hashes for ibm-vpc-ray-connector-1.0.0b75.tar.gz
Algorithm Hash digest
SHA256 3ba218153a199f742739df5e1a16dc80235a6dff84f4b77b8b168e0a5f662d30
MD5 19b1ebaecc49eb48091659ce9774532b
BLAKE2b-256 fe49a5c1b304a3aa8e3882ad68ffa6a95dfc7aad1c9bd784dcb5685a4e0f6540

See more details on using hashes here.

File details

Details for the file ibm_vpc_ray_connector-1.0.0b75-py3-none-any.whl.

File metadata

File hashes

Hashes for ibm_vpc_ray_connector-1.0.0b75-py3-none-any.whl
Algorithm Hash digest
SHA256 42a7c0e2f7a8ea3554bcdede9ffc85c7c1df5c9977aab97de7e4e1bf9d963f27
MD5 e33bcffab70255382e0f6190b913bfc5
BLAKE2b-256 dea100a789834e2455367abcbef4c75f7bcf16601b45ca0b42899a56c452321d

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page