TorchX SDK and Components
Project description
TorchX
TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.
TorchX currently supports:
- Kubernetes (EKS, GKE, AKS, etc)
- Slurm
- AWS Batch
- Docker
- Local
- Ray (prototype)
- GCP Batch (prototype)
Need a scheduler not listed? Let us know!
Quickstart
See the quickstart guide.
Documentation
Requirements
torchx:
Certain schedulers may require scheduler specific requirements. See installation for info.
Installation
Stable
# install torchx sdk and CLI -- minimum dependencies
pip install torchx
# install torchx sdk and CLI -- all dependencies
pip install "torchx[dev]"
# install torchx kubeflow pipelines (kfp) support
pip install "torchx[kfp]"
# install torchx Kubernetes / Volcano support
pip install "torchx[kubernetes]"
# install torchx Ray support
pip install "torchx[ray]"
# install torchx GCP Batch support
pip install "torchx[gcp_batch]"
Nightly
# install torchx sdk and CLI
pip install torchx-nightly[dev]
Source
# install torchx sdk and CLI from source
$ pip install -e git+https://github.com/pytorch/torchx.git#egg=torchx
# install extra dependencies
$ pip install -e git+https://github.com/pytorch/torchx.git#egg=torchx[dev]
Docker
TorchX provides a docker container for using as as part of a TorchX role.
See: https://github.com/pytorch/torchx/pkgs/container/torchx
Contributing
We welcome PRs! See the CONTRIBUTING file.
License
TorchX is BSD licensed, as found in the LICENSE file.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for torchx-applovin-0.6.0.dev1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | ca13796d33fff7dc031c7f6e6a3d813b882ed4d0eaad6171cca522e0dce7f394 |
|
MD5 | 3bf5ca629045e69ad593880a69c12888 |
|
BLAKE2b-256 | a584685ca03ad65c6c8f898cf54e21059d682a945210cc88d87cd022cc79299b |
Hashes for torchx_applovin-0.6.0.dev1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5d3c40b4b2034a304bf48f2ef43e26398746007498eb11f9035d89e5ba2ce9dc |
|
MD5 | 92bd4d1a6210f82ffe3eec7f5447e294 |
|
BLAKE2b-256 | 5303b7297369fd8c3273cd287b55f3fd13e2bbaab0c20190ddb2c74599a2413e |