Skip to main content

TorchX SDK and Components

Project description

PyPI License Tests Lint codecov

TorchX

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

TorchX currently supports:

  • Kubernetes (EKS, GKE, AKS, etc)
  • Slurm
  • AWS Batch
  • Docker
  • Local
  • Ray (prototype)
  • GCP Batch (prototype)

Need a scheduler not listed? Let us know!

Quickstart

See the quickstart guide.

Documentation

Requirements

torchx:

  • python3 (3.8+)
  • PyTorch
  • optional: Docker (needed for docker based schedulers)

Certain schedulers may require scheduler specific requirements. See installation for info.

Installation

Stable

# install torchx sdk and CLI -- minimum dependencies
pip install torchx

# install torchx sdk and CLI -- all dependencies
pip install "torchx[dev]"

# install torchx kubeflow pipelines (kfp) support
pip install "torchx[kfp]"

# install torchx Kubernetes / Volcano support
pip install "torchx[kubernetes]"

# install torchx Ray support
pip install "torchx[ray]"

# install torchx GCP Batch support
pip install "torchx[gcp_batch]"

Nightly

# install torchx sdk and CLI
pip install torchx-nightly[dev]

Source

# install torchx sdk and CLI from source
$ pip install -e git+https://github.com/pytorch/torchx.git#egg=torchx

# install extra dependencies
$ pip install -e git+https://github.com/pytorch/torchx.git#egg=torchx[dev]

Docker

TorchX provides a docker container for using as as part of a TorchX role.

See: https://github.com/pytorch/torchx/pkgs/container/torchx

Contributing

We welcome PRs! See the CONTRIBUTING file.

License

TorchX is BSD licensed, as found in the LICENSE file.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

torchx-applovin-0.6.0.dev1.tar.gz (192.6 kB view details)

Uploaded Source

Built Distribution

torchx_applovin-0.6.0.dev1-py3-none-any.whl (253.1 kB view details)

Uploaded Python 3

File details

Details for the file torchx-applovin-0.6.0.dev1.tar.gz.

File metadata

  • Download URL: torchx-applovin-0.6.0.dev1.tar.gz
  • Upload date:
  • Size: 192.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.9.17

File hashes

Hashes for torchx-applovin-0.6.0.dev1.tar.gz
Algorithm Hash digest
SHA256 ca13796d33fff7dc031c7f6e6a3d813b882ed4d0eaad6171cca522e0dce7f394
MD5 3bf5ca629045e69ad593880a69c12888
BLAKE2b-256 a584685ca03ad65c6c8f898cf54e21059d682a945210cc88d87cd022cc79299b

See more details on using hashes here.

File details

Details for the file torchx_applovin-0.6.0.dev1-py3-none-any.whl.

File metadata

File hashes

Hashes for torchx_applovin-0.6.0.dev1-py3-none-any.whl
Algorithm Hash digest
SHA256 5d3c40b4b2034a304bf48f2ef43e26398746007498eb11f9035d89e5ba2ce9dc
MD5 92bd4d1a6210f82ffe3eec7f5447e294
BLAKE2b-256 5303b7297369fd8c3273cd287b55f3fd13e2bbaab0c20190ddb2c74599a2413e

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page