Skip to main content

APIs to get started with using Pathways on Cloud

Pathways is a compute orchestration runtime for single-controller ML workloads across multiple Cloud TPU slices. A single Python controller orchestrates computation across hundreds or thousands of TPU chips, unlocking slice-level training resiliency, fast cross-slice data movement, and interactive multi-slice development.

This package bundles the Python client integrations, resharding and elasticity helpers, and GKE deployment builders for running JAX workloads on Pathways on Cloud.

Installation

pip install pathwaysutils
# Optional GKE JobSet generator and kubectl/Kubernetes client dependencies:
pip install 'pathwaysutils[gke]'
# Optional experimental Shared Pathways Service (SPS) dependencies:
pip install 'pathwaysutils[sps]'

Core Modules

  • pathwaysutils.initialize() registers the Pathways IFRT proxy backend, configures the compilation cache and XProf trace hooks, and registers Orbax checkpoint handlers.
  • pathwaysutils.reshard.reshard reshards arrays and PyTrees across device meshes directly on Pathways workers via the IFRT RemapArray API without routing tensors through controller memory.
  • pathwaysutils.elastic.manager.Manager monitors slice health in the background and provides @elastic_retry and ScaleUpSignalError for step-level fault recovery and dynamic slice scaling.
  • PathwaysJobSet (pathwaysutils.experimental.gke.jobset) builds, customizes, exports, and deploys Kubernetes JobSet manifests for Pathways workloads on GKE.
  • Shared Pathways Service (pathwaysutils.experimental.shared_pathways_service) deploys a persistent multi-tenant Pathways service on GKE for interactive JAX sessions.

Further Reading

Metadata

Release files for pathwaysutils 0.1.14

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pathwaysutils 0.1.14
File Size Uploaded Provenance Actions
pathwaysutils-0.1.14.tar.gz 145.7 kB With provenance Details for pathwaysutils-0.1.14.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for pathwaysutils 0.1.14
File Interpreter ABI Platform Actions
pathwaysutils-0.1.14-py3-none-any.whl Python 3 none any Details for pathwaysutils-0.1.14-py3-none-any.whl

Total release size: 329.3 kB

Release files / pathwaysutils-0.1.14.tar.gz

Download URL pathwaysutils-0.1.14.tar.gz
Size 145.7 kB
Tags Source
SHA-256 checksum
How to use checksums
34843220d8cc753dfc065a8e6618df162a6729f1a5b5f2386311cf4e29ddd6fe
BLAKE2b-256 checksum
How to use checksums
008acc510245d453b54d6831818fe83aadc0320cfe8614e1180dd7645536fc8f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 7, 2026.

Transparency log

Release files / pathwaysutils-0.1.14-py3-none-any.whl

Download URL pathwaysutils-0.1.14-py3-none-any.whl
Size 183.6 kB
Tags Python 3
SHA-256 checksum
How to use checksums
3345208051c128d05b032cfd22c5306d802c324ce8d324c8e60a43abd8efb6f8
BLAKE2b-256 checksum
How to use checksums
ea6d389ee41a6a0203a1fa7999e0d2d3f5c03ac8faed2742be97221504c73dd5
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 7, 2026.

Transparency log

Security for pathwaysutils 0.1.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

Both files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for pathwaysutils-0.1.14.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 7, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page