Skip to main content

Package of Pathways-on-Cloud utilities.

Project description

Package of Pathways-on-Cloud utilities

Pathways is a novel compute orchtestration method that enables single controller runtime ML workloads. This approach unlocks a range of new capabilities for training resiliency, multihost inference and interactive development on cluster of arbitrary scale. Pathways simplifies large-scale machine learning computations by enabling a single JAX client to orchestrate workloads across multiple large TPU slices, potentially spanning hundreds or thousands of TPU chips. Pathways is used internally at Google to train large models like Gemini. Pathways on Cloud brings the same benefits to Google Cloud customers.

To make it as easy as possible for you to leverage Pathways on Cloud, we've bundled the necessary cloud-specific integrations into a single Python package and a set of container images. This package handles the underlying adaptations required for the cloud environment, allowing you to focus on your core workflows with minimal setup.

Further Reading

Pathways Research Paper

[More resources coming Soon]

How to get access to Pathways on Cloud

Pathways on Cloud is currently in Preview. Please contact your Google Cloud account representative to request access to Pathways.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pathwaysutils-0.1.0.tar.gz (25.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pathwaysutils-0.1.0-py3-none-any.whl (34.4 kB view details)

Uploaded Python 3

File details

Details for the file pathwaysutils-0.1.0.tar.gz.

File metadata

  • Download URL: pathwaysutils-0.1.0.tar.gz
  • Upload date:
  • Size: 25.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for pathwaysutils-0.1.0.tar.gz
Algorithm Hash digest
SHA256 7db4f45e306d521dd82c6c09d0a910f83a40f22ad038b24f0048b14638142487
MD5 fc95dca779c814445fbe1adef662b0f6
BLAKE2b-256 2923f51ba9eb83c1a00baa2c93b5eeeb5e699a38dcd40d199a492a62169275da

See more details on using hashes here.

Provenance

The following attestation bundles were made for pathwaysutils-0.1.0.tar.gz:

Publisher: build_wheel.yml on AI-Hypercomputer/pathways-utils

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pathwaysutils-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: pathwaysutils-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 34.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for pathwaysutils-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 ea6e0fbe859178d45808c8b18f56a71a8c62d8c88af3da1ff3b3170d86bb4554
MD5 8202f68618cdbc1b0d6bf84fb949eb1e
BLAKE2b-256 59c63415e6a6a84953a30ddbcc9cef899e3efff14459b19ac8e10ceb097c9a79

See more details on using hashes here.

Provenance

The following attestation bundles were made for pathwaysutils-0.1.0-py3-none-any.whl:

Publisher: build_wheel.yml on AI-Hypercomputer/pathways-utils

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page