Skip to main content

Add your description here

Project description

parallel_wandb

This simple package makes it easy to use the new (reinit="create_new") feature of Weights & Biases (wandb) to create and log to multiple wandb runs in parallel

This, when combined with jax.vmap, enables extremely efficient, high-throughput training (and logging!) of multiple simultaneous training runs.

  • This package provides two simple functions that you can import and use in your own project: wandb_init to initialize multiple wandb runs and wandb_log to log metrics to them in parallel.
  • A demonstration of how these can be used with jax.vmap can be found in jax_mnist.py.

Installation

  1. (optional) Install UV: https://docs.astral.sh/uv/getting-started/installation/

  2. Add this package as a dependency to your project:

uv add parallel_wandb

OR, if you don't use UV yet, you can also pip install parallel_wandb.

Usage

from parallel_wandb import wandb_init, wandb_log

runs = wandb_init(
    {"name": ["run_0", "run_1"], "config": {"seed": [0, 1]}},
    project="test_project",
    name="test_name",
)
assert isinstance(runs, np.ndarray) and runs.shape == (2,) and runs.dtype == object

wandb_log(runs, {"loss": [0.1, 0.2]}, step=0)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

parallel_wandb-0.0.2.tar.gz (92.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

parallel_wandb-0.0.2-py3-none-any.whl (17.6 kB view details)

Uploaded Python 3

File details

Details for the file parallel_wandb-0.0.2.tar.gz.

File metadata

  • Download URL: parallel_wandb-0.0.2.tar.gz
  • Upload date:
  • Size: 92.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for parallel_wandb-0.0.2.tar.gz
Algorithm Hash digest
SHA256 0011f92d00498a036fd5fb080e0e89c234376fe0081bc2a73913736679b84998
MD5 1d67fa8cddd0356ca0c8ef7f04be6408
BLAKE2b-256 eb339471e77974262050e7f25d09674afc67bc6984899f67050a8ded7a325fbf

See more details on using hashes here.

Provenance

The following attestation bundles were made for parallel_wandb-0.0.2.tar.gz:

Publisher: publish.yaml on lebrice/parallel_wandb

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file parallel_wandb-0.0.2-py3-none-any.whl.

File metadata

  • Download URL: parallel_wandb-0.0.2-py3-none-any.whl
  • Upload date:
  • Size: 17.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for parallel_wandb-0.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 4a95fbcca512ad2fc6c854d231994a0562fb53c78f1dd9e51b5fea379e8a019a
MD5 fe2f21f06d6d324ebf0f96466991e6d0
BLAKE2b-256 7a08a7154c616e1a862bc4cc27d4c6886e7ce8def9eef6e0406289e9aa655529

See more details on using hashes here.

Provenance

The following attestation bundles were made for parallel_wandb-0.0.2-py3-none-any.whl:

Publisher: publish.yaml on lebrice/parallel_wandb

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page