Skip to main content

A set of tools for running simulation using vivarium on cluster.

Project description

https://badge.fury.io/py/vivarium-cluster-tools.svg Latest Version Documentation Status

Vivarium cluster tools is a python package that makes running vivarium simulations at scale on a Slurm cluster easy.

Installation

You can install this package with

pip install vivarium-cluster-tools

In addition, this tool needs the redis client. This must be installed using conda.

conda install redis

A simple example

If you have a vivarium model specifcation file defining a particular model, you can use that along side a branches file to launch a run of many simulations at once with variations in the input data, random seed, or with different parameter settings.

psimulate run /path/to/model_specification.yaml /path/to/branches_file.yaml

The simplest branches file defines a count of input data draws and random seeds to launch.

input_draw_count: 25
random_seed_count: 10

This branches file defines a set of simulations for all combinations of 25 input draws and 10 random seeds and so would run, in total, 250 simulations.

You can also define a set of parameter variations to run your model over. Say your original model specification looked something like

plugins:
  optional: ...

components:
  vivarium_public_health:
    population:
      - BasePopulation()
      - Mortality()
    disease.models:
      - SIS('lower_respiratory_infections')
  my_lri_intervention:
    components:
      - GiveKidsVaccines()

configuration:
  population:
    population_size: 1000
    age_start: 0
    age_end: 5
  lri_vaccine:
    coverage: 0.2
    efficacy: 0.8

Defining a simple model of lower respiratory infections and a vaccine intervention. You could then write a branches file that varied over both input data draws and random seeds, but also over different levels of coverage and efficacy for the vaccine. That file would look like

input_draw_count: 25
random_seed_count: 10

branches:
  lri_vaccine:
    coverage: [0.0, 0.2, 0.4, 0.8, 1.0]
    efficacy: [0.4, 0.6, 0.8]

The branches file would overwrite your original lri_vaccine configuration with each combination of coverage and efficacy in the branches file and launch a simulation. More, it would run each coverage-efficacy pair in the branches for each combination of input draw and random seed to produce 25 * 10 * 5 * 3 = 3750 unique simulations.

To read about more of the available features and get a better understanding of how to correctly write your own branches files,

Check out the docs!

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

vivarium_cluster_tools-2.3.3.tar.gz (90.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

vivarium_cluster_tools-2.3.3-py3-none-any.whl (57.0 kB view details)

Uploaded Python 3

File details

Details for the file vivarium_cluster_tools-2.3.3.tar.gz.

File metadata

  • Download URL: vivarium_cluster_tools-2.3.3.tar.gz
  • Upload date:
  • Size: 90.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for vivarium_cluster_tools-2.3.3.tar.gz
Algorithm Hash digest
SHA256 083f7b79720b2c1b893e4deb86b21eb4f76b31f18e89c34e15d4f37fe804436e
MD5 14da222d40af6a13dd4482b3223cfb91
BLAKE2b-256 74ce9bc90b929416527490592104e4d2b0f31be2b47037f7a58c6beab298c859

See more details on using hashes here.

Provenance

The following attestation bundles were made for vivarium_cluster_tools-2.3.3.tar.gz:

Publisher: deploy.yml on ihmeuw/vivarium_cluster_tools

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file vivarium_cluster_tools-2.3.3-py3-none-any.whl.

File metadata

File hashes

Hashes for vivarium_cluster_tools-2.3.3-py3-none-any.whl
Algorithm Hash digest
SHA256 d74fe2ea1c84f7dfb50d50f6f3799881a4ba452bac9f87d196810e59b1f0aeb2
MD5 222b78fefa47cf08680097ef16a42974
BLAKE2b-256 47d0b263998cfdbcf020e0a03a337ee28968d94e0fd0aac6bce3579be8413f29

See more details on using hashes here.

Provenance

The following attestation bundles were made for vivarium_cluster_tools-2.3.3-py3-none-any.whl:

Publisher: deploy.yml on ihmeuw/vivarium_cluster_tools

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page