CZ Benchmarks

What is cz-benchmarks?

cz-benchmarks is a package for standardized evaluation and comparison of machine learning models for biological applications (first, in the single-cell transcriptomics domain, with future plans to expand to additional domains). The package provides a toolkit for running containerized models, executing biologically-relevant tasks, and computing performance metrics. We see this tool as a step towards ensuring that large-scale ML Models can be harnessed to deliver genuine biological insights -- by building trust, accelerating development, and bridging the gap between ML and biology communities.

Why benchmarking? Why now?

Last year, CZI hosted a workshop focused on benchmarking and evaluation of ML Models in biology, and the insights gained have reinforced our commitment to supporting the development of a robust benchmarking infrastructure, which we see as critical to achieving our Virtual Cell vision.

💬 Community Feedback & Contributions

We're working to get the alpha version of cz-benchmarks stable to build with the community. In the meantime, for issues you may identify, feel free to open an issue on GitHub or reach out to us at virtualcellmodels@chanzuckerberg.com.

Getting Started

To get started with cz-benchmarks, refer to the Quick Start Guide.

📚 Additional Resources

📖 Documentation: The full documentation is available at cz-benchmarks

Development Status
- 3 - Alpha
Intended Audience
- Science/Research
License
- OSI Approved :: MIT License
Operating System
- OS Independent
Programming Language

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

cz_benchmarks-0.15.1.tar.gz (1.2 MB view details)

Uploaded Nov 25, 2025 Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

The dropdown lists show the available interpreters, ABIs, and platforms. Enable javascript to be able to filter the list of wheel files.

cz_benchmarks-0.15.1-py3-none-any.whl (78.8 kB view details)

Uploaded Nov 25, 2025 Python 3

File details

Details for the file cz_benchmarks-0.15.1.tar.gz.

File metadata

Download URL: cz_benchmarks-0.15.1.tar.gz
Upload date: Nov 25, 2025
Size: 1.2 MB
Tags: Source
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for cz_benchmarks-0.15.1.tar.gz
Algorithm	Hash digest
SHA256	`0752d42bd1b33b5efc94c7c33e8956e6197997d839bbb080e7b17b1cebf29178`
MD5	`3df4c7eab188736f9773d1de89c60265`
BLAKE2b-256	`40a5cbb345e074448db7d778e6092dd20cdbabf473858ea5dc0f6a0639d3bf6e`

See more details on using hashes here.

Provenance

The following attestation bundles were made for cz_benchmarks-0.15.1.tar.gz:

Publisher: publish-pypi.yml on chanzuckerberg/cz-benchmarks

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: cz_benchmarks-0.15.1.tar.gz
- Subject digest: 0752d42bd1b33b5efc94c7c33e8956e6197997d839bbb080e7b17b1cebf29178
- Sigstore transparency entry: 725422915
- Sigstore integration time: Nov 25, 2025
Source repository:
- Permalink: chanzuckerberg/cz-benchmarks@0d44e73c4987c35bfb9f8f1fee2b0f8cca4682ea
- Branch / Tag: refs/tags/v0.15.1
- Owner: https://github.com/chanzuckerberg
- Access: public
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: publish-pypi.yml@0d44e73c4987c35bfb9f8f1fee2b0f8cca4682ea
- Trigger Event: release