Skip to main content

Self-Play Pretraining with Zero Data (wip)

Implementation of Self-Play Pretraining with Zero Data

Paper Review from @hu-po

Citations

@misc{cowsik2026selfplaypretrainingzerodata,
    title    = {Self-Play Pretraining with Zero Data},
    author   = {Aditya Cowsik and Kfir Dolev and Michael Y. Li and G. Bruno De Luca and Nourya Cohen and Noah D. Goodman and Yoav Levine},
    year     = {2026},
    eprint   = {2609.30063},
    archivePrefix = {arXiv},
    primaryClass = {cs.AI},
    url      = {https://arxiv.org/abs/2609.30063},
}
@software{Morehead_JVP_Flash_Attention_2025,
    author  = {Morehead, Alex},
    doi     = {10.5281/zenodo.17050188},
    license = {MIT},
    month   = {sep},
    title   = {JVP Flash Attention},
    url     = {https://github.com/amorehead/jvp_flash_attention},
    version = {0.14.0},
    year    = {2025}
}
@misc{bloem2025universalpretrainingiteratedrandom,
    title   = {Universal pre-training by iterated random computation},
    author  = {Peter Bloem},
    year    = {2025},
    eprint  = {2506.20057},
    archivePrefix = {arXiv},
    primaryClass = {cs.LG},
    url     = {https://arxiv.org/abs/2506.20057},
}

Metadata

Release files for self-play-pretrain-zero-data 0.0.9

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for self-play-pretrain-zero-data 0.0.9
File Size Uploaded
self_play_pretrain_zero_data-0.0.9.tar.gz 13.1 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for self-play-pretrain-zero-data 0.0.9
File Interpreter ABI Platform
self_play_pretrain_zero_data-0.0.9-py3-none-any.whl Python 3 none any Details

Total release size: 27.6 kB

Release files / self_play_pretrain_zero_data-0.0.9.tar.gz

Download URL self_play_pretrain_zero_data-0.0.9.tar.gz
Size 13.1 kB
Tags Source
SHA-256 checksum
How to use checksums
f6bb569f6138d870fbf67f64fc8cf7a2ffb408c9ad9e3d788f4c4a34c4eb6ac2
BLAKE2b-256 checksum
How to use checksums
eec02d3dde50fbb89f470b0bdc2ef35acab3bbe0c085c662e725a752a58ac1d9
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.8.17

Release files / self_play_pretrain_zero_data-0.0.9-py3-none-any.whl

Download URL self_play_pretrain_zero_data-0.0.9-py3-none-any.whl
Size 14.6 kB
Tags Python 3
SHA-256 checksum
How to use checksums
3b5f60bc423cc8569b876bce44e285e608187dee1f1a31750c21987094b90154
BLAKE2b-256 checksum
How to use checksums
fad524b3071a685b887fa7da82d5477a8f66f89b96fe5d90c45304ac8f400cf7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.8.17
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page