Self-Play Pretraining with Zero Data (wip)
Implementation of Self-Play Pretraining with Zero Data
Citations
@misc{cowsik2026selfplaypretrainingzerodata,
title = {Self-Play Pretraining with Zero Data},
author = {Aditya Cowsik and Kfir Dolev and Michael Y. Li and G. Bruno De Luca and Nourya Cohen and Noah D. Goodman and Yoav Levine},
year = {2026},
eprint = {2609.30063},
archivePrefix = {arXiv},
primaryClass = {cs.AI},
url = {https://arxiv.org/abs/2609.30063},
}
@software{Morehead_JVP_Flash_Attention_2025,
author = {Morehead, Alex},
doi = {10.5281/zenodo.17050188},
license = {MIT},
month = {sep},
title = {JVP Flash Attention},
url = {https://github.com/amorehead/jvp_flash_attention},
version = {0.14.0},
year = {2025}
}
@misc{bloem2025universalpretrainingiteratedrandom,
title = {Universal pre-training by iterated random computation},
author = {Peter Bloem},
year = {2025},
eprint = {2506.20057},
archivePrefix = {arXiv},
primaryClass = {cs.LG},
url = {https://arxiv.org/abs/2506.20057},
}
Metadata
Release files for self-play-pretrain-zero-data 0.0.10
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| self_play_pretrain_zero_data-0.0.10.tar.gz | 12.9 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| self_play_pretrain_zero_data-0.0.10-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 27.4 kB
Release files / self_play_pretrain_zero_data-0.0.10.tar.gz
| Download URL | self_play_pretrain_zero_data-0.0.10.tar.gz |
|---|---|
| Size | 12.9 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
512646832c40c9663e6fc0094584c43f0182401c5d26c7778ffe1a971ffff0e1
|
|
BLAKE2b-256 checksum How to use checksums |
9809160fee43a05db262c913c534761e023af895bc99695aa0ed0ab96e3c29b4
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.8.17
|
Release files / self_play_pretrain_zero_data-0.0.10-py3-none-any.whl
| Download URL | self_play_pretrain_zero_data-0.0.10-py3-none-any.whl |
|---|---|
| Size | 14.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
8bc2ebcd1d081cc93c7e03a773cb0e9807a3336c820df26c6b83d0f8d3ebbf22
|
|
BLAKE2b-256 checksum How to use checksums |
3cfc4908101ac2dc8c1cd770c90eae14831e7b47c7e66f461309326c97202f8b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.8.17
|