Self-Play Pretraining with Zero Data (wip)
Implementation of Self-Play Pretraining with Zero Data
Citations
@misc{cowsik2026selfplaypretrainingzerodata,
title = {Self-Play Pretraining with Zero Data},
author = {Aditya Cowsik and Kfir Dolev and Michael Y. Li and G. Bruno De Luca and Nourya Cohen and Noah D. Goodman and Yoav Levine},
year = {2026},
eprint = {2609.30063},
archivePrefix = {arXiv},
primaryClass = {cs.AI},
url = {https://arxiv.org/abs/2609.30063},
}
@software{Morehead_JVP_Flash_Attention_2025,
author = {Morehead, Alex},
doi = {10.5281/zenodo.17050188},
license = {MIT},
month = {sep},
title = {JVP Flash Attention},
url = {https://github.com/amorehead/jvp_flash_attention},
version = {0.14.0},
year = {2025}
}
@misc{bloem2025universalpretrainingiteratedrandom,
title = {Universal pre-training by iterated random computation},
author = {Peter Bloem},
year = {2025},
eprint = {2506.20057},
archivePrefix = {arXiv},
primaryClass = {cs.LG},
url = {https://arxiv.org/abs/2506.20057},
}
Metadata
Release files for self-play-pretrain-zero-data 0.0.8
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| self_play_pretrain_zero_data-0.0.8.tar.gz | 13.0 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| self_play_pretrain_zero_data-0.0.8-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 27.4 kB
Release files / self_play_pretrain_zero_data-0.0.8.tar.gz
| Download URL | self_play_pretrain_zero_data-0.0.8.tar.gz |
|---|---|
| Size | 13.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
ca412b5faa235104e77c8b4cccbadc9de397358ca2563a7fc031863b71ad6a62
|
|
BLAKE2b-256 checksum How to use checksums |
640e455907ba085352fd7d084bc96433ea084717623f8a73dcd9662e6ac8abbf
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.8.17
|
Release files / self_play_pretrain_zero_data-0.0.8-py3-none-any.whl
| Download URL | self_play_pretrain_zero_data-0.0.8-py3-none-any.whl |
|---|---|
| Size | 14.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
eb044d20b755d872cdc3fe1cd483700f4f41d378d4eee0f0547832a2f808321f
|
|
BLAKE2b-256 checksum How to use checksums |
60df8cc26c48dee25c54a551f5d345aba647926446a952c9ecf1f2efb049c5c8
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.8.17
|