Skip to main content

Self-Play Pretraining with Zero Data (wip)

Implementation of Self-Play Pretraining with Zero Data

Paper Review from @hu-po

Citations

@misc{cowsik2026selfplaypretrainingzerodata,
    title    = {Self-Play Pretraining with Zero Data},
    author   = {Aditya Cowsik and Kfir Dolev and Michael Y. Li and G. Bruno De Luca and Nourya Cohen and Noah D. Goodman and Yoav Levine},
    year     = {2026},
    eprint   = {2609.30063},
    archivePrefix = {arXiv},
    primaryClass = {cs.AI},
    url      = {https://arxiv.org/abs/2609.30063},
}
@software{Morehead_JVP_Flash_Attention_2025,
    author  = {Morehead, Alex},
    doi     = {10.5281/zenodo.17050188},
    license = {MIT},
    month   = {sep},
    title   = {JVP Flash Attention},
    url     = {https://github.com/amorehead/jvp_flash_attention},
    version = {0.14.0},
    year    = {2025}
}
@misc{bloem2025universalpretrainingiteratedrandom,
    title   = {Universal pre-training by iterated random computation},
    author  = {Peter Bloem},
    year    = {2025},
    eprint  = {2506.20057},
    archivePrefix = {arXiv},
    primaryClass = {cs.LG},
    url     = {https://arxiv.org/abs/2506.20057},
}

Metadata

Release files for self-play-pretrain-zero-data 0.0.10

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for self-play-pretrain-zero-data 0.0.10
File Size Uploaded
self_play_pretrain_zero_data-0.0.10.tar.gz 12.9 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for self-play-pretrain-zero-data 0.0.10
File Interpreter ABI Platform
self_play_pretrain_zero_data-0.0.10-py3-none-any.whl Python 3 none any Details

Total release size: 27.4 kB

Release files / self_play_pretrain_zero_data-0.0.10.tar.gz

Download URL self_play_pretrain_zero_data-0.0.10.tar.gz
Size 12.9 kB
Tags Source
SHA-256 checksum
How to use checksums
512646832c40c9663e6fc0094584c43f0182401c5d26c7778ffe1a971ffff0e1
BLAKE2b-256 checksum
How to use checksums
9809160fee43a05db262c913c534761e023af895bc99695aa0ed0ab96e3c29b4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.8.17

Release files / self_play_pretrain_zero_data-0.0.10-py3-none-any.whl

Download URL self_play_pretrain_zero_data-0.0.10-py3-none-any.whl
Size 14.5 kB
Tags Python 3
SHA-256 checksum
How to use checksums
8bc2ebcd1d081cc93c7e03a773cb0e9807a3336c820df26c6b83d0f8d3ebbf22
BLAKE2b-256 checksum
How to use checksums
3cfc4908101ac2dc8c1cd770c90eae14831e7b47c7e66f461309326c97202f8b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.8.17
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page