Skip to main content

Self-Play Pretraining with Zero Data (wip)

Implementation of Self-Play Pretraining with Zero Data

Paper Review from @hu-po

Citations

@misc{cowsik2026selfplaypretrainingzerodata,
    title    = {Self-Play Pretraining with Zero Data},
    author   = {Aditya Cowsik and Kfir Dolev and Michael Y. Li and G. Bruno De Luca and Nourya Cohen and Noah D. Goodman and Yoav Levine},
    year     = {2026},
    eprint   = {2609.30063},
    archivePrefix = {arXiv},
    primaryClass = {cs.AI},
    url      = {https://arxiv.org/abs/2609.30063},
}
@software{Morehead_JVP_Flash_Attention_2025,
    author  = {Morehead, Alex},
    doi     = {10.5281/zenodo.17050188},
    license = {MIT},
    month   = {sep},
    title   = {JVP Flash Attention},
    url     = {https://github.com/amorehead/jvp_flash_attention},
    version = {0.14.0},
    year    = {2025}
}
@misc{bloem2025universalpretrainingiteratedrandom,
    title   = {Universal pre-training by iterated random computation},
    author  = {Peter Bloem},
    year    = {2025},
    eprint  = {2506.20057},
    archivePrefix = {arXiv},
    primaryClass = {cs.LG},
    url     = {https://arxiv.org/abs/2506.20057},
}

Metadata

Release files for self-play-pretrain-zero-data 0.0.8

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for self-play-pretrain-zero-data 0.0.8
File Size Uploaded
self_play_pretrain_zero_data-0.0.8.tar.gz 13.0 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for self-play-pretrain-zero-data 0.0.8
File Interpreter ABI Platform
self_play_pretrain_zero_data-0.0.8-py3-none-any.whl Python 3 none any Details

Total release size: 27.4 kB

Release files / self_play_pretrain_zero_data-0.0.8.tar.gz

Download URL self_play_pretrain_zero_data-0.0.8.tar.gz
Size 13.0 kB
Tags Source
SHA-256 checksum
How to use checksums
ca412b5faa235104e77c8b4cccbadc9de397358ca2563a7fc031863b71ad6a62
BLAKE2b-256 checksum
How to use checksums
640e455907ba085352fd7d084bc96433ea084717623f8a73dcd9662e6ac8abbf
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.8.17

Release files / self_play_pretrain_zero_data-0.0.8-py3-none-any.whl

Download URL self_play_pretrain_zero_data-0.0.8-py3-none-any.whl
Size 14.5 kB
Tags Python 3
SHA-256 checksum
How to use checksums
eb044d20b755d872cdc3fe1cd483700f4f41d378d4eee0f0547832a2f808321f
BLAKE2b-256 checksum
How to use checksums
60df8cc26c48dee25c54a551f5d345aba647926446a952c9ecf1f2efb049c5c8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.8.17
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page