Installation

uv add gyokusai

ruff check --select I --fix . && ruff format .

@software{shippole2026gyokusai,
  title        = {Gyokusai: A Web-Scale Text Processing Library},
  author       = {Shippole, Enrico and Hu, Andrew and Li, Owen and Huang, Thomas and Jitsev, Jenia},
  year         = {2026},
  url          = {https://github.com/teraflop-ai/gyokusai},
  version      = {0.1.1},
  note         = {Python package available on PyPI at \url{https://pypi.org/project/gyokusai/}}
}

@misc{paster2023openwebmath,
    title={OpenWebMath: An Open Dataset of High-Quality Mathematical Web Text},
    author={Keiran Paster and Marco Dos Santos and Zhangir Azerbayev and Jimmy Ba},
    year={2023},
    eprint={2310.06786},
    archivePrefix={arXiv},
    primaryClass={cs.AI}
}

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

gyokusai-0.1.1.tar.gz (18.1 kB view details)

Uploaded Sep 1, 2026 Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

The dropdown lists show the available interpreters, ABIs, and platforms. Enable javascript to be able to filter the list of wheel files.

gyokusai-0.1.1-py3-none-any.whl (27.6 kB view details)

Uploaded Sep 1, 2026 Python 3

File details

Details for the file gyokusai-0.1.1.tar.gz.

File metadata

Download URL: gyokusai-0.1.1.tar.gz
Upload date: Sep 1, 2026
Size: 18.1 kB
Tags: Source
Uploaded using Trusted Publishing? No
Uploaded via: uv/0.11.31 {"installer":{"name":"uv","version":"0.11.31","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"22.04","id":"jammy","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for gyokusai-0.1.1.tar.gz
Algorithm	Hash digest
SHA256	`8ccd9a52466836759e03f9fb5ff32e52f05e9ad85b13ae1e4d41736993a8a23f`
MD5	`27e9137a2c0787411482b308d661cb8a`
BLAKE2b-256	`6175fa957dd81f91c14d2c8414cba0ca0898c814dd370babe845493ea7db88a2`

See more details on using hashes here.

File details

Details for the file gyokusai-0.1.1-py3-none-any.whl.

File metadata

Download URL: gyokusai-0.1.1-py3-none-any.whl
Upload date: Sep 1, 2026
Size: 27.6 kB
Tags: Python 3
Uploaded using Trusted Publishing? No
Uploaded via: uv/0.11.31 {"installer":{"name":"uv","version":"0.11.31","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"22.04","id":"jammy","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for gyokusai-0.1.1-py3-none-any.whl
Algorithm	Hash digest
SHA256	`91adfdd83e8df6e63d62e366a64ef59398765aa0a7c161ba8406267fe1c0baf7`
MD5	`9e3486cf795350496da0bbc256e365bb`
BLAKE2b-256	`d662efd6b390dca8aefe558e7042224ff6e04f22b7425b8ff8fd7b81e8c92bb6`