Skip to main content

PSANN-LM: language modeling and training utilities for PSANN

Project description

psannlm – PSANN Language Modeling

This package hosts the PSANN-LM core library plus the standalone training CLI.

  • Importable module: psannlm (e.g. python -m psannlm or python -m psannlm.train).
  • Depends on the core psann library for shared utilities.
  • Includes the LM APIs previously hosted under psann.lm (now a stub in psann).
  • Intended to be published as its own wheel (psannlm) so users can opt into LM tooling separately from the core psann estimators.
  • psannlm.train remains the canonical LM training entrypoint and now delegates to the internal psannlm/_train/ package for tokenizer setup, dataset wiring, export helpers, and CLI orchestration.

For end-to-end usage patterns, configuration examples, and evaluation flows, see the top-level documentation in docs/lm.md and the scripts under scripts/ (for example scripts/train_psann_lm.py and scripts/run_lm_eval_psann.py).

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

psannlm-0.12.7.tar.gz (62.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

psannlm-0.12.7-py3-none-any.whl (3.1 kB view details)

Uploaded Python 3

File details

Details for the file psannlm-0.12.7.tar.gz.

File metadata

  • Download URL: psannlm-0.12.7.tar.gz
  • Upload date:
  • Size: 62.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.9

File hashes

Hashes for psannlm-0.12.7.tar.gz
Algorithm Hash digest
SHA256 d26ac033a5ff62dab40a0ad84fb6e0089b7ecfa9bda53549de6d7be02874dd92
MD5 7d77d40263492d9cd29d00a7fd67c43e
BLAKE2b-256 29dffac0d6ffab74e1d987df31929af5e8654f42d44c90b739dbc6a63ef366ad

See more details on using hashes here.

File details

Details for the file psannlm-0.12.7-py3-none-any.whl.

File metadata

  • Download URL: psannlm-0.12.7-py3-none-any.whl
  • Upload date:
  • Size: 3.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.9

File hashes

Hashes for psannlm-0.12.7-py3-none-any.whl
Algorithm Hash digest
SHA256 2bb709a58792e737e29df96699329580f2f69f8efa59154db91b1bed82fef995
MD5 06f236f311dc835cf3372b83d48c1e5a
BLAKE2b-256 d0d0d30c142906df2e6a88fbf09e3f96ec3e53a6848965f35050a65801f4887e

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page