Skip to main content

PSANN-LM: language modeling and training utilities for PSANN

Project description

psannlm – PSANN Language Modeling

This package hosts the PSANN-LM core library plus the standalone training CLI.

  • Importable module: psannlm (e.g. python -m psannlm or python -m psannlm.train).
  • Depends on the core psann library for shared utilities.
  • Includes the LM APIs previously hosted under psann.lm (now a stub in psann).
  • Intended to be published as its own wheel (psannlm) so users can opt into LM tooling separately from the core psann estimators.
  • psannlm.train remains the canonical LM training entrypoint and now delegates to the internal psannlm/_train/ package for tokenizer setup, dataset wiring, export helpers, and CLI orchestration.

For end-to-end usage patterns, configuration examples, and evaluation flows, see the top-level documentation in docs/lm.md and the scripts under scripts/ (for example scripts/train_psann_lm.py and scripts/run_lm_eval_psann.py).

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

psannlm-0.12.4.tar.gz (62.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

psannlm-0.12.4-py3-none-any.whl (3.1 kB view details)

Uploaded Python 3

File details

Details for the file psannlm-0.12.4.tar.gz.

File metadata

  • Download URL: psannlm-0.12.4.tar.gz
  • Upload date:
  • Size: 62.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.9

File hashes

Hashes for psannlm-0.12.4.tar.gz
Algorithm Hash digest
SHA256 8a7420af8dd39dda146850e39ee882efb5527a429034a76753f09c79e3aa69f9
MD5 0e57a9727cfddfdacc0d3d24b4e7eddd
BLAKE2b-256 67a76abff6380a61030b823b994d29f4d113c94fe14cc7f6f60841476332dca7

See more details on using hashes here.

File details

Details for the file psannlm-0.12.4-py3-none-any.whl.

File metadata

  • Download URL: psannlm-0.12.4-py3-none-any.whl
  • Upload date:
  • Size: 3.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.9

File hashes

Hashes for psannlm-0.12.4-py3-none-any.whl
Algorithm Hash digest
SHA256 e93bf854fbe5566f624a766051111fbd8d6fde096bb553e29f4d2d127c354363
MD5 1ed0bbcc80b0488f18f42f0f0a03071c
BLAKE2b-256 bbfe89cf3e021fa1bd510aec9872eca596534df3a561f1cfe9c45ee207496f17

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page