Skip to main content

Utterance Normalizer Plugin

Normalizes utterances by stripping quotes, trailing punctuation, normalization (numeric substitutions, expanded contractions), and removing articles. Original utterances are preserved and returned utterances are returned in order:

  1. No Punctuation, Normalized
  2. No Punctuation, Normalized, Removed Articles
  3. No Punctuation
  4. Original Utterances

Wrapping " symbols are removed from all normalized strings

Configuration

This plugin can be enabled and configured as described below. By default, all normalization is completed.

utterance_transformers:
  neon_utterance_normalizer_plugin:
    remove_punctuation: True
    remove_articles: False

Metadata

Release files for neon-utterance-normalizer-plugin 1.0.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for neon-utterance-normalizer-plugin 1.0.0
File Size Uploaded
neon_utterance_normalizer_plugin-1.0.0.tar.gz 4.2 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for neon-utterance-normalizer-plugin 1.0.0
File Interpreter ABI Platform
neon_utterance_normalizer_plugin-1.0.0-py3-none-any.whl Python 3 none any Details

Total release size: 9.6 kB

Release files / neon_utterance_normalizer_plugin-1.0.0.tar.gz

Download URL neon_utterance_normalizer_plugin-1.0.0.tar.gz
Size 4.2 kB
Tags Source
SHA-256 checksum
How to use checksums
b6a7238413e7813921f6c68ee29f8f3e715865af2772561ada449e9929d371af
BLAKE2b-256 checksum
How to use checksums
e925c57f498138a32e0fd512683d572ec5bdb8bd87327175de26b2252853ac72
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.1.0 CPython/3.12.9

Release files / neon_utterance_normalizer_plugin-1.0.0-py3-none-any.whl

Download URL neon_utterance_normalizer_plugin-1.0.0-py3-none-any.whl
Size 5.3 kB
Tags Python 3
SHA-256 checksum
How to use checksums
669f927c7ad443af40ea0a5f18090a3ff80975c11d4780bdf9e7549bed81b1df
BLAKE2b-256 checksum
How to use checksums
90921b6a128938d74c90dd29b91b9012f83197f80a1497e2517f2257c68e46df
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.1.0 CPython/3.12.9
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page