nl-processing 1.0.4

Aggregate build for the nl_processing multi-package repository

nl_processing

Dutch language processing toolkit organized as a multi-package Python repository.

Install

pip install nl_processing

The published nl_processing package is the aggregate build from the repo root. Day-to-day development happens inside the package folders under packages/.

Repository Layout

packages/
  core/
  extract_text_from_image/
  extract_words_from_text/
  translate_text/
  translate_word/
  database/
  database_cache/
  sampling/
docs/
pyproject.toml        # aggregate build for the published nl_processing package
Makefile              # repo-wide lint/test entrypoint

Each package has its own:

• pyproject.toml
• ruff.toml
• pytest.ini
• tests/
• docs/

Modules

Module	Class	Description	Docs
core	N/A	Shared models, ports, exceptions, and prompt helpers	docs
extract_text_from_image	ImageTextExtractor	Extract Dutch text from images via Vision API	docs
extract_words_from_text	WordExtractor	Extract and normalize words from markdown text	docs
translate_text	TextTranslator	Translate text (NL -> RU) with markdown preservation	docs
translate_word	WordTranslator	Batch-translate words (NL -> RU)	docs
database	DatabaseService	Remote source of truth and default progress/sync provider	docs
database_cache	DatabaseCacheService	Local-first SQLite cache with injectable remote progress sync	docs
sampling	WordSampler	Weighted word sampling over any compatible scored-pair provider	docs

Development

Work inside one package when you only touch one module:

cd packages/translate_word
uv sync --all-groups
uv run pytest tests/unit

Run the repo-wide quality gate from the root:

make check

Useful package-local examples:

cd packages/core
uv run pytest tests/unit/core

cd packages/database
doppler run -- uv run pytest tests/integration/database

Dependency Rule

Modules are independent packages. Cross-module dependencies must be explicit in the consuming package's pyproject.toml.

Shared cross-module storage contracts live in nl_processing.core.ports. database and database_cache are concrete implementations and adapters, not the owners of those shared interfaces.

One intentional design change in this layout: database no longer imports translate_word directly. If you want automatic translation on add_words(), compose it explicitly:

from nl_processing.core.models import Language
from nl_processing.database.service import DatabaseService
from nl_processing.translate_word.service import WordTranslator

db = DatabaseService(
    user_id="alex",
    translator=WordTranslator(
        source_language=Language.NL,
        target_language=Language.RU,
    ),
)

Docs

• Repository module spec: docs/module-spec.md
• Environment variables: docs/ENV_VARS.md
• Release workflow: docs/REALEASE_WORKFLOW.md