bulk-translate 0.24.1

A tiny Python no-string package for performing translation of a massive CSV/JSONL files with optionally pre-annotated object spans

bulk-translate 0.24.1

A tiny Python no-string package for performing translation of a massive CSV/JSONL files that natively provides support for annotating fixed-spans that are optionally invariant for translator.

The out-of-the box features of the bulk-translate are:

• ✅ Support of the spans for annotation / optional translation.
• ✅ Native Implementation of two translation modes:
  • fast-mode: exploits extra chars that could be used for grouping all the text parts into single batch with further deconstruction.
  • accurate: pefroms individual translation of each text part.
• ✅ No strings: you're free to adopt any LM / LLM backend.
  • Support googletrans by default.

Installation

pip install git+https://github.com/nicolay-r/bulk-translate

Usage

NOTE: If you wish to translate parse entities, you can use parse-entities flag

For the following test.tsv example data with annotated entities enclosed in square brackets:

python -m bulk_translate.translate \
    --src "test/data/test.tsv" \
    --prompt "{text}" \
    --adapter "dynamic:models/googletrans_310a.py:GoogleTranslateModel" \
    --output "test-translated.jsonl" \
    --parse-entities \
    %% \
    --src "auto" \
    --dest "ru"

Powered by

• AREkit [github]