Skip to main content

TEA - Translation Engine Architect

Project description

TEA - Translation Engine Architect

A command line tool to create translation engine.

Install

First install pipx then:

pipx install pangeamt-tea

Usage

Step 1: Create a new project

tea new --customer customer --srcLang es --tgtLang en --flavor automotion --version 0.0.1

This command will create the project directory structure:

├── customer_es_en_automotion_0.0.1
│   ├── config.yml
│   └── data

Then enter in the directory

cd customer_es_en_automotion_0.0.1

Step 2: Configuration

Tokenizer

A tokenizer can be applied to source and target

tea tokenizer --src mecab  --tgt moses

To list all available tokenizer:

tea tokenizer --list 

Truecaser

tea truecaser --src --tgt

BPE

tea bpe -s -t

data['processors'], data['tokenizer'], data['truecaser'], data['bpe'], data['trainer'])

Step 3:

Copy some multilingual ressources (.tmx, bilingual files, .af ) into the 'data' directory

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pangeamt-tea-0.2.1.tar.gz (15.0 kB view details)

Uploaded Source

Built Distribution

pangeamt_tea-0.2.1-py3-none-any.whl (20.8 kB view details)

Uploaded Python 3

File details

Details for the file pangeamt-tea-0.2.1.tar.gz.

File metadata

  • Download URL: pangeamt-tea-0.2.1.tar.gz
  • Upload date:
  • Size: 15.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.15.0 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.1.1.post20200323 requests-toolbelt/0.9.1 tqdm/4.30.0 CPython/3.8.2

File hashes

Hashes for pangeamt-tea-0.2.1.tar.gz
Algorithm Hash digest
SHA256 a759e3591fdfe92825790d558ce3561d14767b272a727225664e2448fd0b288e
MD5 09680d5607aab10f5c4c55e15f3d03db
BLAKE2b-256 0a833ae8037353fadc1cbb614c41dd070acf2d32d76f7dd98c833a1f153f8f6b

See more details on using hashes here.

File details

Details for the file pangeamt_tea-0.2.1-py3-none-any.whl.

File metadata

  • Download URL: pangeamt_tea-0.2.1-py3-none-any.whl
  • Upload date:
  • Size: 20.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.15.0 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.1.1.post20200323 requests-toolbelt/0.9.1 tqdm/4.30.0 CPython/3.8.2

File hashes

Hashes for pangeamt_tea-0.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 4e2f9e3c7556fc4f3c9dc11645923ae051a07d11cdeec9c196bccd00a5f26311
MD5 e41e5da5d3f57e4de2b3ebe194b8c9f1
BLAKE2b-256 b5c0f91d0aa5ed7d99bac4cdd2b4e195dc73b29f5b7ff6b42a36ef38649d6f71

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page