Skip to main content

TEA - Translation Engine Architect

Project description

TEA - Translation Engine Architect

A command line tool to create translation engine.

Install

First install pipx then:

pipx install pangeamt-tea

Usage

Step 1: Create a new project

tea new --customer customer --srcLang es --tgtLang en --flavor automotion --version 0.0.1

This command will create the project directory structure:

├── customer_es_en_automotion_0.0.1
│   ├── config.yml
│   └── data

Then enter in the directory

cd customer_es_en_automotion_0.0.1

Step 2: Configuration

Tokenizer

A tokenizer can be applied to source and target

tea tokenizer --src mecab  --tgt moses

To list all available tokenizer:

tea tokenizer --list 

Truecaser

tea truecaser --src --tgt

BPE

tea bpe -s -t

data['processors'], data['tokenizer'], data['truecaser'], data['bpe'], data['trainer'])

Step 3:

Copy some multilingual ressources (.tmx, bilingual files, .af ) into the 'data' directory

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pangeamt-tea-0.2.0.tar.gz (14.8 kB view details)

Uploaded Source

Built Distribution

pangeamt_tea-0.2.0-py3-none-any.whl (20.7 kB view details)

Uploaded Python 3

File details

Details for the file pangeamt-tea-0.2.0.tar.gz.

File metadata

  • Download URL: pangeamt-tea-0.2.0.tar.gz
  • Upload date:
  • Size: 14.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.15.0 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.1.1.post20200323 requests-toolbelt/0.9.1 tqdm/4.43.0 CPython/3.8.2

File hashes

Hashes for pangeamt-tea-0.2.0.tar.gz
Algorithm Hash digest
SHA256 e6226e1fab20938b33d44df23c28c664b128d2bc4a858f3cf60ae58c1fd5fb43
MD5 31deb344cbb4f7c79c1b6752a81d9498
BLAKE2b-256 b27933537670d0184e6ae07ec74366d1e18743c46c9990b782dde4554c40dfef

See more details on using hashes here.

File details

Details for the file pangeamt_tea-0.2.0-py3-none-any.whl.

File metadata

  • Download URL: pangeamt_tea-0.2.0-py3-none-any.whl
  • Upload date:
  • Size: 20.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.15.0 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.1.1.post20200323 requests-toolbelt/0.9.1 tqdm/4.43.0 CPython/3.8.2

File hashes

Hashes for pangeamt_tea-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 81de86ab6c362baf77b65ed63c2c7a1466d8101838d6e9a96b2c0feb20099d79
MD5 022bd26acb5f267f0f10b4747d162a6b
BLAKE2b-256 acf695aa510a266193612321e6f8405175ab116820548df4ea28f1f54394131d

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page