Skip to main content

a light-weight aligner.

Project description

Light-Aligner buildCode style: blackLicense: MITPyPI version

A light-weight aligner for dual-text (currently just English-Chinese) alignment based on similariy scores using word for word "translation"

中文版读我 https://github.com/ffreemt/light-aligner/blob/master/README-zh.md

Features

  • Light-weight, low resources demand
  • Lightning fast, well maybe not lightning fast but quite fast
  • No internet required

Special Dependencies

light aligner depends on polyglot that in turn depends on libicu

To install libicu

For Linux/OSX

E.g.

  • Ubuntu: sudo apt install libicu-dev
  • Centos: yum install libicu
  • OSX: brew install icu4c

Then use poetry or pip to install PyICU pycld2 Morfessor, e.g.

poetry add PyICU pycld2 Morfessor

or

pip install PyICU pycld2 Morfessor
For Windows

Download and install the pyicu and pycld2 (possibly also Morfessor) whl packages for your OS/Python version from https://www.lfd.uci.edu/~gohlke/pythonlibs/#pyicu and https://www.lfd.uci.edu/~gohlke/pythonlibs/#pycld2 (possibly also Morfessor https://www.lfd.uci.edu/~gohlke/pythonlibs/)

Installation

pip install light-aligner

or, clone the repo and install necessary packages using pip:

git clone git@github.com:ffreemt/light-aligner.git
cd light-aigner
pip install -r requirements.txt

or, clone the repo and install necessary packages using poetry

git clone git@github.com:ffreemt/light-aligner.git
cd light-aigner
poetry install -v

light aligner can be run in Linux/OSX. In fact, the build process in github (pertaining to that github workflow badge build is carried out in Linux.

Usage

cd light-aligner
python -m light_aligner

or

cd light-aligner
python light_aligner.__main__.py

You may wish to use powershell (e.g., right click the powershell scriptrun-python-m.ps1 and select Run with Powershell) or conemu or cmder for better visual terminal experience.

Join qq-group 316287378 qrcode if you have any questions. The group chat is normally in Chinese but can switch to English if so desired.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

light-aligner-0.1.3.tar.gz (2.1 MB view hashes)

Uploaded Source

Built Distribution

light_aligner-0.1.3-py3-none-any.whl (2.2 MB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page