a light-weight aligner.
Project description
Light-Aligner
A light-weight aligner for dual-text (currently just English-Chinese) alignment based on similariy scores using word for word "translation"
中文版读我 https://github.com/ffreemt/light-aligner/blob/master/README-zh.md
Features
Light-weight
, low resources demandLightning
fast, well maybe notlightning
fast but quite fast- No internet required
Special Dependencies
light aligner
depends on polyglot that in turn depends on libicu
To install libicu
For Linux/OSX
E.g.
- Ubuntu:
sudo apt install libicu-dev
- Centos:
yum install libicu
- OSX:
brew install icu4c
Then use poetry
or pip
to install PyICU pycld2 Morfessor
, e.g.
poetry add PyICU pycld2 Morfessor
or
pip install PyICU pycld2 Morfessor
For Windows
Download and install the pyicu
and pycld2
(possibly also Morfessor
) whl packages for your OS/Python version from https://www.lfd.uci.edu/~gohlke/pythonlibs/#pyicu and https://www.lfd.uci.edu/~gohlke/pythonlibs/#pycld2 (possibly also Morfessor https://www.lfd.uci.edu/~gohlke/pythonlibs/)
Installation
pip install light-aligner
or, clone the repo and install necessary packages using pip
:
git clone git@github.com:ffreemt/light-aligner.git
cd light-aigner
pip install -r requirements.txt
or, clone the repo and install necessary packages using poetry
git clone git@github.com:ffreemt/light-aligner.git
cd light-aigner
poetry install -v
light aligner
can be run in Linux/OSX
. In fact, the build process in github (pertaining to that github workflow badge is carried out in Linux.
Usage
cd light-aligner
python -m light_aligner
or
cd light-aligner
python light_aligner.__main__.py
You may wish to use powershell (e.g., right click the powershell scriptrun-python-m.ps1
and select Run with Powershell
) or conemu or cmder for better visual terminal experience.
Join qq-group 316287378 if you have any questions. The group chat is normally in Chinese but can switch to English if so desired.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file light-aligner-0.1.4.tar.gz
.
File metadata
- Download URL: light-aligner-0.1.4.tar.gz
- Upload date:
- Size: 2.1 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.1.5 CPython/3.7.9 Windows/10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | ed59a90611c99a3fe4055575d58316605fec8d51073de4a29b9e0ead528d9bdf |
|
MD5 | ea7ab77cd3d2444ead2c57edcaf72773 |
|
BLAKE2b-256 | 0efd6d72c8f03d2f3543f784dc8798189860997538b8045ead87aeb0883f681d |
File details
Details for the file light_aligner-0.1.4-py3-none-any.whl
.
File metadata
- Download URL: light_aligner-0.1.4-py3-none-any.whl
- Upload date:
- Size: 2.2 MB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.1.5 CPython/3.7.9 Windows/10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | cdf0e37c9b0fa4fe6ee35bf8d84b6f776bd727b696e09325c557c6d0e8b1d39f |
|
MD5 | 4e092974b1ef3b792416b22e5b984a51 |
|
BLAKE2b-256 | 236059d7e43c55620115c0d2371eb7d04dca153ee4a3e9443cabd1956f2971f0 |