A pure Python implementation of HFST for using HFST optimized lookup transducers (with or without weights)
Project description
Pyhfst
Pyhfst is a pure Python implementation of HFST. The library makes it possible to use HFST optimized lookup FSTs without any C dependencies. Both weighted and unweighted FSTs are supported.
The library will run on all operting systems that support Python 3.
Installation
pip install pyhfst
Pyhfst can run way faster if you have Cython installed. After installing Cython, you must reinstall Pyhfst
pip install cython
pip install --upgrade --force-reinstall pyhfst --no-cache-dir
Usage
import pyhfst
input_stream = pyhfst.HfstInputStream("./analyser")
tr = input_stream.read()
print(tr.lookup("voi"))
>> [['voida+V+Act+Ind+Prs+Sg3', 0.0], ['voida+V+Act+Ind+Prs+ConNeg', 0.0], ['voida+V+Act+Ind+Prt+Sg3', 0.0], ['voida+V+Act+Imprt+Prs+ConNeg+Sg2', 0.0], ['voida+V+Act+Imprt+Sg2', 0.0], ['voi+N+Sg+Nom', 0.0], ['voi+Pcle', 0.0], ['voi+Interj', 0.0]]
Citation
Please cite the library as follows:
Alnajjar, K., & Hämäläinen, M. (2023, December). PYHFST: A Pure Python Implementation of HFST. In Lightning Proceedings of NLP4DH and IWCLUL 2023 (pp. 32-35).
@article{pyhfst_2023,
title={PyHFST: A Pure Python Implementation of HFST},
author={Alnajjar, Khalid and H{\"a}m{\"a}l{\"a}inen, Mika},
booktitle={Lightning Proceedings of NLP4DH and IWCLUL 2023},
pages={32--35},
year={2023}
}
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for pyhfst-1.3.0-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 41f78b1c1d034ea57fd9d21fe152d629d9f97fdcddb0411628e18578f33b8ba8 |
|
MD5 | 6ac63913b6ca9a85d789aaee23a301a0 |
|
BLAKE2b-256 | e002c10a69ff21d6679a6b6e28c42cd265bec2cdd9be3dcbbee830a10fa4b0e5 |