ASJP conversion and tokenisation utils
A library of three functions. ipa2asjp takes an IPA-encoded sequence and converts it into an ASJP-encoded sequence. asjp2ipa tries to do the opposite. tokenise takes an ASJP-encoded string and returns a list of tokens.
>>> from asjp import ipa2asjp, asjp2ipa, tokenise >>> ipa2asjp('zɛmʲa') 'zEmy~a' >>> ipa2asjp(['z', 'ɛ', 'mʲ', 'a']) ['z', 'E', 'my~', 'a'] >>> asjp2ipa('zEmy~a') 'zɛmʲa' >>> tokenise('zEmy~a') ['z', 'E', 'my~', 'a'] >>> ipa2asjp(asjp2ipa(tokenise('zEmy~a'))) == tokenise('zEmy~a') True >>> ipa2asjp(['z', 'ɛ', 'mʲ', 'a']) == tokenise(ipa2asjp('zɛmʲa')) True
what is this?
ASJPcode, more commonly referred to as the ASJP alphabet or simply as ASJP, is a simplified transcription alphabet introduced in Brown et al. (2008) and then slightly modified in Brown et al. (2013); the latter is considered the alphabet’s spec for the purposes of this package.
The ASJP alphabet is used for transcribing the ASJP Database, an actively developed database aiming to provide the translations of a set of 40 basic concepts into all the world’s languages. Both alphabet and database are employed in the field of computational historical linguistics, e.g. in Jäger (2013) or Wichmann et al. (2011).
ipa2asjp(ipa_seq) takes an IPA string or sequence of string tokens and converts it into an ASJP string or sequence of string tokens. Raises a ValueError if the input does not constitute a valid IPA sequence.
asjp2ipa(asjp_seq) takes an ASJP string or sequence of string tokens and converts it into an IPA string or sequence of string tokens. As ASJP encodes much less information than IPA, something like asjp2ipa(ipa2asjp(ipa_seq)) == ipa_seq would rarely hold true. Raises a ValueError if the input does not constitute a valid ASJP sequence.
tokenise(asjp_string) takes an ASJP string and converts it into a list of ASJP tokens. Raises a ValueError if the input cannot be unambiguously tokenised.
tokenize(asjp_string) is an alias for tokenise(asjp_string).
pip install asjp
or, alternatively, you can clone this repo (safe to delete afterwards) and do:
python setup.py test python setup.py install
Of course, all of this could, and probably should, be happening within a virtual environment.
MIT. Do as you please and praise the snake gods.
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
|Filename, size||File type||Python version||Upload date||Hashes|
|Filename, size asjp-0.0.2-py3-none-any.whl (10.6 kB)||File type Wheel||Python version py3||Upload date||Hashes View hashes|
|Filename, size asjp-0.0.2.tar.gz (7.9 kB)||File type Source||Python version None||Upload date||Hashes View hashes|