Skip to main content

sentence nlp parser for multilingua

Project description

Installation

Install from pip3

pip3 install --verbose sencore

Install spacy lib

python -m spacy download en_core_web_trf
python -m spacy download es_dep_news_trf

Usage

Please refer to api docs.

Executable usage

  • Parse sentence into vocabs

    parse2vocab --lang en --sentence "It is a great day."
    
  • Parse sentence into phrases

    parse2phrase --lang en --sentence "It is a great day."
    

Package usage

  • Parse sentence into vocabs

    from sencore import VocabParser 
    
    def vocab(lang, sentence):
      sentences = {
          "en": "Apple is looking at buying U.K. startup for $1 billion.",
          "es": "En 1941, fue llamado a filas para incorporarse a la Armada.",
          "de": "Für Joachim Löw ist ein Nationalmannschafts-Comeback von Thomas Müller und Mats Hummels nicht mehr kategorisch ausgeschlossen.",
          "fr": "Nos jolis canards vont-ils détrôner les poules, coqueluches des jardiniers ?",
      }
    
      sen = sentence or sentences[lang]
      print(sen)
      vp = VocabParser(lang)
      vocabs = vp.digest(sen)
      print(vocabs)
    
    
  • Parse sentence into phrases

    from sencore import PhraseParser
    
    def phrase(lang, sentence):
      sentences = {
          "en": "Apple is looking at buying U.K. startup for $1 billion.",
          "es": "En 1941, fue llamado a filas para incorporarse a la Armada.",
          "de": "Für Joachim Löw ist ein Nationalmannschafts-Comeback von Thomas Müller und Mats Hummels nicht mehr kategorisch ausgeschlossen.",
          "fr": "Nos jolis canards vont-ils détrôner les poules, coqueluches des jardiniers ?",
      }
    
      sen = sentence or sentences[lang]
      print(sen)
      pp = PhraseParser(lang)
      phrases = pp.digest(sen)
      print(phrases)
    

Development

Clone project

git clone https://github.com/qishe-nlp/sencore.git

Install poetry

Install dependencies

poetry update
python -m spacy download en_core_web_trf
python -m spacy download es_dep_news_trf

Test

poetry run pytest -rP

which run tests under tests/*

Execute

poetry run parse_to_vocab --help

Create sphinx docs

poetry shell
cd apidocs
sphinx-apidoc -f -o source ../sencore
make html
python -m http.server -d build/html

Hose docs on github pages

cp -rf apidocs/build/html/* docs/

Build

  • Change version in pyproject.toml and sencore/__init__.py
  • Build python package by poetry build

Git commit and push

Publish from local dev env

  • Set pypi test environment variables in poetry, refer to poetry doc
  • Publish to pypi test by poetry publish -r test

Publish through CI

git tag [x.x.x]
git push origin master

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sencore-0.1.37.tar.gz (6.5 kB view hashes)

Uploaded Source

Built Distribution

sencore-0.1.37-py3-none-any.whl (8.4 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page