Installation

Install from pip3

pip3 install --verbose sencore

Install spacy lib

python -m spacy download en_core_web_trf
python -m spacy download es_dep_news_trf

Usage

Please refer to api docs.

Executable usage

Parse sentence into vocabs

parse2vocab --lang en --sentence "It is a great day."

Parse sentence into phrases

parse2phrase --lang en --sentence "It is a great day."

Package usage

Parse sentence into vocabs

from sencore import VocabParser 

def vocab(lang, sentence):
  sentences = {
      "en": "Apple is looking at buying U.K. startup for $1 billion.",
      "es": "En 1941, fue llamado a filas para incorporarse a la Armada.",
      "de": "Für Joachim Löw ist ein Nationalmannschafts-Comeback von Thomas Müller und Mats Hummels nicht mehr kategorisch ausgeschlossen.",
      "fr": "Nos jolis canards vont-ils détrôner les poules, coqueluches des jardiniers ?",
  }

  sen = sentence or sentences[lang]
  print(sen)
  vp = VocabParser(lang)
  vocabs = vp.digest(sen)
  print(vocabs)

Parse sentence into phrases

from sencore import PhraseParser

def phrase(lang, sentence):
  sentences = {
      "en": "Apple is looking at buying U.K. startup for $1 billion.",
      "es": "En 1941, fue llamado a filas para incorporarse a la Armada.",
      "de": "Für Joachim Löw ist ein Nationalmannschafts-Comeback von Thomas Müller und Mats Hummels nicht mehr kategorisch ausgeschlossen.",
      "fr": "Nos jolis canards vont-ils détrôner les poules, coqueluches des jardiniers ?",
  }

  sen = sentence or sentences[lang]
  print(sen)
  pp = PhraseParser(lang)
  phrases = pp.digest(sen)
  print(phrases)

Development

Clone project

git clone https://github.com/qishe-nlp/sencore.git

Install poetry

Install dependencies

poetry update
python -m spacy download en_core_web_trf
python -m spacy download es_dep_news_trf

Test

poetry run pytest -rP

which run tests under tests/*

Execute

poetry run parse_to_vocab --help

Create sphinx docs

poetry shell
cd apidocs
sphinx-apidoc -f -o source ../sencore
make html
python -m http.server -d build/html

Host docs on github pages

cp -rf apidocs/build/html/* docs/

Build

Change version in pyproject.toml and sencore/__init__.py
Build python package by poetry build

Git commit and push

Publish from local dev env

Set pypi test environment variables in poetry, refer to poetry doc
Publish to pypi test by poetry publish -r test

Publish through CI

Github action build and publish package to test pypi repo

git tag [x.x.x]
git push origin master

Manually publish to pypi repo through github action

Release files for sencore 0.1.56

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for sencore 0.1.56
File	Size	Uploaded
sencore-0.1.56.tar.gz	9.7 kB	Mar 21, 2025	Details

Built distribution (wheel)

Table of built distributions (wheels) for sencore 0.1.56
File	Interpreter	ABI	Platform	Reset
sencore-0.1.56-py3-none-any.whl 15.1 kB Mar 21, 2025	Python 3	none	any	Details

Total release size: 24.8 kB

Release files / sencore-0.1.56.tar.gz

Download URL	sencore-0.1.56.tar.gz
Size	9.7 kB
Tags	Source
SHA-256 checksum How to use checksums	`94995e50f35cb53dfdea6d37e4e93239144af6e3f45c922ef9e2fa181bf68639`
BLAKE2b-256 checksum How to use checksums	`7d095cefb348e93612276b0167e37a4cddafd53153a7ea7eae790a241f31e1a2`
Upload date	Mar 21, 2025
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`poetry/2.1.1 CPython/3.12.0 Linux/6.8.0-1021-azure`

Release files / sencore-0.1.56-py3-none-any.whl

Download URL	sencore-0.1.56-py3-none-any.whl
Size	15.1 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`bb67f6cbf82fe40e06b724d6b4c53144eb95dfa288180da2745e2c566745bbf4`
BLAKE2b-256 checksum How to use checksums	`ef84f9c7d4b6574ce579b18181427005fbeeabf78dedce67de4054291f9e4735`
Upload date	Mar 21, 2025
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`poetry/2.1.1 CPython/3.12.0 Linux/6.8.0-1021-azure`