Skip to main content
Python Software Foundation 20th Year Anniversary Fundraiser  Donate today!

Redesigned KoNLPy (Wrapper) for Usability and Portability with gRPC.

Project description

KoNLPy-gRPC

Redesigned KoNLPy (Wrapper) for Usability and Portability with gRPC.

Requirements:

pip install poetry
pip install -r $(python manage.py requirements.txt) -r $(python manage.py requirements-dev.txt)

gRPC Compile needed!

python -m grpc_tools.protoc -I protos/ --python_out=konlpy_grpc/_generated/ --grpc_python_out=konlpy_grpc/_generated/ protos/*.proto

Server

python -m pip install konlpy
python -m konlpy_grpc server
python -m konlpy_grpc hannanum_server
python -m konlpy_grpc kkma_server
python -m konlpy_grpc komoran_server
python -m konlpy_grpc mecab_server
python -m konlpy_grpc okt_server

Tests

python -m pytest
python -m pytest --grpc-fake-server
python -m pytest --grpc-real-server=[::]:50051
python -m pytest --konlpy-repo=../konlpy

Release

rm -rf dist/
poetry publish --build -r test
poetry run twine upload --repository-url https://test.pypi.org/legacy/ dist/*

TODO

  • <input type="checkbox" checked="" disabled="" /> [P0] client.py will be a konlpy-alike module.
    • <input type="checkbox" checked="" disabled="" /> [P0] KoNLPy monkey-patcher
  • <input type="checkbox" checked="" disabled="" /> [P1] Packaging with Poetry pyproject.toml.
    • <input type="checkbox" checked="" disabled="" /> PyPI Register
    • <input type="checkbox" disabled="" /> Find lowerbound-version of requirements.
  • [P1] gRPC Proto Compile
  • [P1] In-house tool: manage.py
  • [P1] KoNLPy Version Matching (set minimum) and Follow-up
  • [P1] gRPC retry/timeout/error_handling logic
  • <input type="checkbox" checked="" disabled="" /> [P1] gRPC reflection
  • [P1] gRPC heartbeat
  • <input type="checkbox" checked="" disabled="" /> [P1] gRPC Gateway (gRPC to JSON)
  • <input type="checkbox" checked="" disabled="" /> [P2] Dockerize / Register
    • k8s and istio?
  • [P2] CI
  • [P3] Button for deploying this to AWS/GCS/Azure now! (and connect by README.)
  • [P3] CustomDic?
  • [P3] Stream I/O
  • [P3] Redesign tests/ with grpc-testing
  • [P4] Java Edition for KoNLPy-gRPC-Server
    • gRPC protos deploy/versioning

Additional Links

License

GNU GPLv3

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for konlpy-grpc, version 0.1.0
Filename, size File type Python version Upload date Hashes
Filename, size konlpy_grpc-0.1.0-py3-none-any.whl (38.7 kB) File type Wheel Python version py3 Upload date Hashes View
Filename, size konlpy_grpc-0.1.0.tar.gz (24.8 kB) File type Source Python version None Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring DigiCert DigiCert EV certificate Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page