Skip to main content

Underthesea Core

Project description

Underthesea Core

Underthesea Core is a powerful extension of the popular natural language processing library Underthesea, which includes a range of efficient data preprocessing tools and machine learning models for training. Built with Rust for optimal performance, Underthesea Core offers fast processing speeds and is easy to implement, with Python bindings for seamless integration into existing projects. This extension is an essential tool for developers looking to build high-performance NLP systems that deliver accurate and reliable results.

Usage

CRFFeaturizer

>>> from underthesea_core import CRFFeaturizer
>>> features = ["T[-1]", "T[0]", "T[1]"]
>>> dictionary = set(["sinh viên"])
>>> featurizer = CRFFeaturizer(features, dictionary)
>>> sentences = [[["sinh", "X"], ["viên", "X"], ["đi", "X"], ["học", "X"]]]
>>> featurizer.process(sentences)
[[['T[-1]=BOS', 'T[0]=sinh', 'T[1]=viên'],
  ['T[-1]=sinh', 'T[0]=viên', 'T[1]=đi'],
  ['T[-1]=viên', 'T[0]=đi', 'T[1]=học'],
  ['T[-1]=đi', 'T[0]=học', 'T[1]=EOS']]]

Release Workflow

  1. Change version in Cargo.toml and pyproject.toml
  2. Push to branch core with commit Publish Underthesea Core
  • This will trigger release-pypi-core action
  1. Check latest version in pypi

Note*: Run a self-hosted for building macos-arm

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

underthesea_core-1.0.4.tar.gz (560.4 kB view details)

Uploaded Source

Built Distributions

underthesea_core-1.0.4-cp311-none-win_amd64.whl (553.0 kB view details)

Uploaded CPython 3.11 Windows x86-64

underthesea_core-1.0.4-cp311-cp311-manylinux2010_x86_64.whl (657.8 kB view details)

Uploaded CPython 3.11 manylinux: glibc 2.12+ x86-64

underthesea_core-1.0.4-cp311-cp311-macosx_11_0_arm64.whl (574.6 kB view details)

Uploaded CPython 3.11 macOS 11.0+ ARM64

underthesea_core-1.0.4-cp311-cp311-macosx_10_7_x86_64.whl (601.6 kB view details)

Uploaded CPython 3.11 macOS 10.7+ x86-64

underthesea_core-1.0.4-cp310-none-win_amd64.whl (553.0 kB view details)

Uploaded CPython 3.10 Windows x86-64

underthesea_core-1.0.4-cp310-cp310-manylinux2010_x86_64.whl (657.8 kB view details)

Uploaded CPython 3.10 manylinux: glibc 2.12+ x86-64

underthesea_core-1.0.4-cp310-cp310-macosx_11_0_arm64.whl (574.6 kB view details)

Uploaded CPython 3.10 macOS 11.0+ ARM64

underthesea_core-1.0.4-cp310-cp310-macosx_10_7_x86_64.whl (601.6 kB view details)

Uploaded CPython 3.10 macOS 10.7+ x86-64

underthesea_core-1.0.4-cp39-none-win_amd64.whl (553.2 kB view details)

Uploaded CPython 3.9 Windows x86-64

underthesea_core-1.0.4-cp39-cp39-manylinux2010_x86_64.whl (657.9 kB view details)

Uploaded CPython 3.9 manylinux: glibc 2.12+ x86-64

underthesea_core-1.0.4-cp39-cp39-macosx_11_0_arm64.whl (574.9 kB view details)

Uploaded CPython 3.9 macOS 11.0+ ARM64

underthesea_core-1.0.4-cp39-cp39-macosx_10_7_x86_64.whl (601.6 kB view details)

Uploaded CPython 3.9 macOS 10.7+ x86-64

underthesea_core-1.0.4-cp38-none-win_amd64.whl (552.4 kB view details)

Uploaded CPython 3.8 Windows x86-64

underthesea_core-1.0.4-cp38-cp38-manylinux2010_x86_64.whl (657.9 kB view details)

Uploaded CPython 3.8 manylinux: glibc 2.12+ x86-64

underthesea_core-1.0.4-cp38-cp38-macosx_11_0_arm64.whl (574.2 kB view details)

Uploaded CPython 3.8 macOS 11.0+ ARM64

underthesea_core-1.0.4-cp38-cp38-macosx_10_7_x86_64.whl (601.4 kB view details)

Uploaded CPython 3.8 macOS 10.7+ x86-64

underthesea_core-1.0.4-cp37-none-win_amd64.whl (552.9 kB view details)

Uploaded CPython 3.7 Windows x86-64

underthesea_core-1.0.4-cp37-cp37m-manylinux2010_x86_64.whl (657.7 kB view details)

Uploaded CPython 3.7m manylinux: glibc 2.12+ x86-64

underthesea_core-1.0.4-cp37-cp37m-macosx_10_7_x86_64.whl (601.2 kB view details)

Uploaded CPython 3.7m macOS 10.7+ x86-64

File details

Details for the file underthesea_core-1.0.4.tar.gz.

File metadata

  • Download URL: underthesea_core-1.0.4.tar.gz
  • Upload date:
  • Size: 560.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.11.0

File hashes

Hashes for underthesea_core-1.0.4.tar.gz
Algorithm Hash digest
SHA256 fea9ddfe7445f6bb5c018407ba37aabd46043fb754f2d36088aab8a2c542f5ae
MD5 e97c97cb8fa905831bb18b27e1451cf8
BLAKE2b-256 b37f8d136185263619e25473af7584bb224918a3546975afeb375b87b3bcae20

See more details on using hashes here.

File details

Details for the file underthesea_core-1.0.4-cp311-none-win_amd64.whl.

File metadata

File hashes

Hashes for underthesea_core-1.0.4-cp311-none-win_amd64.whl
Algorithm Hash digest
SHA256 744d9e4009e76bf5a955b5445a4f7e04cdd0d74976f51c3120b29327a24edc1d
MD5 6e7728b5064c2817c88c2ba1aba0faa9
BLAKE2b-256 039cd77c20ca57b9d053047b31f0c5924318552fa21c2798757b925670552ebd

See more details on using hashes here.

File details

Details for the file underthesea_core-1.0.4-cp311-cp311-manylinux2010_x86_64.whl.

File metadata

File hashes

Hashes for underthesea_core-1.0.4-cp311-cp311-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 a42c7638eff24b01e03c15a96011f96a32ed917d6275faf5bcee911ee8acd051
MD5 a5834ad208d86cc8b826364a42e23f8d
BLAKE2b-256 e19d095b76972ad94fdeee12f9833f03f4bc5cbe0795f9ef3d0b8e000e450b35

See more details on using hashes here.

File details

Details for the file underthesea_core-1.0.4-cp311-cp311-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for underthesea_core-1.0.4-cp311-cp311-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 f0e07d58d559714a0c109cdbe317e56d993c14367f107bb5f89260bb0f88f2f7
MD5 fe8e5307513ef98afd52a93d3a8bc913
BLAKE2b-256 b98a6e5ca86b2485e53fe64f06e0249b0c822aa1d9b5c4077dca6960ee2806ce

See more details on using hashes here.

File details

Details for the file underthesea_core-1.0.4-cp311-cp311-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for underthesea_core-1.0.4-cp311-cp311-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 1b48ee5ec32e23859ab8880bd692b75fc7e3686a438ad96dd8fe5ee7de1da06b
MD5 04fd8f250ac221529952fbf6e253d0ef
BLAKE2b-256 24281caf305355f7ac8e0a0c448889a6171a58fa8a2620e90627e6243e01b1e4

See more details on using hashes here.

File details

Details for the file underthesea_core-1.0.4-cp310-none-win_amd64.whl.

File metadata

File hashes

Hashes for underthesea_core-1.0.4-cp310-none-win_amd64.whl
Algorithm Hash digest
SHA256 d3ace5f20d82178cc2163bb41a97aa9477dec87b7a3623f2d6854e0baae3ac16
MD5 cc6a5b879aa398995f8afb60409bf9b8
BLAKE2b-256 c3491f7fbde97f7d7501e712a74b5a44b970a0997e6301b5d65cad8e27d0374b

See more details on using hashes here.

File details

Details for the file underthesea_core-1.0.4-cp310-cp310-manylinux2010_x86_64.whl.

File metadata

File hashes

Hashes for underthesea_core-1.0.4-cp310-cp310-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 e8ea95a441930548a2f83c744da2b24abe24a101b74dfa3086039aeec52988dd
MD5 1d0f86e8698549437d0f08f0a12949c9
BLAKE2b-256 3c7eb5af0cc8c567e0fc545a897850d8c216df2c2d02f30a52cbe60da252ce92

See more details on using hashes here.

File details

Details for the file underthesea_core-1.0.4-cp310-cp310-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for underthesea_core-1.0.4-cp310-cp310-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 606b59ccfa0ad276d34585186d9ec0f631afc2dacc52bf50521a7f01659438dd
MD5 678b60fad86a5ac89a8ae90d02752a1a
BLAKE2b-256 7183f91cc745aa79cbab0929af600f8150be9542321922d04df2aea5410a0f9e

See more details on using hashes here.

File details

Details for the file underthesea_core-1.0.4-cp310-cp310-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for underthesea_core-1.0.4-cp310-cp310-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 e97315f04eb12b80b7c8f80671e9c98c704eb687e95ed1435549b74f34e4490e
MD5 48b7e76b6e09dcb2c388e1da47e927ec
BLAKE2b-256 b1bea82e92467d34bb1e0b0a02fb8b4e9a8d8f5e3d34e19dedea5606fabd1deb

See more details on using hashes here.

File details

Details for the file underthesea_core-1.0.4-cp39-none-win_amd64.whl.

File metadata

File hashes

Hashes for underthesea_core-1.0.4-cp39-none-win_amd64.whl
Algorithm Hash digest
SHA256 3c5e28c11396d8a1b57773c1613064739986c1e8f68495bb5772bb38dc61571c
MD5 49fe484c77d240c58da6488f4a2683cd
BLAKE2b-256 491452ad136c71ab00ff156b1cb1de023a86797fcd5238e4a6c867950466cf1f

See more details on using hashes here.

File details

Details for the file underthesea_core-1.0.4-cp39-cp39-manylinux2010_x86_64.whl.

File metadata

File hashes

Hashes for underthesea_core-1.0.4-cp39-cp39-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 c558b3172690b0df07c30d6e054b319fc71694d8f304f7e800f2fcaadedbed93
MD5 5e4b2082bc52f6809b2fa0dd7dcc190c
BLAKE2b-256 ab0963b71ed80c7c9f31f53297fede1345cafd5323debde4afb0ddbca8b2d800

See more details on using hashes here.

File details

Details for the file underthesea_core-1.0.4-cp39-cp39-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for underthesea_core-1.0.4-cp39-cp39-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 a8f4ea7d81c3d1bf0b77b8512ba31f504ee89d8381822765c3b393ef787cb9f6
MD5 e6455ce1a114ff76d37a17c70c7a97ee
BLAKE2b-256 88990d0e2826e78797194b56bb06463c92d8d1653b39992c6a95585e4efb95a6

See more details on using hashes here.

File details

Details for the file underthesea_core-1.0.4-cp39-cp39-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for underthesea_core-1.0.4-cp39-cp39-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 14217cb52c2951e82c321d89d0cc4f36ccd98b028e53079f7fd091a8627b6887
MD5 e62305c848f4cc42c944e10d712fd2da
BLAKE2b-256 2ed20f11a1c70402f469bcb2270294954bd0ed9f72d04952ddd432b7fd0bd49a

See more details on using hashes here.

File details

Details for the file underthesea_core-1.0.4-cp38-none-win_amd64.whl.

File metadata

File hashes

Hashes for underthesea_core-1.0.4-cp38-none-win_amd64.whl
Algorithm Hash digest
SHA256 d5b0af33a45742b99aa4f32e853a0aab55a333c82c9f1ad98953d36b0364538f
MD5 f4330d4852e28c60bc7201014a059357
BLAKE2b-256 124262048c6842e42864f53e4b3f940c0e01d8d7fa7bb73847fc1c0a49c19bbf

See more details on using hashes here.

File details

Details for the file underthesea_core-1.0.4-cp38-cp38-manylinux2010_x86_64.whl.

File metadata

File hashes

Hashes for underthesea_core-1.0.4-cp38-cp38-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 97cac4af610298a65efc4e30aed5820ad61d993e8f02b8684179c56fd6776370
MD5 5234807adeec00db506c5947a0e9cd06
BLAKE2b-256 44d92ef9aa90ec0764077fb43ed575ecedf7757bf6ffe41c1ed756ae876f0ca1

See more details on using hashes here.

File details

Details for the file underthesea_core-1.0.4-cp38-cp38-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for underthesea_core-1.0.4-cp38-cp38-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 ea570399f813ba1cbeb560bc19f2dda193deeb2fa1abd9305d0e6c99c5868788
MD5 4f1a410afbaa8947850a58c8741b9852
BLAKE2b-256 aa571c22bc312f76cf0a04dc4e1b7986f94b31dd31416a730413c750280b5a64

See more details on using hashes here.

File details

Details for the file underthesea_core-1.0.4-cp38-cp38-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for underthesea_core-1.0.4-cp38-cp38-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 9d14982b5453bf4fb4e33164530dedb44f27a891f083ef8ae68e7e901ac7d3c2
MD5 aeaf82dc273f74d754b63b9331c7b1f2
BLAKE2b-256 a18b3b3e459032195165c893902fdcd92483894fc879c57a6880910ac634a8f2

See more details on using hashes here.

File details

Details for the file underthesea_core-1.0.4-cp37-none-win_amd64.whl.

File metadata

File hashes

Hashes for underthesea_core-1.0.4-cp37-none-win_amd64.whl
Algorithm Hash digest
SHA256 350472118f9fb73071ee1fa557ab2b0bfcb0c0729a4aec27e38e36b6f99a962c
MD5 c5bf53766563b3924e6d814c346d1b1a
BLAKE2b-256 3a99ad9c9d5e3638394e4580697d2d33aac6a10a24e85c7f271ad3f3eed380f8

See more details on using hashes here.

File details

Details for the file underthesea_core-1.0.4-cp37-cp37m-manylinux2010_x86_64.whl.

File metadata

File hashes

Hashes for underthesea_core-1.0.4-cp37-cp37m-manylinux2010_x86_64.whl
Algorithm Hash digest
SHA256 cd05fc12345cb91782ce573de01fa956694dedcc2d9db3a8ee95362532d68f9e
MD5 237a198ac181de39b9144ee9e8dc75fc
BLAKE2b-256 a38a2cd80ef4ddeb417768b65462b3c6cef2728bdae182f0e28b45d003a24650

See more details on using hashes here.

File details

Details for the file underthesea_core-1.0.4-cp37-cp37m-macosx_10_7_x86_64.whl.

File metadata

File hashes

Hashes for underthesea_core-1.0.4-cp37-cp37m-macosx_10_7_x86_64.whl
Algorithm Hash digest
SHA256 ad313f80ce68c31e1f49a08798213b0d5410dc27e3118848ace4199a83786953
MD5 0636bfe78049b2d90f750ffcf154a955
BLAKE2b-256 6be807eb9f7ad002b0666d2a5901500a8a4683c6182a0fa90bf18f4555842428

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page