Concatenated-word segmentation Python library written in Rust
Table of Contents
About The Project
A fast concatenated-word segmentation library written in Rust, inspired by wordninja and wordsegment. The binding uses pyo3 to interact with the rust package.
Built With
Installation
pip3 install pywordsegment
Usage
import pywordsegment
# The internal UNIGRAMS & BIGRAMS corpuses are lazy initialized
# once per the whole module. Multiple WordSegmenter instances would
# not create new dictionaries.
# Segments a word to its parts
pywordsegment.WordSegmenter.segment(
text="theusashops",
)
# ["the", "usa", "shops"]
# This function checks whether the substring exists as a whole segment
# inside text.
pywordsegment.WordSegmenter.exist_as_segment(
substring="inter",
text="internationalairport",
)
# False
pywordsegment.WordSegmenter.exist_as_segment(
substring="inter",
text="intermilan",
)
# True
License
Distributed under the MIT License. See LICENSE for more information.
Contact
Gal Ben David - gal@intsights.com
Project Link: https://github.com/intsights/pywordsegment
1 maintainer
Metadata
1 maintainer
Release files for pywordsegment 0.4.3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distributions (wheels)
Total release size: 192.7 MB
Release files / pywordsegment-0.4.3-cp311-none-win_amd64.whl
| Download URL | pywordsegment-0.4.3-cp311-none-win_amd64.whl |
|---|---|
| Size | 9.6 MB |
| Tags | CPython 3.11 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
95136eb3101f484faeb762d353036531f6124c8f8bec17d8109f02b1d3516594
|
|
BLAKE2b-256 checksum How to use checksums |
1e129f3f6f282f272a3261df6f73e7d1a52a5025b383ed288b9cbef3f37ac7ee
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/0.12.20
|
Release files / pywordsegment-0.4.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Download URL | pywordsegment-0.4.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl |
|---|---|
| Size | 9.7 MB |
| Tags | CPython 3.11 Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
1505fa8db755cac4e7bc103cc9d13cc48a7e9585a65d54447067bd3c3e23d240
|
|
BLAKE2b-256 checksum How to use checksums |
55a8ca3c4b614defc62d65808e7c604f8516f321a1a0805b3b712abc80d7bcd6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/0.12.20
|
Release files / pywordsegment-0.4.3-cp311-cp311-macosx_11_0_arm64.whl
| Download URL | pywordsegment-0.4.3-cp311-cp311-macosx_11_0_arm64.whl |
|---|---|
| Size | 9.6 MB |
| Tags | CPython 3.11 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
52e85ce00c09a5bbc7eb4a375ac8a54d99e30abd7e6f1b110277ce1a4de52952
|
|
BLAKE2b-256 checksum How to use checksums |
0005c0287f48ca6f484ffe8f718efe804858041aac2eeb5a03e6b267f4521703
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/0.12.20
|
Release files / pywordsegment-0.4.3-cp311-cp311-macosx_10_7_x86_64.whl
| Download URL | pywordsegment-0.4.3-cp311-cp311-macosx_10_7_x86_64.whl |
|---|---|
| Size | 9.7 MB |
| Tags | CPython 3.11 macOS 10.7+ x86-64 |
|
SHA-256 checksum How to use checksums |
a12be14c5fe9cf60b0cb37187a2b4ab93164c6096cbe522bc25be83fce59d6f2
|
|
BLAKE2b-256 checksum How to use checksums |
f62db0daaa48ad73fd28c7b7c69b0251000b717f1984ec29b44d506981e95e52
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/0.12.20
|
Release files / pywordsegment-0.4.3-cp310-none-win_amd64.whl
| Download URL | pywordsegment-0.4.3-cp310-none-win_amd64.whl |
|---|---|
| Size | 9.6 MB |
| Tags | CPython 3.10 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
62dadee684ab40090bbdf96dd548c6e1b8e17254360d23494bd7e68b56c37eac
|
|
BLAKE2b-256 checksum How to use checksums |
76642205fb5307ecaf0f42b0b10e4fe6e0ccfed1bc3183eb2c24b1f8390f06cf
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/0.12.20
|
Release files / pywordsegment-0.4.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Download URL | pywordsegment-0.4.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl |
|---|---|
| Size | 9.7 MB |
| Tags | CPython 3.10 Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
4a013b1b1056f8f9124481ef18c608b12045115fe512e8eab736f075476d7fa5
|
|
BLAKE2b-256 checksum How to use checksums |
5e14a9f0db6cafb559e95745d46388975660265a31a471dbb8e89c48b1d7130f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/0.12.20
|
Release files / pywordsegment-0.4.3-cp310-cp310-macosx_11_0_arm64.whl
| Download URL | pywordsegment-0.4.3-cp310-cp310-macosx_11_0_arm64.whl |
|---|---|
| Size | 9.6 MB |
| Tags | CPython 3.10 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
64b334a66b915bc386c93f50f1be9d39406d59aa9736128f30cec958fe4ac736
|
|
BLAKE2b-256 checksum How to use checksums |
7c3534c5308b6849651ea5c1e79f5ff506fe420bdd0f48e3a3ce7013ff2ffbe6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/0.12.20
|
Release files / pywordsegment-0.4.3-cp310-cp310-macosx_10_7_x86_64.whl
| Download URL | pywordsegment-0.4.3-cp310-cp310-macosx_10_7_x86_64.whl |
|---|---|
| Size | 9.7 MB |
| Tags | CPython 3.10 macOS 10.7+ x86-64 |
|
SHA-256 checksum How to use checksums |
82cb6bdd41379cd557bbd72115424c3bfd8d42e90b644de47ac6156e730f0cb5
|
|
BLAKE2b-256 checksum How to use checksums |
ba40969e9d7d424ede6986a85ecbee72820039596656f189ec00da8bfa86f18a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/0.12.20
|
Release files / pywordsegment-0.4.3-cp39-none-win_amd64.whl
| Download URL | pywordsegment-0.4.3-cp39-none-win_amd64.whl |
|---|---|
| Size | 9.6 MB |
| Tags | CPython 3.9 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
b4c4fedbda9e15e456ac0d1553fc28dad5573de44a7b32847a2d362a1253c9cd
|
|
BLAKE2b-256 checksum How to use checksums |
81cbf0426a59feff1e654321ea5276531212ecad73d47562dfbf098554a52f43
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/0.12.20
|
Release files / pywordsegment-0.4.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Download URL | pywordsegment-0.4.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl |
|---|---|
| Size | 9.7 MB |
| Tags | CPython 3.9 Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
e2b3698bb72b6882044c5e23aedb2b6cbf28294a26a4670afb543c2e6516f629
|
|
BLAKE2b-256 checksum How to use checksums |
aa5674610afff5ab01cda688ee4f2abb7e8c9a3ec0ddec5e478fe3d4f26cfcc5
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/0.12.20
|
Release files / pywordsegment-0.4.3-cp39-cp39-macosx_11_0_arm64.whl
| Download URL | pywordsegment-0.4.3-cp39-cp39-macosx_11_0_arm64.whl |
|---|---|
| Size | 9.6 MB |
| Tags | CPython 3.9 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
b3d13c22732d952a90e0d1c5200aca7bf81aa1036a9abe2bb0cf20435c26b170
|
|
BLAKE2b-256 checksum How to use checksums |
38d0797a68001ce6ccff44d94da891792280c5a81fa46177a28b7f1a566b1191
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/0.12.20
|
Release files / pywordsegment-0.4.3-cp39-cp39-macosx_10_7_x86_64.whl
| Download URL | pywordsegment-0.4.3-cp39-cp39-macosx_10_7_x86_64.whl |
|---|---|
| Size | 9.7 MB |
| Tags | CPython 3.9 macOS 10.7+ x86-64 |
|
SHA-256 checksum How to use checksums |
b044a381aa0826798a204dab0477347c813feeb56a3a496d9d7242d5094839a2
|
|
BLAKE2b-256 checksum How to use checksums |
c7bd3c73e876971bb5310560cd1725333045109149736f6a87f42dec3813b5c9
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/0.12.20
|
Release files / pywordsegment-0.4.3-cp38-none-win_amd64.whl
| Download URL | pywordsegment-0.4.3-cp38-none-win_amd64.whl |
|---|---|
| Size | 9.6 MB |
| Tags | CPython 3.8 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
8b686e43fa390cd9ff7ccabd1bd100217bf713c59f73f40e9f896e4826f227d9
|
|
BLAKE2b-256 checksum How to use checksums |
8d54ab63e12e2c2e03acb93c9261b152209e0f2f4641f123404aa0266dcc3e7f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/0.12.20
|
Release files / pywordsegment-0.4.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Download URL | pywordsegment-0.4.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl |
|---|---|
| Size | 9.7 MB |
| Tags | CPython 3.8 Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
777ecc405a68b97ef4c33e14f37a03c405491a65cc927d81f55dbeef21adc83d
|
|
BLAKE2b-256 checksum How to use checksums |
6accb3317463991756ba2d38e7fdff56d527ff826559fc9c3997ae3431975ffa
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/0.12.20
|
Release files / pywordsegment-0.4.3-cp38-cp38-macosx_11_0_arm64.whl
| Download URL | pywordsegment-0.4.3-cp38-cp38-macosx_11_0_arm64.whl |
|---|---|
| Size | 9.6 MB |
| Tags | CPython 3.8 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
e80447c683501eee5e612990c8ad26329e2997adf65f85a6a07acb0a3c8c940d
|
|
BLAKE2b-256 checksum How to use checksums |
0b8296bd1d6006a7b2f10ce558175d424e87d3504f265f17679408bf36c5ae20
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/0.12.20
|
Release files / pywordsegment-0.4.3-cp38-cp38-macosx_10_7_x86_64.whl
| Download URL | pywordsegment-0.4.3-cp38-cp38-macosx_10_7_x86_64.whl |
|---|---|
| Size | 9.7 MB |
| Tags | CPython 3.8 macOS 10.7+ x86-64 |
|
SHA-256 checksum How to use checksums |
423b4b19c512432c3f6dd469fa56720ab5e612f04289eb0b172f40ed71127f5b
|
|
BLAKE2b-256 checksum How to use checksums |
d1dc7c4fffe87c3d3adbfbf9d9dbc97a8c41437307643dc6eb2e6fee72053222
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/0.12.20
|
Release files / pywordsegment-0.4.3-cp37-none-win_amd64.whl
| Download URL | pywordsegment-0.4.3-cp37-none-win_amd64.whl |
|---|---|
| Size | 9.6 MB |
| Tags | CPython 3.7 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
cfa950833fdee4b9be9afdda2e542f3cba727eab80c101e14cc6101df8213da7
|
|
BLAKE2b-256 checksum How to use checksums |
ca2bd34c3f8e67e4b8641a1f6da87b78e6ffa5f97561ae9003763c5849505855
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/0.12.20
|
Release files / pywordsegment-0.4.3-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Download URL | pywordsegment-0.4.3-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl |
|---|---|
| Size | 9.7 MB |
| Tags | CPython 3.7 CPython 3.7 pymalloc Linux glibc 2.17+ x86-64 |
|
SHA-256 checksum How to use checksums |
e5d07c0845d71faa602872c3e84deb27b625b2811aa409ed8a1fa6fcfe0339b8
|
|
BLAKE2b-256 checksum How to use checksums |
134cf5abefefa0f810300c736b95122776029bd85d77648f22b2fa99fd0be13e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/0.12.20
|
Release files / pywordsegment-0.4.3-cp37-cp37m-macosx_11_0_arm64.whl
| Download URL | pywordsegment-0.4.3-cp37-cp37m-macosx_11_0_arm64.whl |
|---|---|
| Size | 9.6 MB |
| Tags | CPython 3.7 CPython 3.7 pymalloc macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
4765d31d4c7c4ea294fc51ca918995204fbb175e05864bda884ead247d338d0f
|
|
BLAKE2b-256 checksum How to use checksums |
7e6fc84123f7a8c17cbd770d0e9754624e1f86cec4bed1182d637a80b6ece571
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/0.12.20
|
Release files / pywordsegment-0.4.3-cp37-cp37m-macosx_10_7_x86_64.whl
| Download URL | pywordsegment-0.4.3-cp37-cp37m-macosx_10_7_x86_64.whl |
|---|---|
| Size | 9.7 MB |
| Tags | CPython 3.7 CPython 3.7 pymalloc macOS 10.7+ x86-64 |
|
SHA-256 checksum How to use checksums |
99f53e061aed13282c2db07b460230987070c01d3da743221c32355748a47f39
|
|
BLAKE2b-256 checksum How to use checksums |
203c7173e57883fc7587ba9e35875fbedf68df0c2320d5eb0aef95f3b5e24a8c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
maturin/0.12.20
|
