Quick Token
A set of functions to rapidly generate phrased tokens for document representation.
Installation
Two steps
1. Install via Pip as usual
pip install quick-token
2. Install the Spacy Model
PyPi prohibits direct inclusion of this model in the requirements, so you'll need to run this commmand to ensure you have the spacy model.
python -m spacy download en_core_web_md
Basic Example
from quick_token import quick_token
texts = ["Hello there", "how are you today", "I'm feeling great thank you!"]
tokens = quick_token(texts)
> ['', 'today', 'feel great thank']
1 maintainer
Release files for quick-token 0.1.2
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| quick_token-0.1.2.tar.gz | 3.0 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| quick_token-0.1.2-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 6.6 kB
Release files / quick_token-0.1.2.tar.gz
| Download URL | quick_token-0.1.2.tar.gz |
|---|---|
| Size | 3.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
673374893f70fcb43cfabe0fe81ad96d851b31081c99f7d141293e4b026ba8e7
|
|
BLAKE2b-256 checksum How to use checksums |
bedbfda95176911b254a9523ece59ae478e8fe19d2cbaa43ed95b9d00f9e3d43
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.8.3 CPython/3.8.11 Darwin/24.2.0
|
Release files / quick_token-0.1.2-py3-none-any.whl
| Download URL | quick_token-0.1.2-py3-none-any.whl |
|---|---|
| Size | 3.6 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
e4ca753530b46b87f62dc20c5d5c8c9520366f8ab3b975f5b436318e235350a8
|
|
BLAKE2b-256 checksum How to use checksums |
c52eb3ecaa8e83620e713380b11d12756d3cf73a5809deb54db6fc0c7ccbaf86
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.8.3 CPython/3.8.11 Darwin/24.2.0
|
