No project description provided
Project description
Quick Token
A set of functions to rapidly generate phrased tokens for document representation.
Installation
Two steps
1. Install via Pip as usual
pip install quick-token
2. Install the Spacy Model
PyPi prohibits direct inclusion of this model in the requirements, so you'll need to run this commmand to ensure you have the spacy model.
python -m spacy download en_core_web_md
Basic Example
from quick_token import quick_token
texts = ["Hello there", "how are you today", "I'm feeling great thank you!"]
tokens = quick_token(texts)
> ['', 'today', 'feel great thank']
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
quick_token-0.1.2.tar.gz
(3.0 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file quick_token-0.1.2.tar.gz.
File metadata
- Download URL: quick_token-0.1.2.tar.gz
- Upload date:
- Size: 3.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.8.3 CPython/3.8.11 Darwin/24.2.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
673374893f70fcb43cfabe0fe81ad96d851b31081c99f7d141293e4b026ba8e7
|
|
| MD5 |
25a3c8536fddf2cb8bc8d5bf648ef32a
|
|
| BLAKE2b-256 |
bedbfda95176911b254a9523ece59ae478e8fe19d2cbaa43ed95b9d00f9e3d43
|
File details
Details for the file quick_token-0.1.2-py3-none-any.whl.
File metadata
- Download URL: quick_token-0.1.2-py3-none-any.whl
- Upload date:
- Size: 3.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.8.3 CPython/3.8.11 Darwin/24.2.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e4ca753530b46b87f62dc20c5d5c8c9520366f8ab3b975f5b436318e235350a8
|
|
| MD5 |
f72b24ddba4088fd91ad93d6633b2569
|
|
| BLAKE2b-256 |
c52eb3ecaa8e83620e713380b11d12756d3cf73a5809deb54db6fc0c7ccbaf86
|
