VNLP: Turkish NLP Tools
State-of-the-art, lightweight NLP tools for Turkish language.
Developed by VNGRS.
Functionality:
-
Sentence Splitter
-
Normalizer
- Spelling/Typo correction
- Convert numbers to word form
- Deasciification
-
Stopword Remover:
- Static
- Dynamic
-
Stemmer: Morphological Analyzer & Disambiguator
-
Named Entity Recognizer (NER)
-
Dependency Parser
-
Part of Speech (PoS) Tagger
-
Sentiment Analyzer
-
Turkish Word Embeddings
- FastText
- Word2Vec
- SentencePiece Unigram Tokenizer
-
News Summarization
-
News Paraphrasing
-
Summarization and Paraphrasing models are available in the demo. Contact us at vnlp@vngrs.com for API.
Demo:
- Try the Demo.
Installation
pip install vngrs-nlp
Documentation:
- See the Documentation for the details about usage, classes, functions, datasets and evaluation metrics.
Metrics:
Usage Example:
Dependency Parser
from vnlp import DependencyParser
dep_parser = DependencyParser()
dep_parser.predict("Oğuz'un kırmızı bir Astra'sı vardı.")
[("Oğuz'un", 'PROPN'),
('kırmızı', 'ADJ'),
('bir', 'DET'),
("Astra'sı", 'PROPN'),
('vardı', 'VERB'),
('.', 'PUNCT')]
# Spacy's submodule Displacy can be used to visualize DependencyParser result.
import spacy
from vnlp import DependencyParser
dependency_parser = DependencyParser()
result = dependency_parser.predict("Oğuz'un kırmızı bir Astra'sı vardı.", displacy_format = True)
spacy.displacy.render(result, style="dep", manual = True)
Citation
@article{turker2024vnlp,
title={VNLP: Turkish NLP Package},
author={Turker, Meliksah and Ari, Erdi and Han, Aydin},
journal={arXiv preprint arXiv:2403.01309},
year={2024}
}
Metadata
Release files for vngrs-nlp 0.2.4
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| vngrs_nlp-0.2.4.tar.gz | 3.2 MB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| vngrs_nlp-0.2.4-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 6.5 MB
Release files / vngrs_nlp-0.2.4.tar.gz
| Download URL | vngrs_nlp-0.2.4.tar.gz |
|---|---|
| Size | 3.2 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
385e61f784925ff74bb3384f0f4e4431c0126d69937e61b20a03a7f76f3b0483
|
|
BLAKE2b-256 checksum How to use checksums |
1885714ec566d82f7ab4405ed6c6b729202a6f813c2776a8762d4a90bb98c3c2
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.1.1 CPython/3.10.11
|
Release files / vngrs_nlp-0.2.4-py3-none-any.whl
| Download URL | vngrs_nlp-0.2.4-py3-none-any.whl |
|---|---|
| Size | 3.3 MB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
6f70f6b167569515a37e1b1ea1ce70b336dd63c754c3b7183bb89ffc8369da95
|
|
BLAKE2b-256 checksum How to use checksums |
62ddafdecb87eab1857c880eb9f77948fee0b1a3542f6ecd8ad7ce0d25f191a8
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.1.1 CPython/3.10.11
|