Turkish NLP Tools developed by VNGRS.
Project description
VNLP: Turkish NLP Tools
State-of-the-art, lightweight NLP tools for Turkish language.
Developed by VNGRS.
Functionality:
-
Sentence Splitter
-
Normalizer
- Spelling/Typo correction
- Convert numbers to word form
- Deasciification
-
Stopword Remover:
- Static
- Dynamic
-
Stemmer: Morphological Analyzer & Disambiguator
-
Named Entity Recognizer (NER)
-
Dependency Parser
-
Part of Speech (PoS) Tagger
-
Sentiment Analyzer
-
Turkish Word Embeddings
- FastText
- Word2Vec
- SentencePiece Unigram Tokenizer
-
News Summarization
-
News Paraphrasing
-
Summarization and Paraphrasing models are available in the demo. Contact us at vnlp@vngrs.com for API.
Demo:
- Try the Demo.
Installation
pip install vngrs-nlp
Documentation:
- See the Documentation for the details about usage, classes, functions, datasets and evaluation metrics.
Metrics:
Usage Example:
Dependency Parser
from vnlp import DependencyParser
dep_parser = DependencyParser()
dep_parser.predict("Oğuz'un kırmızı bir Astra'sı vardı.")
[("Oğuz'un", 'PROPN'),
('kırmızı', 'ADJ'),
('bir', 'DET'),
("Astra'sı", 'PROPN'),
('vardı', 'VERB'),
('.', 'PUNCT')]
# Spacy's submodule Displacy can be used to visualize DependencyParser result.
import spacy
from vnlp import DependencyParser
dependency_parser = DependencyParser()
result = dependency_parser.predict("Oğuz'un kırmızı bir Astra'sı vardı.", displacy_format = True)
spacy.displacy.render(result, style="dep", manual = True)
Citation
@article{turker2024vnlp,
title={VNLP: Turkish NLP Package},
author={Turker, Meliksah and Ari, Erdi and Han, Aydin},
journal={arXiv preprint arXiv:2403.01309},
year={2024}
}
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
vngrs_nlp-0.2.4.tar.gz
(3.2 MB
view details)
Built Distribution
File details
Details for the file vngrs_nlp-0.2.4.tar.gz
.
File metadata
- Download URL: vngrs_nlp-0.2.4.tar.gz
- Upload date:
- Size: 3.2 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.10.11
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 385e61f784925ff74bb3384f0f4e4431c0126d69937e61b20a03a7f76f3b0483 |
|
MD5 | 54d353133bd83fd48791604657bad2c7 |
|
BLAKE2b-256 | 1885714ec566d82f7ab4405ed6c6b729202a6f813c2776a8762d4a90bb98c3c2 |
File details
Details for the file vngrs_nlp-0.2.4-py3-none-any.whl
.
File metadata
- Download URL: vngrs_nlp-0.2.4-py3-none-any.whl
- Upload date:
- Size: 3.3 MB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.10.11
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6f70f6b167569515a37e1b1ea1ce70b336dd63c754c3b7183bb89ffc8369da95 |
|
MD5 | 0b534e503f10e0ff772e835fd06c083c |
|
BLAKE2b-256 | 62ddafdecb87eab1857c880eb9f77948fee0b1a3542f6ecd8ad7ce0d25f191a8 |