pyspace
installation
git clone -b pyspace_resources https://github.com/sahinbatmaz/resources.git pyspace_resources
cd pyspace_resources
pip install .
pip install pyspace-toolkit
# UPGRADE
pip install pyspace-toolkit --no-deps --force-reinstall
requirements
'sklearn','pandas','numpy',
'matplotlib','seaborn',
'rasa>=1.10.3','tensorflow',
'lightgbm','xgboost',
'spacy>=2.3.0','spacymoji',
'stanza','nlpcube',
'fuzzywuzzy','jellyfish>=0.8.2','fuzzy_sequence_matcher','fastdtw',
'tabulate','tqdm','jsonlines',
'sklearn-hierarchical-classification','JPype1','MiniSom'
text classification
from pyspace.data.analyse import get_cv_predictions
from pyspace.data.metrics import get_confusion_report
# train # pandas DataFrame # required columns : ['Text', 'Intent']
outdf_avg, y_prob_matrix_avg_df = get_cv_predictions(train, mode='text', cv=5, model_repeat_count=3, n_jobs=5, verbose=11,)
# outdf_avg # required columns : ['Text', 'Intent', 'y_pred'], additional columns : ['y_prob', 'y_2nd_pred', ...]
get_confusion_report(outdf_avg, excel_file_path='./dataset_analysis.xlsx', y_prob_matrix_df=None)
text gcn
import pandas as pd
train = pd.read_csv('dataset.csv')
train.columns = ['text', 'label']
from sklearn.model_selection import StratifiedKFold
skf = StratifiedKFold(n_splits=5, shuffle=True, random_state=0)
train_idx, test_idx = list(skf.split(list(train.index), train['label'].values))[4]
train['tot'] = None
train.at[train_idx, 'tot'] = 'train'
train.at[test_idx, 'tot'] = 'test'
from pyspace.nlp.models.text_gcn.text_gcn import TextGCN_TransductiveClassifier
from pyspace.nlp.models.text_gcn.fast_text_gcn_norank import FastTextGCN_InductiveClassifier
fasttextgcn = FastTextGCN_InductiveClassifier(verbose=1, )
fasttextgcn.train(train, validation_ratio=0.0, batch_size=256, epochs=80, learning_rate=0.01)
future work
Metadata
Release files for pyspace-toolkit 1.1.25.294
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| pyspace_toolkit-1.1.25.294-py3-none-any.whl | Python 3 | none | any | Details for pyspace_toolkit-1.1.25.294-py3-none-any.whl |
Release files / pyspace_toolkit-1.1.25.294-py3-none-any.whl
| Download URL | pyspace_toolkit-1.1.25.294-py3-none-any.whl |
|---|---|
| Size | 347.1 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
809b972b04ccfe763ac0186188ea9c55024e4bf736a04374f840624cb2dd189a
|
|
BLAKE2b-256 checksum How to use checksums |
79f840ddec7afe130f1471e07d62d705398f073952c43df66f11cd75d1fb6a8a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.7.1 importlib_metadata/4.10.0 pkginfo/1.8.2 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.9.9
|
Security for pyspace-toolkit 1.1.25.294
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.