ProSem - Probing and Classifying Semantic Spans
Project description
CLTrier ProSem
Usage
from cltrier_prosem import Pipeline
# init pipeline object (load model, data, trainer)
pipeline = Pipeline({
'encoder': {
'model': 'deepset/gbert-base', # huggingface model slug
},
'dataset': {
'path': './path/data', # path to data directory (containing train/test.parquet)
'text_column': 'text', # column containing src text
'label_column': 'label', # column containing target label
'label_classes': ['class_1', 'class_2'], # list of target classes
},
'classifier': {
'hid_size': 512, # size of classifier perceptron
'dropout': 0.2, # dropout value
},
'pooler': {
'form': 'cls',
# type of pooling, possible values:
# 'cls', 'sent_mean', 'subword_{first|last|mean|min|max}'
# if subword probing used
'span_columns': ['span']
},
'trainer': {
'num_epochs': 5, # number of training epochs
'batch_size': 32, # batch size in both training and evaluation
'learning_rate': 1e-3, # trainer learning rate
'export_path': './path/output', # output path for logging and results
},
})
# call pipeline object (training and evaluation)
pipeline()
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
cltrier_prosem-0.4.0.tar.gz
(13.1 MB
view hashes)
Built Distribution
Close
Hashes for cltrier_prosem-0.4.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a19b9fcbb7556ef5c376e606ea7f308c2d5185143cd91ee3bf5290ba38a4c672 |
|
MD5 | ad5a220abbd4e0c4473e8cb955a853f6 |
|
BLAKE2b-256 | e22a272facc8cf6dec7f5edb0a38fa28fe8ab1d678250976c3dc0b4fed6a2377 |