Skip to main content

ToDo!

Project description

CLTrier ProSem

Usage

from cltrier_prosem import Pipeline

# init pipeline object (load model, data, trainer)
pipeline = Pipeline({
    'encoder': {
        'model': 'deepset/gbert-base',  # huggingface model slug 
    },
    'dataset': {
        'path': './path/data',  # path to data directory (containing train/test.parquet)
        'text_column': 'text',  # column containing src text
        'label_column': 'label',  # column containing target label
        'label_classes': ['class_1', 'class_2'],  # list of target classes
    },
    'classifier': {
        'hid_size': 512,  # size of classifier perceptron
        'dropout': 0.2,  # dropout value
    },
    'pooler': {
        'form': 'cls',
        # type of pooling, possible values: 
        # 'cls', 'sent_mean', 'subword_{first|last|mean|min|max}'
    },
    'trainer': {
        'num_epochs': 5,  # number of training epochs
        'batch_size': 32,  # batch size in both training and evaluation
        'learning_rate': 1e-3,  # trainer learning rate
        'export_path': './path/output',  # output path for logging and results
    },
})

# call pipeline object (training and evaluation)
pipeline()

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

cltrier_prosem-0.1.3.tar.gz (1.6 MB view details)

Uploaded Source

Built Distribution

cltrier_prosem-0.1.3-py3-none-any.whl (10.9 kB view details)

Uploaded Python 3

File details

Details for the file cltrier_prosem-0.1.3.tar.gz.

File metadata

  • Download URL: cltrier_prosem-0.1.3.tar.gz
  • Upload date:
  • Size: 1.6 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: python-requests/2.31.0

File hashes

Hashes for cltrier_prosem-0.1.3.tar.gz
Algorithm Hash digest
SHA256 6c8f076cea7af0383cdb46104e7dfe76286893500da0e9590e99eb7cdf461665
MD5 8d707f97bc1eb9a4a0ff701ce286680d
BLAKE2b-256 8c84f0dd49bd090a278ec7325d2495bfb4250d242309eb25a86d4d04979146d5

See more details on using hashes here.

Provenance

File details

Details for the file cltrier_prosem-0.1.3-py3-none-any.whl.

File metadata

File hashes

Hashes for cltrier_prosem-0.1.3-py3-none-any.whl
Algorithm Hash digest
SHA256 768f2e17b8fbd1e323fd0827506f61d5bf7352170442d2bd63e20610414b2327
MD5 71f99cce04e43ac95ebb1a399a30cc41
BLAKE2b-256 5dd09a26ad98d1b78ef195e10f4c7cf73ce9c042d771ab7a2cd77649e66499df

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page