Skip to main content

ToDo!

Project description

CLTrier ProSem

Usage

from cltrier_prosem import Pipeline

# init pipeline object (load model, data, trainer)
pipeline = Pipeline({
    'encoder': {
        'model': 'deepset/gbert-base',  # huggingface model slug 
    },
    'dataset': {
        'path': './path/data',  # path to data directory (containing train/test.parquet)
        'text_column': 'text',  # column containing src text
        'label_column': 'label',  # column containing target label
        'label_classes': ['class_1', 'class_2'],  # list of target classes
    },
    'classifier': {
        'hid_size': 512,  # size of classifier perceptron
        'dropout': 0.2,  # dropout value
    },
    'pooler': {
        'form': 'cls',
        # type of pooling, possible values: 
        # 'cls', 'sent_mean', 'subword_{first|last|mean|min|max}'
    },
    'trainer': {
        'num_epochs': 5,  # number of training epochs
        'batch_size': 32,  # batch size in both training and evaluation
        'learning_rate': 1e-3,  # trainer learning rate
        'export_path': './path/output',  # output path for logging and results
    },
})

# call pipeline object (training and evaluation)
pipeline()

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

cltrier_prosem-0.1.6.tar.gz (1.6 MB view details)

Uploaded Source

Built Distribution

cltrier_prosem-0.1.6-py3-none-any.whl (10.9 kB view details)

Uploaded Python 3

File details

Details for the file cltrier_prosem-0.1.6.tar.gz.

File metadata

  • Download URL: cltrier_prosem-0.1.6.tar.gz
  • Upload date:
  • Size: 1.6 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: python-requests/2.31.0

File hashes

Hashes for cltrier_prosem-0.1.6.tar.gz
Algorithm Hash digest
SHA256 7ba27273004d7ab7ceb1e15c3de6f8b19a3a8bda209c644645963d63641d59a4
MD5 f4e96825155ee1f8fb1a8e023cb46731
BLAKE2b-256 5c6f8a4b54e73deb65c6d96cd711788f29b64763c9ff26d1b50bf5b428c01594

See more details on using hashes here.

Provenance

File details

Details for the file cltrier_prosem-0.1.6-py3-none-any.whl.

File metadata

File hashes

Hashes for cltrier_prosem-0.1.6-py3-none-any.whl
Algorithm Hash digest
SHA256 ab6df9e57ea44245b90b2ca27b94dad77545350726ded974687566130a459235
MD5 4f994b1f337fa74b9541461b6319ed86
BLAKE2b-256 22ae5a0fa349a3a1800a96a9e9244b7b34a2b0b4f45f49fa1bd8dc751a6b63c8

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page