Skip to main content

ToDo!

Project description

CLTrier ProSem

Usage

from cltrier_prosem import Pipeline

# init pipeline object (load model, data, trainer)
pipeline = Pipeline({
    'encoder': {
        'model': 'deepset/gbert-base',  # huggingface model slug 
    },
    'dataset': {
        'path': './path/data',  # path to data directory (containing train/test.parquet)
        'text_column': 'text',  # column containing src text
        'label_column': 'label',  # column containing target label
        'label_classes': ['class_1', 'class_2'],  # list of target classes
    },
    'classifier': {
        'hid_size': 512,  # size of classifier perceptron
        'dropout': 0.2,  # dropout value
    },
    'pooler': {
        'form': 'cls',
        # type of pooling, possible values: 
        # 'cls', 'sent_mean', 'subword_{first|last|mean|min|max}'
    },
    'trainer': {
        'num_epochs': 5,  # number of training epochs
        'batch_size': 32,  # batch size in both training and evaluation
        'learning_rate': 1e-3,  # trainer learning rate
        'export_path': './path/output',  # output path for logging and results
    },
})

# call pipeline object (training and evaluation)
pipeline()

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

cltrier_prosem-0.1.4.tar.gz (1.6 MB view details)

Uploaded Source

Built Distribution

cltrier_prosem-0.1.4-py3-none-any.whl (10.9 kB view details)

Uploaded Python 3

File details

Details for the file cltrier_prosem-0.1.4.tar.gz.

File metadata

  • Download URL: cltrier_prosem-0.1.4.tar.gz
  • Upload date:
  • Size: 1.6 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: python-requests/2.31.0

File hashes

Hashes for cltrier_prosem-0.1.4.tar.gz
Algorithm Hash digest
SHA256 199972158d6e84966322a676b5da347a7d3629f5e08701799f5cbe8376f4cba6
MD5 191fc0d3eea8e78d59e4bd4d5d80ca9c
BLAKE2b-256 ad8e71af71f235c38024ff928d141340e8679cb7f8dbbfe7dad97327ff1c9abc

See more details on using hashes here.

Provenance

File details

Details for the file cltrier_prosem-0.1.4-py3-none-any.whl.

File metadata

File hashes

Hashes for cltrier_prosem-0.1.4-py3-none-any.whl
Algorithm Hash digest
SHA256 b9312fe5a8a9c790dbaf59e3c191ae9057f6bbe7d9db02947012df60ec74f4d3
MD5 c87b1dc04996108b9b78ebb467695d99
BLAKE2b-256 9915652a1ca224d68948c0963161c699de057d0b86827d93ff9ef31fba4ea2a4

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page