Skip to main content

No project description provided

Project description

FULL

Unsupervised evaluation of open-domain conversations using follow-ups likelihood.


Installation

pip install full

Example

We provide an example script using FULL which reproduces the results of the paper.

Open In Colab

Turn evaluation

from full import FULL
eval_model = FULL()
conversation = ["Hi", "What's your name"]
response = "None of your business"
evaluation = eval_model.evaluate_turn(convesation, response)
print(evaluation)

Conversation evaluation

from full import FULL
eval_model = FULL()
conversation = ["Hi", "What's your name", "None of your business"]
evaluation = eval_model.evaluate_turn(convesation)
print(evaluation)

License

full is distributed under the terms of the MIT license.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

full-0.0.3.1.tar.gz (80.8 kB view details)

Uploaded Source

Built Distribution

full-0.0.3.1-py3-none-any.whl (4.1 kB view details)

Uploaded Python 3

File details

Details for the file full-0.0.3.1.tar.gz.

File metadata

  • Download URL: full-0.0.3.1.tar.gz
  • Upload date:
  • Size: 80.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: python-httpx/0.23.0

File hashes

Hashes for full-0.0.3.1.tar.gz
Algorithm Hash digest
SHA256 3923522acbcec49a7bdde4a9fb0a081e0f62ea010fc0408c2e1fa81bb9cff34f
MD5 ca35ac756125aa539bb07d83f95786e1
BLAKE2b-256 5c8f238c7f2168090eb8f24d45052cdad45789d1c109592c095b4b01f1b65f5b

See more details on using hashes here.

File details

Details for the file full-0.0.3.1-py3-none-any.whl.

File metadata

  • Download URL: full-0.0.3.1-py3-none-any.whl
  • Upload date:
  • Size: 4.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: python-httpx/0.23.0

File hashes

Hashes for full-0.0.3.1-py3-none-any.whl
Algorithm Hash digest
SHA256 3c6fe68107303d180b1cd0e92e9d25701a78f4b14cf6767fc5c2bb2d7c5f8d95
MD5 05bf24aff7aa3907f2a641c0444e0be6
BLAKE2b-256 692bfe12d8c72fde7f4cfc731cf5e4bd7bd30cb6e2ce44b0e2e010e27e1958b5

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page